*** roxanaghe has quit IRC | 00:02 | |
*** tqtran has joined #openstack-infra | 00:06 | |
*** zz_dimtruck is now known as dimtruck | 00:10 | |
*** tqtran has quit IRC | 00:10 | |
*** hparekh has joined #openstack-infra | 00:11 | |
*** amitgandhinz has joined #openstack-infra | 00:12 | |
*** Darkstorm has joined #openstack-infra | 00:12 | |
*** gouthamr has quit IRC | 00:13 | |
*** jcoufal has quit IRC | 00:16 | |
*** amitgandhinz has quit IRC | 00:16 | |
*** gyee has quit IRC | 00:18 | |
*** bswartz has quit IRC | 00:18 | |
*** matrohon has quit IRC | 00:19 | |
*** spzala has quit IRC | 00:23 | |
*** spzala has joined #openstack-infra | 00:23 | |
*** Darkstorm has quit IRC | 00:23 | |
*** yamahata has joined #openstack-infra | 00:26 | |
*** adrian_otto has quit IRC | 00:26 | |
*** adrian_otto has joined #openstack-infra | 00:27 | |
openstackgerrit | Paul Belanger proposed openstack-infra/project-config: Add bindep.txt support to zuul layout https://review.openstack.org/355116 | 00:28 |
---|---|---|
*** spzala has quit IRC | 00:29 | |
*** nwkarsten has joined #openstack-infra | 00:29 | |
*** adrian_otto has quit IRC | 00:32 | |
*** nwkarsten has quit IRC | 00:34 | |
*** Apoorva_ has joined #openstack-infra | 00:35 | |
*** bswartz has joined #openstack-infra | 00:35 | |
*** sc` has quit IRC | 00:35 | |
*** Apoorva has quit IRC | 00:38 | |
*** fguillot_ has joined #openstack-infra | 00:39 | |
*** Apoorva_ has quit IRC | 00:39 | |
*** adrian_otto has joined #openstack-infra | 00:49 | |
*** tkelsey has joined #openstack-infra | 00:51 | |
*** sdake has quit IRC | 00:51 | |
*** thorst_ has joined #openstack-infra | 00:53 | |
*** raunak has joined #openstack-infra | 00:54 | |
*** tphummel has quit IRC | 00:54 | |
*** markvoelker has joined #openstack-infra | 00:55 | |
*** tkelsey has quit IRC | 00:55 | |
*** pvaneck has quit IRC | 00:57 | |
*** oomichi has quit IRC | 00:58 | |
openstackgerrit | James E. Blair proposed openstack-infra/nodepool: Make ZK fixture more robust https://review.openstack.org/355131 | 00:58 |
*** armax has quit IRC | 00:58 | |
*** markvoelker has quit IRC | 01:00 | |
*** thorst_ has quit IRC | 01:01 | |
*** raunak has quit IRC | 01:04 | |
*** thorst_ has joined #openstack-infra | 01:04 | |
*** spzala has joined #openstack-infra | 01:05 | |
*** thorst_ has quit IRC | 01:07 | |
*** mriedem has joined #openstack-infra | 01:11 | |
*** amitgandhinz has joined #openstack-infra | 01:13 | |
openstackgerrit | Merged openstack-infra/zuul: Fix addFailTest https://review.openstack.org/352637 | 01:14 |
openstackgerrit | Merged openstack-infra/zuul: Re-enable test_connection tests https://review.openstack.org/351949 | 01:14 |
openstackgerrit | Merged openstack-infra/zuul: Tests: update references from worker to launch_server https://review.openstack.org/353768 | 01:14 |
openstackgerrit | Merged openstack-infra/zuul: Tests: add an extra debug line when stalled https://review.openstack.org/353769 | 01:14 |
openstackgerrit | Merged openstack-infra/shade: Deal with clouds that don't have fips betterer https://review.openstack.org/355083 | 01:14 |
*** baoli has joined #openstack-infra | 01:18 | |
*** amitgandhinz has quit IRC | 01:18 | |
openstackgerrit | Jeffrey Zhang proposed openstack-infra/project-config: Make the kolla-kubernetes relate jobs non-voting https://review.openstack.org/355132 | 01:20 |
cloudnull | is there a known issue with the infra-mirrors from earlier today? I have a bunch of errors in my gate jobs with the following in various regions: "HTTPError: 404 Client Error: Not Found for url: http://mirror.iad.rax.openstack.org/wheel/ubuntu-16.04-x86_64/pip/"? | 01:21 |
cloudnull | http://logs.openstack.org/52/354952/1/check/gate-openstack-ansible-os_horizon-ansible-func-ubuntu-xenial-nv/4ffb6b3/console.html#_2016-08-12_22_58_25_530701 | 01:22 |
cloudnull | that URL is still 404, so idk if its something with the mirror or something we're doing wrong. | 01:22 |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: add post-send script option https://review.openstack.org/355135 | 01:26 |
openstackgerrit | Matt Riedemann proposed openstack-infra/elastic-recheck: Add query for nova schedule bug 1612875 https://review.openstack.org/355136 | 01:29 |
openstack | bug 1612875 in OpenStack Compute (nova) "FixedIPsTestJson fails server build with "was re-scheduled: operation failed: filter 'nova-no-nd-reflection' already exists with uuid"" [Undecided,New] https://launchpad.net/bugs/1612875 | 01:29 |
Jeffrey4l | does anyone have ideas why the CI result not shown on the top of the Patch Set page. | 01:29 |
*** yamamoto has joined #openstack-infra | 01:32 | |
*** tphummel has joined #openstack-infra | 01:34 | |
*** adrian_otto has quit IRC | 01:39 | |
*** adrian_otto has joined #openstack-infra | 01:39 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: use base_email_create to customize email flexible https://review.openstack.org/355139 | 01:45 |
*** armax has joined #openstack-infra | 01:47 | |
openstackgerrit | Merged openstack-infra/elastic-recheck: Add query for nova schedule bug 1612875 https://review.openstack.org/355136 | 01:49 |
openstack | bug 1612875 in OpenStack Compute (nova) "FixedIPsTestJson fails server build with "was re-scheduled: operation failed: filter 'nova-no-nd-reflection' already exists with uuid"" [Undecided,New] https://launchpad.net/bugs/1612875 | 01:49 |
*** thorst_ has joined #openstack-infra | 01:50 | |
*** rbuzatu has joined #openstack-infra | 01:56 | |
*** markvoelker has joined #openstack-infra | 01:59 | |
*** tphummel has quit IRC | 02:00 | |
*** rbuzatu has quit IRC | 02:01 | |
*** baoli has quit IRC | 02:01 | |
*** yamamoto has quit IRC | 02:02 | |
*** adrian_otto has quit IRC | 02:02 | |
*** baoli has joined #openstack-infra | 02:02 | |
*** yamamoto has joined #openstack-infra | 02:02 | |
*** baoli has quit IRC | 02:03 | |
*** baoli has joined #openstack-infra | 02:04 | |
*** docaedo has quit IRC | 02:05 | |
*** eharney has quit IRC | 02:05 | |
*** yamamoto has quit IRC | 02:07 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: customize abort/failure/success/fixed email notification https://review.openstack.org/355145 | 02:07 |
*** baoli has quit IRC | 02:09 | |
*** baoli has joined #openstack-infra | 02:10 | |
*** julim has quit IRC | 02:12 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: use base_email_create to customize email flexible https://review.openstack.org/355139 | 02:13 |
*** amitgandhinz has joined #openstack-infra | 02:14 | |
*** rajinir has quit IRC | 02:15 | |
*** burgerk has joined #openstack-infra | 02:17 | |
*** thorst_ has quit IRC | 02:18 | |
*** amitgandhinz has quit IRC | 02:20 | |
openstackgerrit | Matt Riedemann proposed openstack-infra/project-config: Add gate-novaclient-dsvm-functional-neutron-nv job https://review.openstack.org/355148 | 02:22 |
*** yamahata has quit IRC | 02:23 | |
*** burgerk has quit IRC | 02:23 | |
*** thorst_ has joined #openstack-infra | 02:24 | |
*** thorst_ has quit IRC | 02:25 | |
*** adrian_otto has joined #openstack-infra | 02:26 | |
*** raunak has joined #openstack-infra | 02:31 | |
*** elo has joined #openstack-infra | 02:37 | |
*** eric_lopez has joined #openstack-infra | 02:40 | |
*** elo has quit IRC | 02:41 | |
*** thorst_ has joined #openstack-infra | 02:45 | |
*** burgerk has joined #openstack-infra | 02:45 | |
*** baoli has quit IRC | 02:46 | |
*** adrian_otto has quit IRC | 02:46 | |
*** baoli has joined #openstack-infra | 02:46 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: use base_email_create to customize email flexible https://review.openstack.org/355139 | 02:47 |
*** thorst_ has quit IRC | 02:48 | |
*** burgerk has quit IRC | 02:50 | |
*** sdake has joined #openstack-infra | 02:50 | |
*** baoli has quit IRC | 02:51 | |
*** tkelsey has joined #openstack-infra | 02:53 | |
*** mriedem has quit IRC | 02:53 | |
Jeffrey4l | what does the `dsvm` stand for in jobs name? | 02:56 |
*** thorst_ has joined #openstack-infra | 02:57 | |
*** tkelsey has quit IRC | 02:58 | |
*** mriedem has joined #openstack-infra | 02:58 | |
*** thorst_ has quit IRC | 02:59 | |
fungi | Jeffrey4l: "DevStack Virtual Machine" (now somewhat of a misnomer as they no longer run on different virtual machines but we haven't renamed them since) | 02:59 |
Jeffrey4l | fungi, so, i can remove this word in the job, right? Kolla's job have a long name, i want to shorten them. | 03:01 |
fungi | Jeffrey4l: ci result table display is broken by the gerrit upgrade earlier today, but we're hoping someone will whip up a javascript patch this weekend to make it work with the slightly changed hyperlink format in our ci comments | 03:02 |
*** yamamoto has joined #openstack-infra | 03:02 | |
Jeffrey4l | Thanks for the infor. | 03:03 |
fungi | Jeffrey4l: yes, that's probably a fine part of the name to remove. for example a lot of projects have functional test jobs that use devstack-gate but don't say dsvm in their names | 03:03 |
Jeffrey4l | *info | 03:03 |
Jeffrey4l | cool. I will try to remove them. | 03:03 |
*** links has joined #openstack-infra | 03:04 | |
*** yamamoto has quit IRC | 03:05 | |
*** yamamoto has joined #openstack-infra | 03:06 | |
*** yamamoto has quit IRC | 03:06 | |
*** yamamoto has joined #openstack-infra | 03:06 | |
*** yamamoto has quit IRC | 03:07 | |
*** sdake has quit IRC | 03:09 | |
fungi | Jeffrey4l: the history is that back when we had separate, e.g., bare-trusty and devstack-trusty job nodes we did a pattern match on dsvm in job names to decide which ones ran on devstack-specific images. now that we've switched to installing distro packages during job runtime for all jobs we've been able to reduce down to using common job nodes for all job types | 03:10 |
fungi | so the "dsvm" in some job names is vestigial | 03:11 |
Jeffrey4l | roger that. thanks. | 03:11 |
fungi | similar to the "check-" or "gate-" prefixes on lots of job names | 03:11 |
Jeffrey4l | so check- gate- is useless, right? | 03:11 |
fungi | we used to use those to be able to run check pipeline and gate pipeline jobs on different providers | 03:11 |
fungi | now we run the same jobs everywhere | 03:12 |
Jeffrey4l | great. i will remove these two word :D | 03:12 |
fungi | so, yes, you could likely drop "gate-" from the start of your job names if they're already too long | 03:12 |
Jeffrey4l | i will. it is really long now. like `gate-kolla-dsvm-deploy-ubuntu-source-ubuntu-xenial-nv` | 03:13 |
*** yamamoto has joined #openstack-infra | 03:15 | |
*** yamamoto has quit IRC | 03:16 | |
*** thorst_ has joined #openstack-infra | 03:16 | |
*** amitgandhinz has joined #openstack-infra | 03:16 | |
*** yamamoto has joined #openstack-infra | 03:17 | |
*** raunak has quit IRC | 03:18 | |
*** thorst_ has quit IRC | 03:19 | |
*** thorst_ has joined #openstack-infra | 03:20 | |
*** amitgandhinz has quit IRC | 03:21 | |
*** yamamoto has quit IRC | 03:21 | |
*** thorst_ has quit IRC | 03:21 | |
*** eric_lopez has quit IRC | 03:22 | |
*** thorst_ has joined #openstack-infra | 03:22 | |
*** spzala has quit IRC | 03:27 | |
*** spzala has joined #openstack-infra | 03:28 | |
*** elo has joined #openstack-infra | 03:28 | |
*** rbuzatu has joined #openstack-infra | 03:28 | |
*** thorst_ has quit IRC | 03:29 | |
*** ansiwen has quit IRC | 03:30 | |
*** mdbooth has quit IRC | 03:30 | |
*** mdbooth has joined #openstack-infra | 03:31 | |
*** ansiwen has joined #openstack-infra | 03:32 | |
*** spzala has quit IRC | 03:32 | |
*** raunak has joined #openstack-infra | 03:32 | |
*** rbuzatu has quit IRC | 03:33 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: customize abort/failure/success/fixed email notification https://review.openstack.org/355145 | 03:33 |
*** sdake has joined #openstack-infra | 03:34 | |
openstackgerrit | Emilien Macchi proposed openstack-infra/project-config: fix typo in comment https://review.openstack.org/355153 | 03:39 |
EmilienM | anteaya: ^ | 03:39 |
EmilienM | fixed :) | 03:39 |
*** Julien-zte has quit IRC | 03:41 | |
*** timl0101 has quit IRC | 03:43 | |
EmilienM | something changed in Gerrit, isn't? I we don't see CI jobs results under the vote, and jobs colors don't work also | 03:48 |
*** ramishra_ has quit IRC | 03:49 | |
*** ramishra has joined #openstack-infra | 03:51 | |
*** sdake has quit IRC | 03:57 | |
*** sdake has joined #openstack-infra | 04:04 | |
*** tqtran has joined #openstack-infra | 04:08 | |
*** tqtran has quit IRC | 04:12 | |
*** dkehn has quit IRC | 04:14 | |
*** dkehn_ has quit IRC | 04:15 | |
*** dkehn has joined #openstack-infra | 04:16 | |
*** amitgandhinz has joined #openstack-infra | 04:17 | |
*** yamamoto has joined #openstack-infra | 04:19 | |
*** kzaitsev_mb has joined #openstack-infra | 04:19 | |
*** adrian_otto has joined #openstack-infra | 04:20 | |
*** amitgandhinz has quit IRC | 04:21 | |
*** csomerville has quit IRC | 04:22 | |
*** markvoelker has quit IRC | 04:23 | |
*** cody-somerville has joined #openstack-infra | 04:23 | |
*** cody-somerville has joined #openstack-infra | 04:23 | |
*** yamamoto has quit IRC | 04:24 | |
*** thorst_ has joined #openstack-infra | 04:25 | |
*** dkehn_ has joined #openstack-infra | 04:26 | |
*** gouthamr has joined #openstack-infra | 04:30 | |
*** thorst_ has quit IRC | 04:33 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: customize abort/failure/success/fixed email notification https://review.openstack.org/355145 | 04:34 |
*** fguillot_ has quit IRC | 04:34 | |
*** yamamoto has joined #openstack-infra | 04:35 | |
*** elo has quit IRC | 04:35 | |
*** elo has joined #openstack-infra | 04:36 | |
*** yamamoto has quit IRC | 04:38 | |
*** sdake has quit IRC | 04:39 | |
*** yamamoto has joined #openstack-infra | 04:39 | |
*** elo has quit IRC | 04:41 | |
*** elo has joined #openstack-infra | 04:41 | |
*** eric_lopez has joined #openstack-infra | 04:45 | |
*** yamamoto has quit IRC | 04:45 | |
*** elo has quit IRC | 04:46 | |
*** IlyaG has quit IRC | 04:48 | |
*** eric_lopez has quit IRC | 04:49 | |
*** itisha has quit IRC | 04:50 | |
*** adrian_otto has quit IRC | 04:51 | |
*** elo has joined #openstack-infra | 04:52 | |
*** sarob has joined #openstack-infra | 04:53 | |
*** sdake has joined #openstack-infra | 04:55 | |
*** pt_15 has quit IRC | 04:56 | |
*** sdake has quit IRC | 04:56 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: customize abort/failure/success/fixed email notification https://review.openstack.org/355145 | 04:57 |
*** gouthamr has quit IRC | 04:59 | |
*** adrian_otto has joined #openstack-infra | 04:59 | |
*** dkehn has quit IRC | 05:03 | |
*** dkehn_ has quit IRC | 05:03 | |
*** baoli has joined #openstack-infra | 05:03 | |
*** elo has quit IRC | 05:04 | |
*** elo has joined #openstack-infra | 05:04 | |
*** baoli has quit IRC | 05:08 | |
*** adrian_otto has quit IRC | 05:09 | |
*** eric_lopez has joined #openstack-infra | 05:09 | |
*** elo has quit IRC | 05:09 | |
*** adrian_otto has joined #openstack-infra | 05:09 | |
*** dkehn has joined #openstack-infra | 05:10 | |
*** apetrich has joined #openstack-infra | 05:11 | |
*** armax has quit IRC | 05:12 | |
*** sdake has joined #openstack-infra | 05:13 | |
*** adrian_otto has quit IRC | 05:13 | |
*** eric_lopez has quit IRC | 05:13 | |
*** eric_lopez has joined #openstack-infra | 05:14 | |
*** adrian_otto has joined #openstack-infra | 05:14 | |
*** dkehn_ has joined #openstack-infra | 05:15 | |
*** sarob has quit IRC | 05:17 | |
*** sarob has joined #openstack-infra | 05:17 | |
*** amitgandhinz has joined #openstack-infra | 05:18 | |
*** eric_lopez has quit IRC | 05:21 | |
*** amitgandhinz has quit IRC | 05:22 | |
*** markvoelker has joined #openstack-infra | 05:24 | |
*** raunak has quit IRC | 05:25 | |
*** IlyaG has joined #openstack-infra | 05:25 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: customize abort/failure/success/fixed email notification https://review.openstack.org/355145 | 05:27 |
*** elo has joined #openstack-infra | 05:28 | |
*** _nadya_ has joined #openstack-infra | 05:28 | |
*** markvoelker has quit IRC | 05:28 | |
*** rbuzatu has joined #openstack-infra | 05:29 | |
*** thorst_ has joined #openstack-infra | 05:31 | |
*** dimtruck is now known as zz_dimtruck | 05:31 | |
*** yamamoto has joined #openstack-infra | 05:33 | |
*** thorst_ has quit IRC | 05:38 | |
*** tonytan4ever has quit IRC | 05:39 | |
*** sarob has quit IRC | 05:44 | |
*** sdake has quit IRC | 05:46 | |
*** r-mibu has quit IRC | 05:46 | |
*** r-mibu has joined #openstack-infra | 05:46 | |
*** adrian_otto has quit IRC | 05:47 | |
*** adrian_otto has joined #openstack-infra | 05:48 | |
*** adrian_otto has quit IRC | 05:50 | |
*** yamamoto has quit IRC | 05:51 | |
*** adrian_otto has joined #openstack-infra | 05:52 | |
*** yamamoto has joined #openstack-infra | 05:52 | |
*** tkelsey has joined #openstack-infra | 05:55 | |
*** adrian_otto has quit IRC | 05:56 | |
*** psachin has joined #openstack-infra | 05:56 | |
*** elo has quit IRC | 05:57 | |
openstackgerrit | Changcheng Intel proposed openstack-infra/jenkins-job-builder: customize abort/failure/success/fixed email notification https://review.openstack.org/355145 | 06:00 |
*** tkelsey has quit IRC | 06:00 | |
*** tonytan4ever has joined #openstack-infra | 06:01 | |
*** psachin has quit IRC | 06:02 | |
*** elo has joined #openstack-infra | 06:02 | |
*** yamamoto has quit IRC | 06:08 | |
*** kzaitsev_mb has quit IRC | 06:12 | |
*** adrian_otto has joined #openstack-infra | 06:14 | |
*** yamamoto has joined #openstack-infra | 06:14 | |
*** senk_ has joined #openstack-infra | 06:16 | |
*** elo has quit IRC | 06:18 | |
*** ihrachys has joined #openstack-infra | 06:18 | |
*** adrian_otto has quit IRC | 06:18 | |
*** amitgandhinz has joined #openstack-infra | 06:18 | |
*** adrian_otto has joined #openstack-infra | 06:19 | |
*** amitgandhinz has quit IRC | 06:23 | |
*** sdake has joined #openstack-infra | 06:29 | |
*** sdake has quit IRC | 06:29 | |
*** elo has joined #openstack-infra | 06:29 | |
*** adrian_otto has quit IRC | 06:33 | |
*** elo has quit IRC | 06:36 | |
*** thorst_ has joined #openstack-infra | 06:36 | |
*** zhurong has joined #openstack-infra | 06:41 | |
*** elo has joined #openstack-infra | 06:41 | |
*** thorst_ has quit IRC | 06:44 | |
*** rwsu has quit IRC | 06:45 | |
*** eric_lopez has joined #openstack-infra | 06:45 | |
openstackgerrit | Luz Cazares proposed openstack/os-testr: Save subunit results file when using --no-discover https://review.openstack.org/339189 | 06:47 |
*** elo has quit IRC | 06:47 | |
*** eric_lopez has quit IRC | 06:51 | |
*** eric_lopez has joined #openstack-infra | 06:51 | |
*** yamamoto has quit IRC | 06:52 | |
*** ihrachys has quit IRC | 06:52 | |
*** Hal has quit IRC | 06:53 | |
*** Hal has joined #openstack-infra | 06:53 | |
*** eric_lopez has quit IRC | 06:57 | |
*** rbuzatu has quit IRC | 06:59 | |
*** rbuzatu has joined #openstack-infra | 07:01 | |
*** yamahata has joined #openstack-infra | 07:06 | |
*** eranrom_ has joined #openstack-infra | 07:08 | |
*** kzaitsev_mb has joined #openstack-infra | 07:10 | |
*** eranrom has quit IRC | 07:10 | |
*** elo has joined #openstack-infra | 07:10 | |
*** _nadya_ has quit IRC | 07:13 | |
*** hparekh has quit IRC | 07:14 | |
*** baoli has joined #openstack-infra | 07:16 | |
*** elo has quit IRC | 07:16 | |
*** amitgandhinz has joined #openstack-infra | 07:19 | |
*** baoli has quit IRC | 07:20 | |
*** hieulq_ has joined #openstack-infra | 07:21 | |
*** elo has joined #openstack-infra | 07:22 | |
*** amitgandhinz has quit IRC | 07:24 | |
*** rbuzatu has quit IRC | 07:26 | |
*** ihrachys has joined #openstack-infra | 07:26 | |
*** hparekh has joined #openstack-infra | 07:27 | |
*** hparekh_ has joined #openstack-infra | 07:27 | |
*** rbuzatu has joined #openstack-infra | 07:27 | |
*** hparekh_ has quit IRC | 07:27 | |
*** dkehn has quit IRC | 07:27 | |
*** dkehn_ has quit IRC | 07:28 | |
*** rbuzatu has quit IRC | 07:31 | |
*** rbuzatu has joined #openstack-infra | 07:31 | |
*** tonytan4ever has quit IRC | 07:32 | |
*** dkehn has joined #openstack-infra | 07:35 | |
*** IlyaG has quit IRC | 07:37 | |
*** ihrachys has quit IRC | 07:41 | |
*** thorst_ has joined #openstack-infra | 07:42 | |
*** kus has joined #openstack-infra | 07:43 | |
*** kzaitsev_mb has quit IRC | 07:45 | |
openstackgerrit | Jeffrey Zhang proposed openstack-infra/project-config: Shorten the job name of Kolla project https://review.openstack.org/355167 | 07:45 |
*** dkehn_ has joined #openstack-infra | 07:47 | |
*** sdake has joined #openstack-infra | 07:49 | |
*** thorst_ has quit IRC | 07:49 | |
*** yamamoto has joined #openstack-infra | 07:52 | |
*** rbuzatu has quit IRC | 07:54 | |
*** yamamoto has quit IRC | 07:58 | |
*** zzzeek has quit IRC | 08:00 | |
*** zzzeek has joined #openstack-infra | 08:00 | |
*** tqtran has joined #openstack-infra | 08:09 | |
*** tqtran has quit IRC | 08:14 | |
*** shashank_hegde has joined #openstack-infra | 08:19 | |
*** amitgandhinz has joined #openstack-infra | 08:20 | |
*** mikelk has joined #openstack-infra | 08:24 | |
*** amitgandhinz has quit IRC | 08:25 | |
*** sdake has quit IRC | 08:30 | |
*** mikelk has quit IRC | 08:31 | |
*** mikelk has joined #openstack-infra | 08:31 | |
*** mikelk has quit IRC | 08:31 | |
*** mikelk has joined #openstack-infra | 08:32 | |
*** tonytan4ever has joined #openstack-infra | 08:32 | |
*** tonytan4ever has quit IRC | 08:37 | |
*** ihrachys has joined #openstack-infra | 08:42 | |
*** hieulq_ has quit IRC | 08:44 | |
*** thorst_ has joined #openstack-infra | 08:46 | |
*** pcaruana has joined #openstack-infra | 08:48 | |
*** thorst_ has quit IRC | 08:54 | |
*** hieulq_ has joined #openstack-infra | 08:57 | |
*** senk_ has quit IRC | 08:58 | |
*** shashank_hegde has quit IRC | 08:58 | |
*** hieulq_ has quit IRC | 09:05 | |
*** _nadya_ has joined #openstack-infra | 09:05 | |
*** mikelk has quit IRC | 09:06 | |
*** cody-somerville has quit IRC | 09:08 | |
*** ihrachys has quit IRC | 09:19 | |
*** sdake has joined #openstack-infra | 09:20 | |
*** amitgandhinz has joined #openstack-infra | 09:21 | |
*** zhurong has quit IRC | 09:24 | |
*** raunak has joined #openstack-infra | 09:25 | |
*** amitgandhinz has quit IRC | 09:25 | |
*** markvoelker has joined #openstack-infra | 09:27 | |
*** raunak_ has joined #openstack-infra | 09:29 | |
*** raunak has quit IRC | 09:30 | |
*** raunak_ is now known as raunak | 09:30 | |
*** markvoelker has quit IRC | 09:32 | |
*** sdake has quit IRC | 09:38 | |
openstackgerrit | guo yunxian proposed openstack/os-testr: Delete openstack/common in flake8 exclude list https://review.openstack.org/355175 | 09:42 |
*** senk_ has joined #openstack-infra | 09:42 | |
*** Hal has quit IRC | 09:43 | |
*** raunak has quit IRC | 09:50 | |
*** thorst_ has joined #openstack-infra | 09:51 | |
*** kus has quit IRC | 09:55 | |
*** thorst_ has quit IRC | 09:58 | |
*** yamahata has quit IRC | 09:59 | |
*** senk_ has quit IRC | 10:21 | |
*** amitgandhinz has joined #openstack-infra | 10:22 | |
*** amitgandhinz has quit IRC | 10:26 | |
*** markvoelker has joined #openstack-infra | 10:28 | |
*** markvoelker has quit IRC | 10:32 | |
*** tonytan4ever has joined #openstack-infra | 10:34 | |
*** ayoung has quit IRC | 10:37 | |
*** tonytan4ever has quit IRC | 10:38 | |
*** ayoung has joined #openstack-infra | 10:49 | |
*** thorst_ has joined #openstack-infra | 10:56 | |
*** tkelsey has joined #openstack-infra | 10:59 | |
*** tkelsey has quit IRC | 11:03 | |
*** thorst_ has quit IRC | 11:04 | |
*** _nadya_ has quit IRC | 11:11 | |
*** yamamoto has joined #openstack-infra | 11:12 | |
*** yamamoto has quit IRC | 11:17 | |
*** yamamoto has joined #openstack-infra | 11:20 | |
*** amitgandhinz has joined #openstack-infra | 11:22 | |
*** Mmike has quit IRC | 11:23 | |
*** Mmike has joined #openstack-infra | 11:25 | |
*** amitgandhinz has quit IRC | 11:27 | |
*** markvoelker has joined #openstack-infra | 11:29 | |
*** markvoelker has quit IRC | 11:33 | |
*** Julien-zte has joined #openstack-infra | 11:34 | |
*** yamamoto has quit IRC | 11:35 | |
*** kzaitsev_mb has joined #openstack-infra | 11:44 | |
fungi | EmilienM: yes, a recent gerrit patch (in yesterday's upgrade) that makes it a less attractive target for spammers slightly altered the hyperlink format in comments, so our custom javascript to build that test results table needs some minor, unforeseen tweaking now | 11:47 |
fungi | hopefully someone will find time to whip that up over the next day or two | 11:47 |
mordred | fungi: I believe in the javascript people | 11:47 |
mordred | they're also not as scary as crab people | 11:48 |
fungi | not to mention the mole people | 11:48 |
*** kzaitsev_mb has quit IRC | 11:48 | |
mordred | ugh. mole people | 11:49 |
mordred | fungi: ansible should now be fixed-fixed on puppetmaster | 11:51 |
*** senk_ has joined #openstack-infra | 11:52 | |
mordred | fungi: I have forced an inventory cache refresh by hand and verify that all of the hosts are actually there | 11:52 |
*** zhurong has joined #openstack-infra | 11:54 | |
fungi | mordred: thanks! | 12:00 |
*** senk_ has quit IRC | 12:00 | |
*** thorst_ has joined #openstack-infra | 12:02 | |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Stop expanding hostvars in ansible inventory https://review.openstack.org/355182 | 12:02 |
mordred | fungi: review.o.o is down | 12:09 |
*** thorst_ has quit IRC | 12:09 | |
mordred | com.google.inject.ProvisionException: Unable to provision, see the following errors: | 12:12 |
mordred | 1) No index versions ready; run Reindex | 12:12 |
mordred | infra-root: if anyone else happens to be up/around ... ^^ | 12:12 |
*** yamamoto has joined #openstack-infra | 12:13 | |
mordred | #status alert gerrit is having issues ... it is being working, no ETA at the moment | 12:20 |
openstackstatus | mordred: sending alert | 12:20 |
*** links has quit IRC | 12:20 | |
-openstackstatus- NOTICE: gerrit is having issues ... it is being working, no ETA at the moment | 12:23 | |
*** ChanServ changes topic to "gerrit is having issues ... it is being working, no ETA at the moment" | 12:23 | |
*** amitgandhinz has joined #openstack-infra | 12:23 | |
mordred | fungi: I am running the reindex, as the gerrit start error message seems to indicate it does not want to start without one | 12:25 |
*** zhurong has quit IRC | 12:25 | |
*** gongysh has joined #openstack-infra | 12:25 | |
openstackstatus | mordred: finished sending alert | 12:26 |
*** zhurong has joined #openstack-infra | 12:26 | |
mordred | Reindexing changes: projects: 55% (640/1149), 48% (171808/352375) (|) | 12:28 |
*** amitgandhinz has quit IRC | 12:28 | |
*** markvoelker has joined #openstack-infra | 12:29 | |
*** markvoelker has quit IRC | 12:34 | |
mordred | Reindexing changes: projects: 76% (879/1149), 68% (242640/352375) (/) | 12:34 |
*** sdague has joined #openstack-infra | 12:46 | |
mordred | Reindexing changes: projects: 99% (1141/1149), 89% (316208/352375) (\) | 12:47 |
*** mriedem1 has joined #openstack-infra | 13:01 | |
*** mriedem has quit IRC | 13:04 | |
*** thorst_ has joined #openstack-infra | 13:05 | |
*** ihrachys has joined #openstack-infra | 13:10 | |
*** mriedem1 is now known as mriedem | 13:11 | |
*** thorst_ has quit IRC | 13:13 | |
*** senk_ has joined #openstack-infra | 13:13 | |
*** gongysh has quit IRC | 13:21 | |
mordred | Reindexing changes: projects: 99% (1147/1149), 97% (342222/352375) (|)t | 13:22 |
*** ayoung has quit IRC | 13:23 | |
*** amitgandhinz has joined #openstack-infra | 13:24 | |
*** Na3iL has joined #openstack-infra | 13:25 | |
*** thorst_ has joined #openstack-infra | 13:28 | |
*** amitgandhinz has quit IRC | 13:28 | |
*** markvoelker has joined #openstack-infra | 13:30 | |
*** rossella_s has joined #openstack-infra | 13:31 | |
mordred | HOLY CRAP the last 3% really sucks | 13:32 |
*** markvoelker has quit IRC | 13:35 | |
*** baoli has joined #openstack-infra | 13:35 | |
*** baoli has quit IRC | 13:37 | |
*** baoli has joined #openstack-infra | 13:38 | |
*** baoli has quit IRC | 13:39 | |
*** zz_dimtruck is now known as dimtruck | 13:40 | |
*** ihrachys has quit IRC | 13:40 | |
*** kzaitsev_mb has joined #openstack-infra | 13:45 | |
*** hockeynut has joined #openstack-infra | 13:45 | |
*** hockeynut has quit IRC | 13:47 | |
*** kzaitsev_mb has quit IRC | 13:50 | |
*** senk_ has quit IRC | 13:55 | |
*** sdake has joined #openstack-infra | 13:55 | |
mordred | Reindexing changes: projects: 99% (1148/1149), 97% (345148/352375) (|) | 13:56 |
*** TRUMP-PENCE has quit IRC | 13:57 | |
*** hieulq_ has joined #openstack-infra | 13:59 | |
mordred | we're at 98! | 13:59 |
mordred | Reindexing changes: projects: 99% (1148/1149), 98% (345338/352375) | 13:59 |
*** TRUMP-PENCE has joined #openstack-infra | 13:59 | |
*** TRUMP-PENCE has quit IRC | 13:59 | |
*** TRUMP-PENCE has joined #openstack-infra | 14:01 | |
*** TRUMP-PENCE has quit IRC | 14:01 | |
*** TRUMP-PENCE has joined #openstack-infra | 14:06 | |
*** TRUMP-PENCE has quit IRC | 14:06 | |
*** TRUMP-PENCE has joined #openstack-infra | 14:08 | |
*** TRUMP-PENCE has quit IRC | 14:08 | |
*** TRUMP-PENCE has joined #openstack-infra | 14:10 | |
*** TRUMP-PENCE has quit IRC | 14:10 | |
*** chlong|mtg has joined #openstack-infra | 14:11 | |
*** tqtran has joined #openstack-infra | 14:11 | |
*** zhurong has quit IRC | 14:12 | |
*** TRUMP-PENCE has joined #openstack-infra | 14:14 | |
*** tqtran has quit IRC | 14:16 | |
*** rbuzatu has joined #openstack-infra | 14:17 | |
*** thorst_ has quit IRC | 14:20 | |
*** thorst_ has joined #openstack-infra | 14:21 | |
*** rbuzatu has quit IRC | 14:22 | |
*** electrofelix has joined #openstack-infra | 14:24 | |
*** amitgandhinz has joined #openstack-infra | 14:25 | |
*** hockeynut has joined #openstack-infra | 14:26 | |
*** rbuzatu has joined #openstack-infra | 14:27 | |
*** hockeynut has quit IRC | 14:28 | |
*** sdake has quit IRC | 14:28 | |
*** thorst_ has quit IRC | 14:29 | |
*** amitgandhinz has quit IRC | 14:29 | |
*** markvoelker has joined #openstack-infra | 14:31 | |
*** rossella_s has quit IRC | 14:34 | |
*** markvoelker has quit IRC | 14:35 | |
*** arif-ali has quit IRC | 14:36 | |
*** rcernin has joined #openstack-infra | 14:39 | |
*** hockeynut has joined #openstack-infra | 14:43 | |
mordred | Reindexing changes: projects: 99% (1148/1149), 98% (348046/352375) | 14:43 |
mordred | have I mentioned this is my least favorite thing ever? | 14:44 |
*** _nadya_ has joined #openstack-infra | 14:44 | |
*** hockeynut has quit IRC | 14:45 | |
kragniz | looks grim | 14:45 |
*** kzaitsev_mb has joined #openstack-infra | 14:46 | |
*** asselin_ has joined #openstack-infra | 14:47 | |
*** sdague has quit IRC | 14:48 | |
*** tphummel has joined #openstack-infra | 14:48 | |
*** thorst_ has joined #openstack-infra | 14:48 | |
*** thorst_ has quit IRC | 14:48 | |
*** asselin has quit IRC | 14:50 | |
*** adrian_otto has joined #openstack-infra | 14:50 | |
*** kzaitsev_mb has quit IRC | 14:51 | |
*** hieulq_ has quit IRC | 14:53 | |
mordred | Reindexing changes: projects: 99% (1148/1149), 98% (348728/352375) | 14:55 |
jeblair | o/ | 14:57 |
fungi | mordred: oh, when you got puppet working again did that retrigger a restart and an offline reindex? | 14:57 |
fungi | the version of gerrit we have installed now is supposed to support online reindexing | 14:58 |
mordred | fungi: yah | 14:58 |
mordred | fungi: well, it triggered a restart | 14:58 |
mordred | when I first looked at things, there were no javas running | 14:58 |
*** adrian_otto has quit IRC | 14:59 | |
*** rfolco has joined #openstack-infra | 14:59 | |
fungi | apparently the reason it spends so long on the last percent is that it is one thread per repo, and runs through them in alpha order, so takes a while before it gets to nova and then nova is running on one thread for a couple hours after that point | 14:59 |
fungi | i think zaro has submitted a patch upstream to switch that scheduler to descending order by size, which should more efficiently us ethe available threads | 15:00 |
mordred | ++ | 15:00 |
*** fguillot_ has joined #openstack-infra | 15:00 | |
fungi | s/size/change count/ | 15:00 |
*** _nadya_ has quit IRC | 15:01 | |
mordred | so I'm not sure what action puppet triggered that caused gerrit to think a full offline reindex was required | 15:01 |
mordred | but the init script refused to start gerrit otherwise :( | 15:01 |
fungi | mordred: i probably didn't correctly fake the upgrade when i did it manually | 15:01 |
mordred | possibly so? | 15:01 |
fungi | i downloaded into the gerrit-wars directory and then copied that to review_site/bin/gerrit.war but i may have overlooked something | 15:02 |
mordred | yah - I think there were things in the puppet logs about gerrit.war - but it didn't look like it installed a new version | 15:02 |
* mordred glares at puppet | 15:03 | |
fungi | but i ran the same init from the puppet exec after that, and then started the service from the initscript and it ran fine | 15:03 |
mordred | ooh. we're at 99 | 15:03 |
mordred | Reindexing changes: projects: 99% (1148/1149), 99% (349180/352375 | 15:03 |
fungi | i think zaro has proposed (or was going to propose) a change to set secondary_index=false in the openstack_project::review class so that we no longer fire an offline reindex on upgrade, but it sounds like it thought one was necessary for some reason? | 15:04 |
jeblair | yeah, puppet 'upgraded' gerrit again | 15:04 |
*** ihrachys has joined #openstack-infra | 15:05 | |
fungi | i thought it only did that if the filename it was going to download wasn't already present in the gerrit-wars fir | 15:05 |
fungi | dir | 15:05 |
mordred | jeblair: well, while waiting for this to finish, I've updated the shade changes we need for ipv6 with tests and release notes - as well as wrote tests for the change I landed yesterday | 15:06 |
mordred | so - yay for that I guess :) | 15:06 |
fungi | also, wiki upgrade with newer captcha implementation is still not preventing all spammers. got three more overnight | 15:06 |
mordred | blerg | 15:06 |
mordred | well, at least we've upgraded/modernized so iterating on new solutions should be easier | 15:07 |
jeblair | fungi: it did some stuff related to the libraries (bouncy castle, mysql).... it also changed some ownership/perms of gerrit.war.... | 15:07 |
jeblair | Aug 13 12:03:10 review puppet-user[48695]: (/Stage[main]/Gerrit/Exec[gerrit-initial-init]) Triggered 'refresh' from 2 events | 15:07 |
fungi | oh, i wonder if i downloaded it as the review user instead of root | 15:07 |
*** rbuzatu has quit IRC | 15:07 | |
jeblair | so two (2) things made it want to init. | 15:07 |
jeblair | we get to guess which | 15:08 |
jeblair | which eventually led to Aug 13 12:08:48 review puppet-user[48695]: (/Stage[main]/Gerrit/Exec[gerrit-reindex]) Failed to call refresh: Command exceeded timeout | 15:08 |
jeblair | which is the current sad | 15:08 |
*** hockeynut has joined #openstack-infra | 15:09 | |
fungi | got it. so it thought it needed to upgrade again, which triggered a reindex, which got killed by the timeout, which left it unable to start because of a partially complete index | 15:09 |
jeblair | ya, that's what it looks like to me | 15:09 |
fungi | if it hadn't triggered the offline reindex exec then it would have just been a momentary blip for a gerrit restart i guess | 15:10 |
mordred | I think definitely removing the auto-offline-reindex from puppet would be good | 15:11 |
mordred | since there are pretty much no cases in which we want puppet to be the one doing that | 15:11 |
jeblair | yep | 15:11 |
*** annegentle has joined #openstack-infra | 15:11 | |
fungi | yeah, and also we're supposed to be able to reindex online since yesterday's upgrade | 15:11 |
mordred | \o/ | 15:12 |
fungi | at least you caught this pretty quickly once puppet started working again | 15:12 |
fungi | sorry i wasn't around to help troubleshoot, i only just got back from breakfast with the inlaws | 15:13 |
*** arif-ali has joined #openstack-infra | 15:13 | |
mordred | no worries at all - it hasn't been terrible - just boring waiting on the reindex | 15:14 |
mordred | breakfast with the inlaws is, they tell me, important | 15:14 |
fungi | hopefully this will be the last one ever | 15:14 |
mordred | +100 | 15:14 |
fungi | i'll see if zaro already has that change proposed, or write one myself | 15:14 |
fungi | and then i'll see if i can figure out the hideci.js patch we need for handling the new href tag format | 15:15 |
*** electrofelix has quit IRC | 15:15 | |
*** armax has joined #openstack-infra | 15:20 | |
*** tonytan4ever has joined #openstack-infra | 15:20 | |
*** megm has quit IRC | 15:21 | |
fungi | yeah, didn't find a change for it yet in my gertty cache, so i've got one ready to push as soon as gerrit is running again | 15:23 |
*** annegentle has quit IRC | 15:23 | |
mordred | woot | 15:24 |
mordred | Reindexing changes: projects: 99% (1148/1149), 99% (350462/352375) | 15:24 |
fungi | working on a hideci.js patch now | 15:24 |
*** amitgandhinz has joined #openstack-infra | 15:25 | |
fungi | javascript is a dark art | 15:26 |
* fungi prepares a gate seal | 15:26 | |
jeblair | 1913 patches to index remain, 1913 patches to index; take one patch, index it down, 1912 patches to index remain! | 15:26 |
fungi | as the old saying goes, never cast a summoning if you haven't also memorized the corresponding binding | 15:26 |
fungi | er, that would have been better as "my grandmother always said... | 15:27 |
jeblair | or even your eternally young great, great, great grandmother. | 15:28 |
*** rfolco has quit IRC | 15:28 | |
fungi | heh | 15:28 |
fungi | seems like i haven't been up to dunwich to visit for _aeons_ | 15:29 |
*** shashank_hegde has joined #openstack-infra | 15:29 | |
*** gouthamr has joined #openstack-infra | 15:30 | |
*** amitgandhinz has quit IRC | 15:30 | |
mordred | done! | 15:30 |
mordred | ok | 15:30 |
mordred | so - /etc/init.d/gerrit start isn't going to do anything evil, right? | 15:30 |
fungi | or i just use sudo service gerrit start | 15:31 |
fungi | but yeah, 'tis fine | 15:31 |
*** hockeynut has quit IRC | 15:32 | |
mordred | I've done that - it says ok - but the web app seems unhappy | 15:32 |
*** markvoelker has joined #openstack-infra | 15:32 | |
mordred | shift-reload got it | 15:32 |
fungi | takes at least a minute to start | 15:32 |
fungi | don't panic yet | 15:32 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Base auto_ip on interface_ip not public_v4 https://review.openstack.org/355048 | 15:32 |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Add tests to show IP inference in missed conditions https://review.openstack.org/355183 | 15:32 |
fungi | if you see the war running in the process list | 15:33 |
fungi | also, gertty knows better than we do | 15:33 |
mordred | yah. it's working | 15:33 |
fungi | as does gerritbot apparently | 15:33 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Stop triggering offline Gerrit reindexing https://review.openstack.org/355184 | 15:33 |
fungi | jeblair: mordred: ^ with fire | 15:33 |
*** markvoelker has quit IRC | 15:36 | |
*** mriedem has quit IRC | 15:36 | |
fungi | well, i _thought_ the hideci.js issue was due to rel="nofollow" now being in the href tags, but i'm not seeing an overly strict regex in use by the results parser to account for it | 15:37 |
mordred | might be a dom restructure due to GWT then | 15:41 |
fungi | oh, yep, comparing an already cached tab, the verified comments from the jenkins user were formatted differently than they are now | 15:43 |
*** megm has joined #openstack-infra | 15:43 | |
fungi | before the job name was hyperlinked to the log. now it's the job name followed by a raw url and only the latter is hyperlinked | 15:44 |
fungi | and the result lines have bullets by them now | 15:45 |
mordred | did they get rid of the ability to post url comments? | 15:46 |
jeblair | if they have bullets, then our commentlink regex trick is failing | 15:47 |
fungi | aha, that would 'splain it (and would also confuse hideci.js) | 15:47 |
jeblair | we post them as '* list items' and then the commentlink regex manipulates that into the nicer formatting | 15:47 |
*** kzaitsev_mb has joined #openstack-infra | 15:47 | |
fungi | i guess that's only directly in the gerrit puppet module, not in openstack_project | 15:48 |
jeblair | it's in modules/openstack_project/manifests/review.pp | 15:49 |
fungi | oh, in the manifest | 15:49 |
jeblair | match => '<li>([^ ]+) <a href=\"[^\"]+\" target=\"_blank\">([^<]+)</a> : ([^ ]+)([^<]*)</li>', | 15:49 |
jeblair | html => '<li class=\"comment_test\"><span class=\"comment_test_name\"><a href=\"$2\">$1</a></span> <span class=\"comment_test_result\"><span class=\"result_$3\">$3</span>$4</span></li>', | 15:49 |
fungi | right, for some reason i though we had put it directl yin the config template | 15:49 |
fungi | so that's actually straightforward to fix i think | 15:50 |
jeblair | yeah, prolly just need to add the nofollow bit to that first line | 15:50 |
mordred | ++ | 15:50 |
jeblair | i'll do it | 15:50 |
*** fguillot_ is now known as fguillot_afk | 15:50 | |
fungi | im about to push it, just writing the commit message | 15:51 |
jeblair | ok you're ahead of me :) | 15:51 |
*** fguillot_afk has quit IRC | 15:51 | |
jeblair | by a good 5 seconds | 15:51 |
*** shashank_hegde has quit IRC | 15:51 | |
*** baoli has joined #openstack-infra | 15:51 | |
*** ihrachys has quit IRC | 15:51 | |
openstackgerrit | Monty Taylor proposed openstack-infra/shade: Base auto_ip on interface_ip not public_v4 https://review.openstack.org/355048 | 15:52 |
*** kzaitsev_mb has quit IRC | 15:52 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Update Gerrit CI comment regex for rel="nofollow" https://review.openstack.org/355186 | 15:53 |
fungi | jeblair: mordred: there ^ complete with upstream change reference | 15:53 |
fungi | should i carry rel="nofollow" into the results table too? | 15:54 |
fungi | that might be wise to thwart spammers | 15:54 |
mordred | yah - I think so | 15:54 |
fungi | adding now | 15:54 |
mordred | also, are target and rel always in that order? | 15:54 |
jeblair | heh, yeah, otherwise i reckon we would have created a (very subtle) loophole | 15:54 |
jeblair | mordred: they appear to be on inspection | 15:55 |
mordred | cool | 15:55 |
jeblair | oh wait | 15:55 |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Update Gerrit CI comment regex for rel="nofollow" https://review.openstack.org/355186 | 15:55 |
*** mriedem has joined #openstack-infra | 15:55 | |
jeblair | that's not the order i see.... gimme a sec to make sure i'm looking right | 15:55 |
*** baoli has quit IRC | 15:56 | |
fungi | that was the order https://gerrit-review.googlesource.com/#/c/80320/4/gerrit-gwtexpui/src/main/java/com/google/gwtexpui/safehtml/client/SafeHtml.java showed | 15:56 |
fungi | but maybe java can reorder them or something? | 15:56 |
*** armax has quit IRC | 15:57 | |
pabelanger | morning | 15:58 |
jeblair | weird. firebug has them as "<a rel="nofollow" target...." | 15:59 |
jeblair | but i don't know if that's firebug or gerrit | 15:59 |
pabelanger | mordred: wow, osic is using ipv6 I think | 15:59 |
fungi | pabelanger: they switched it on yesterday | 16:00 |
jeblair | fungi: your order is in what's in our repo too: http://git.openstack.org/cgit/openstack-infra/gerrit/commit/?h=openstack/2.11.4&id=b50155fc803cd2b5124b37f8dbe470752152774a | 16:00 |
pabelanger | fungi: right, but mordred said it might now work because of shade bug | 16:00 |
jeblair | fungi: why don't we experiment on review-dev? | 16:00 |
pabelanger | fungi: and had a revert up | 16:00 |
fungi | patch on the way | 16:00 |
pabelanger | checking logs to see if things are happy now | 16:01 |
mordred | pabelanger: so - using ipv6 is one part ... | 16:01 |
mordred | pabelanger: the question is did nodepool also allocate an ipv4 FIP needlessly? | 16:01 |
jeblair | fungi: 'because gerrit is not running on review-dev' would be the answer to that question. | 16:01 |
jeblair | fungi: meh. i vote we land your patch, and if it doesn't work, move it to my order. :) | 16:01 |
mordred | jeblair: ++ | 16:01 |
*** dimtruck is now known as zz_dimtruck | 16:02 | |
*** zz_dimtruck is now known as dimtruck | 16:02 | |
openstackgerrit | Jeremy Stanley proposed openstack-infra/system-config: Test Gerrit CI comment regex for rel="nofollow" https://review.openstack.org/355188 | 16:03 |
pabelanger | mordred: http://paste.openstack.org/show/556611/ | 16:03 |
fungi | well, there's the corresponding change for review-dev too | 16:03 |
pabelanger | I do see 1 ipv4 address | 16:03 |
*** thorst_ has joined #openstack-infra | 16:03 | |
pabelanger | but it is private | 16:03 |
fungi | i'm fine landing them in either order | 16:03 |
fungi | i can also hand-patch it in the gerrit config and do a quick restart if we're concerned | 16:04 |
mordred | pabelanger: great | 16:04 |
mordred | pabelanger: does osic have fips? | 16:04 |
fungi | yeah, gerrit currently refuses to start on review-dev | 16:05 |
pabelanger | mordred: we don't use them any more. They allocated us ipv4 address a while back | 16:05 |
fungi | "No index versions ready; run Reindex" | 16:06 |
fungi | so we probably triggered a similar brokenness on review-dev | 16:06 |
*** yaume has joined #openstack-infra | 16:06 | |
fungi | and since zaro imported the nova repo into it to be able to test a sufficiently involved online reindex, it now runs longer than our timeout there too | 16:06 |
fungi | i'll start fixing it | 16:06 |
mordred | pabelanger: awesome. | 16:06 |
*** thorst_ has quit IRC | 16:07 | |
mordred | pabelanger: so - I'm going to peek a little more to see why this worked | 16:07 |
mordred | :) | 16:07 |
fungi | i've got an offline reindex running on review-dev now | 16:08 |
fungi | that will probably take an hour or so to complete | 16:08 |
*** shashank_hegde has joined #openstack-infra | 16:09 | |
fungi | #status ok The Gerrit service on review.openstack.org is online again | 16:11 |
openstackstatus | fungi: sending ok | 16:11 |
*** dimtruck is now known as zz_dimtruck | 16:12 | |
*** ChanServ changes topic to "Discussion of OpenStack Developer and Community Infrastructure | docs http://docs.openstack.org/infra/ | bugs https://storyboard.openstack.org/ | source https://git.openstack.org/cgit/openstack-infra/ | channel logs http://eavesdrop.openstack.org/irclogs/%23openstack-infra/" | 16:13 | |
-openstackstatus- NOTICE: The Gerrit service on review.openstack.org is online again | 16:13 | |
pabelanger | jeblair: do we need to update zuul_console for ipv6 support? | 16:13 |
openstackstatus | fungi: finished sending ok | 16:16 |
pabelanger | tcp 0 0 0.0.0.0:19885 0.0.0.0:* LISTEN | 16:17 |
pabelanger | look like we are only binding to ipv4 | 16:17 |
fungi | could presumably just change that to ::19885 | 16:20 |
fungi | i haven't looked into whether we're using socket.socket() for that or what | 16:20 |
pabelanger | Ya, if I under stand the code in zuul_console, it should trying both ipv4/ipv6. But ipv4 seems to take priority | 16:21 |
fungi | for a listening socket to bind to all available interfaces and address families, i don't think you need to try/order anything | 16:21 |
*** adrian_otto has joined #openstack-infra | 16:22 | |
*** tonytan4ever has quit IRC | 16:22 | |
fungi | most linux distros' have been setting the kernel to dual-stack and support unified family sockets for years afaik | 16:22 |
pabelanger | looks like we are using socket.getaddrinfo() | 16:23 |
pabelanger | https://docs.python.org/2/library/socket.html has an example, which I am trying | 16:23 |
fungi | at least at a syscall level i think you have to set the socket option IPV6_V6ONLY on an AF_INET6 socket if you don't want it also listening on v4 addresses | 16:24 |
*** amitgandhinz has joined #openstack-infra | 16:26 | |
jeblair | pabelanger: oh wow, i love that the example is not for the thing you should actually do | 16:27 |
jeblair | "The server side will listen to the first address family available (it should listen to both instead)." | 16:27 |
pabelanger | ya | 16:28 |
pabelanger | >>> socket.getaddrinfo(None, 80,socket.AF_UNSPEC,socket.SOCK_STREAM,0,socket.AI_PASSIVE) | 16:28 |
pabelanger | [(2, 1, 6, '', ('0.0.0.0', 80)), (10, 1, 6, '', ('::', 80, 0, 0))] | 16:28 |
pabelanger | we are only binding to ipv4 | 16:28 |
pabelanger | since it is returned first | 16:28 |
*** yaume has quit IRC | 16:28 | |
jeblair | so if i'm following, we actually need to listen on *every* item returned | 16:29 |
jeblair | so we'll need to listen on and store N sockets (where N=2) | 16:29 |
pabelanger | Looks that way | 16:29 |
jeblair | thiss will complicate the logic somewhat; i think we'll need 2 accept threads. | 16:30 |
jeblair | (right now, the accept thread is the main thread). | 16:31 |
*** amitgandhinz has quit IRC | 16:31 | |
*** fguillot_ has joined #openstack-infra | 16:32 | |
jeblair | anyway, it shouldn't be too bad. i'd probably just have the socket creation spawn an accept thread for each socket it binds, then have the main thread wait for those threads to join. | 16:32 |
pabelanger | Aside of the lack of console, it does look like 2001:4800:1ae1:18:f816:3eff:fe55:8977 is working correctly | 16:32 |
fungi | in other projects i've just done something along the lines of socket.socket(socket.AF_INET6, socket.SOCK_STREAM).bind(('::', port)) and it accepts on both its ipv4 and ipv6 addresses | 16:32 |
*** hieulq_ has joined #openstack-infra | 16:33 | |
*** markvoelker has joined #openstack-infra | 16:33 | |
jeblair | oh that works? | 16:33 |
pabelanger | cloudnull: good news, it looks like osic-cloud1 is working correctly with ipv6. Change when live a few hours ago | 16:34 |
fungi | yeah, as long as the kernel doesn't have forced separation for v4 and v6only sockets, which has been passe for ages | 16:34 |
fungi | except on *bsds still i thinkl | 16:34 |
fungi | you can still set linux to act that way, but it's not typical in modern distros | 16:35 |
*** thorst_ has joined #openstack-infra | 16:37 | |
*** markvoelker has quit IRC | 16:37 | |
fungi | for example, here's a mud engine i did it in: http://mudpy.org/gitweb?p=mudpy.git;a=blob;f=lib/mudpy/misc.py;h=ea18ffb;hb=HEAD#l458 | 16:38 |
fungi | in my configuration i set the parameter that ends up in the "host" variable to "::" and can connect on its ipv4 or ipv6 addresses, yet netstat -lnt only shows the port listening on :: | 16:39 |
zaro | looks like i'm missing the fun | 16:39 |
jeblair | pabelanger: i like fungi's idea :) | 16:40 |
mordred | pabelanger: ok - so - there is another bug (which isn't breaking anytihng but which I'll fix now that I see it) | 16:40 |
fungi | jeblair: all the best server ideas come from muds after all | 16:40 |
mordred | pabelanger: that bug has happily caused the ipv6 on osic to work when it should have broken | 16:40 |
mordred | pabelanger: so we should still land my fix for that | 16:40 |
zaro | fungi: -1 for your change to stop triggering offline reindex https://review.openstack.org/#/c/355184 | 16:40 |
jeblair | fungi: yeah, if it works for a mud, it'll work for us. | 16:40 |
fungi | zaro: thanks, looking | 16:40 |
*** thorst_ has quit IRC | 16:41 | |
pabelanger | jeblair: fungi: let me see if I can get it working. Might need some hand holding on this | 16:41 |
mordred | (for some reason shade is detecting the private v4 address on osic as a public address ... I have not yet figured out why) | 16:41 |
zaro | sorry, i was playing with review-dev to verify rel=nofollow issue yesterday but didn't restore it | 16:41 |
pabelanger | mordred: do we need to revert OSIC to ipv4 or can we keep moving forward? | 16:41 |
mordred | nope | 16:41 |
mordred | it's all great | 16:41 |
mordred | it's a happy accident for now :) | 16:41 |
*** senk_ has joined #openstack-infra | 16:41 | |
pabelanger | yay | 16:41 |
jeblair | pabelanger: cool, i'm going to go $saturday, but can check back in on things later. | 16:42 |
pabelanger | jeblair: ack | 16:42 |
openstackgerrit | Monty Taylor proposed openstack-infra/system-config: Tell shade that OSIC doesn't need floating ips https://review.openstack.org/355191 | 16:42 |
mordred | pabelanger: this will cut down on the number of API calls we do to accomplish things though | 16:42 |
*** yamamoto has quit IRC | 16:43 | |
fungi | zaro: ooh, great catch. i totally forgot to check whether that variable was used for anything else | 16:43 |
pabelanger | mordred: great | 16:43 |
zaro | fungi: looks like review-dev is in same state as review now? we can test fixes on now? | 16:43 |
fungi | zaro: yeah, i manually ran an offline reindex on review-dev and was able to start gerrit again after that | 16:44 |
fungi | basically same thing happened there as happened on review.o.o | 16:44 |
openstackgerrit | Merged openstack-infra/system-config: Update Gerrit CI comment regex for rel="nofollow" https://review.openstack.org/355186 | 16:45 |
fungi | after that ^ is showing up on review.o.o i'll restart gerrit there again quickly | 16:46 |
zaro | fungi: are you working on https://review.openstack.org/#/c/355184 i can help there if needed | 16:47 |
*** shashank_hegde has quit IRC | 16:48 | |
fungi | zaro: i haven't started revising it yet, so if you want to take it over i'll be happy to review! | 16:48 |
zaro | fungi: ok. new PS coming soon | 16:48 |
*** kzaitsev_mb has joined #openstack-infra | 16:48 | |
fungi | i have some weekend stuff i need to get done not in here too | 16:48 |
fungi | but want to make sure everything is settled properly first | 16:49 |
*** chlong|mtg has quit IRC | 16:52 | |
*** kzaitsev_mb has quit IRC | 16:53 | |
*** IlyaG has joined #openstack-infra | 16:53 | |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Add an offline reindex parameter https://review.openstack.org/355194 | 16:54 |
*** mlekkas has quit IRC | 16:54 | |
*** ihrachys has joined #openstack-infra | 16:54 | |
zaro | fungi: ^ | 16:55 |
*** Na3iL has quit IRC | 16:56 | |
openstackgerrit | Khai Do proposed openstack-infra/puppet-gerrit: Add an offline reindex parameter https://review.openstack.org/355194 | 16:57 |
*** mriedem has quit IRC | 17:00 | |
*** IlyaG has quit IRC | 17:00 | |
*** psachin has joined #openstack-infra | 17:03 | |
*** raunak has joined #openstack-infra | 17:07 | |
*** adrian_otto has quit IRC | 17:07 | |
openstackgerrit | Paul Belanger proposed openstack-infra/zuul: Simplify zuul_console port binding logic https://review.openstack.org/355197 | 17:09 |
*** rhallisey has joined #openstack-infra | 17:09 | |
pabelanger | fungi: jeblair: ^ I believe that should work for ipv4/ipv6. I tested the code locally and seems to work. Let me know what you think | 17:09 |
pabelanger | mordred: also, did we still need to restart nodepool.o.o or have you done that already to pickup latest shade release? | 17:10 |
*** IlyaG has joined #openstack-infra | 17:11 | |
*** thorst_ has joined #openstack-infra | 17:12 | |
*** tphummel has quit IRC | 17:14 | |
*** thorst_ has quit IRC | 17:15 | |
*** IlyaG has quit IRC | 17:15 | |
*** thorst_ has joined #openstack-infra | 17:15 | |
*** ihrachys has quit IRC | 17:16 | |
mordred | pabelanger: I have not restarted it | 17:16 |
*** tphummel has joined #openstack-infra | 17:16 | |
*** hieulq_ has quit IRC | 17:17 | |
mordred | pabelanger: I'd like to land that system-config change though before we do - should cut down on the number of API calls we're making | 17:17 |
pabelanger | mordred: WFM | 17:18 |
zaro | mordred: turn off offline reindex https://review.openstack.org/#/c/355194/ | 17:19 |
*** thorst_ has quit IRC | 17:20 | |
fungi | restarting gerrit on review.o.o again now for the commentlink patch | 17:21 |
mordred | zaro: +A - thanks! | 17:21 |
*** sdake has joined #openstack-infra | 17:21 | |
fungi | that seems to have worked. ci somments are back to our expected format now and the results table has returned | 17:24 |
fungi | i'm disappearing to saturday some stuff | 17:24 |
fungi | back later maybe | 17:24 |
mordred | woot! | 17:24 |
Krenair | how do you subscribe to things in storyboard? | 17:27 |
*** amitgandhinz has joined #openstack-infra | 17:27 | |
Krenair | if you make a comment are you automatically emailed about any further comments? | 17:28 |
*** amitgandhinz has quit IRC | 17:31 | |
*** thorst_ has joined #openstack-infra | 17:31 | |
*** zhenguo has quit IRC | 17:32 | |
SotK | Krenair: you'll have to subscribe to the story you commented on for that at the moment | 17:32 |
Krenair | that's what I'd like to do, but how? | 17:33 |
SotK | There is a star next to the story title, which when clicked will subscribe you to the story | 17:33 |
*** markvoelker has joined #openstack-infra | 17:33 | |
Krenair | aha, thanks | 17:33 |
*** thorst_ has quit IRC | 17:35 | |
*** markvoelker has quit IRC | 17:38 | |
*** e0ne has joined #openstack-infra | 17:39 | |
*** tphummel has quit IRC | 17:39 | |
*** bswartz has quit IRC | 17:50 | |
*** raunak has quit IRC | 17:50 | |
openstackgerrit | Merged openstack-infra/puppet-gerrit: Add an offline reindex parameter https://review.openstack.org/355194 | 17:54 |
*** rbuzatu has joined #openstack-infra | 17:54 | |
*** senk_ has quit IRC | 17:55 | |
*** senk_ has joined #openstack-infra | 17:56 | |
*** sdake has quit IRC | 18:03 | |
*** sdake has joined #openstack-infra | 18:05 | |
*** yaume has joined #openstack-infra | 18:06 | |
*** gouthamr has quit IRC | 18:07 | |
*** tqtran has joined #openstack-infra | 18:13 | |
*** rbuzatu has quit IRC | 18:16 | |
*** tqtran has quit IRC | 18:17 | |
*** senk_ has quit IRC | 18:17 | |
*** yamamoto has joined #openstack-infra | 18:17 | |
*** yamamoto has quit IRC | 18:22 | |
*** tonytan4ever has joined #openstack-infra | 18:23 | |
*** rcernin has quit IRC | 18:27 | |
*** hockeynut has joined #openstack-infra | 18:27 | |
*** tonytan4ever has quit IRC | 18:27 | |
*** rbuzatu has joined #openstack-infra | 18:27 | |
*** amitgandhinz has joined #openstack-infra | 18:28 | |
*** kzaitsev_mb has joined #openstack-infra | 18:29 | |
*** fguillot_ is now known as fguillot_afk | 18:31 | |
*** rbuzatu has quit IRC | 18:32 | |
*** amitgandhinz has quit IRC | 18:32 | |
*** itisha has joined #openstack-infra | 18:34 | |
*** tphummel has joined #openstack-infra | 18:34 | |
*** markvoelker has joined #openstack-infra | 18:34 | |
*** pt_15 has joined #openstack-infra | 18:34 | |
openstackgerrit | Ryan Hallisey proposed openstack-infra/project-config: Make the kolla-kubernetes jobs non-voting and experimental https://review.openstack.org/355199 | 18:36 |
*** sdake has quit IRC | 18:38 | |
*** markvoelker has quit IRC | 18:38 | |
*** hockeynut has quit IRC | 18:40 | |
*** sdake has joined #openstack-infra | 18:54 | |
*** e0ne has quit IRC | 18:55 | |
*** e0ne has joined #openstack-infra | 18:55 | |
*** fguillot_ has joined #openstack-infra | 18:56 | |
*** fguillot_ is now known as fguillot_afk | 18:58 | |
*** fguillot_afk has quit IRC | 18:58 | |
openstackgerrit | Ryan Hallisey proposed openstack-infra/project-config: Make the kolla-kubernetes jobs non-voting and experimental https://review.openstack.org/355199 | 19:03 |
*** timello has quit IRC | 19:04 | |
*** timello has joined #openstack-infra | 19:06 | |
*** fifieldt has quit IRC | 19:07 | |
*** timello has quit IRC | 19:07 | |
*** fguillot_ has joined #openstack-infra | 19:09 | |
*** fguillot_ is now known as fguillot_afk | 19:10 | |
*** fguillot_afk has quit IRC | 19:11 | |
*** yaume has quit IRC | 19:11 | |
*** timello has joined #openstack-infra | 19:12 | |
*** sdake has quit IRC | 19:13 | |
*** tonytan4ever has joined #openstack-infra | 19:17 | |
*** fifieldt has joined #openstack-infra | 19:18 | |
*** tesseract- has joined #openstack-infra | 19:20 | |
*** fguillot_ has joined #openstack-infra | 19:20 | |
*** tesseract- has quit IRC | 19:21 | |
*** eric_lopez has joined #openstack-infra | 19:27 | |
*** psachin has quit IRC | 19:27 | |
*** amitgandhinz has joined #openstack-infra | 19:29 | |
*** elo has quit IRC | 19:29 | |
*** amitgandhinz has quit IRC | 19:33 | |
*** markvoelker has joined #openstack-infra | 19:35 | |
*** markvoelker has quit IRC | 19:39 | |
openstackgerrit | Alex Schultz proposed openstack-infra/project-config: Update puppet integration jobs to use bindep https://review.openstack.org/355203 | 19:50 |
openstackgerrit | Ryan Hallisey proposed openstack-infra/project-config: Make the kolla-kubernetes jobs non-voting and experimental https://review.openstack.org/355199 | 19:54 |
*** rfolco has joined #openstack-infra | 19:57 | |
*** eric_lopez has quit IRC | 19:59 | |
*** elo has joined #openstack-infra | 19:59 | |
*** e0ne has quit IRC | 20:01 | |
*** rfolco has quit IRC | 20:08 | |
*** pfallenop has quit IRC | 20:11 | |
*** shashank_hegde has joined #openstack-infra | 20:11 | |
*** pfallenop has joined #openstack-infra | 20:17 | |
*** thorst_ has joined #openstack-infra | 20:20 | |
*** tonytan4ever has quit IRC | 20:28 | |
*** amitgandhinz has joined #openstack-infra | 20:29 | |
*** kzaitsev_mb has quit IRC | 20:31 | |
*** pfallenop has quit IRC | 20:31 | |
*** pfallenop has joined #openstack-infra | 20:32 | |
*** Jeffrey4l_ has joined #openstack-infra | 20:34 | |
*** amitgandhinz has quit IRC | 20:34 | |
*** Jeffrey4l has quit IRC | 20:35 | |
*** markvoelker has joined #openstack-infra | 20:36 | |
*** raunak has joined #openstack-infra | 20:36 | |
*** markvoelker has quit IRC | 20:40 | |
*** thorst_ has quit IRC | 20:43 | |
*** pfallenop has quit IRC | 20:49 | |
*** gibi has quit IRC | 20:56 | |
*** rhallisey has quit IRC | 20:58 | |
*** rhallisey has joined #openstack-infra | 20:58 | |
*** rhallisey_ has joined #openstack-infra | 21:02 | |
*** rhallisey_ has quit IRC | 21:03 | |
*** pfallenop has joined #openstack-infra | 21:05 | |
openstackgerrit | Joost van der Griendt proposed openstack-infra/jenkins-job-builder: adding extra properties to sonar publisher https://review.openstack.org/355206 | 21:06 |
*** thorst_ has joined #openstack-infra | 21:16 | |
*** thorst_ has quit IRC | 21:16 | |
openstackgerrit | Joost van der Griendt proposed openstack-infra/jenkins-job-builder: add credentials-id to svn_tags plugin https://review.openstack.org/355207 | 21:24 |
*** tonytan4ever has joined #openstack-infra | 21:29 | |
*** amitgandhinz has joined #openstack-infra | 21:30 | |
*** mriedem has joined #openstack-infra | 21:32 | |
*** thorst_ has joined #openstack-infra | 21:34 | |
*** thorst_ has quit IRC | 21:34 | |
*** tonytan4ever has quit IRC | 21:34 | |
*** thorst_ has joined #openstack-infra | 21:34 | |
*** amitgandhinz has quit IRC | 21:34 | |
*** markvoelker has joined #openstack-infra | 21:36 | |
*** yamahata has joined #openstack-infra | 21:37 | |
*** thorst_ has quit IRC | 21:39 | |
*** markvoelker has quit IRC | 21:41 | |
openstackgerrit | Joost van der Griendt proposed openstack-infra/jenkins-job-builder: Adding support for Hidden parameter plugin https://review.openstack.org/355209 | 21:42 |
*** sdake has joined #openstack-infra | 21:45 | |
cloudnull | pabelanger: woot!! | 22:00 |
*** tqtran has joined #openstack-infra | 22:14 | |
openstackgerrit | Joost van der Griendt proposed openstack-infra/jenkins-job-builder: Add support for stash-pullrequest-builder plugin Although the application has now been renamed/merge to BitBucket, it is still sensible to keep the Stash name for now. As there are already plugins named BitBucket, which are purely targeting the cloud solu https://review.openstack.org/355211 | 22:15 |
*** tqtran has quit IRC | 22:19 | |
*** rbuzatu has joined #openstack-infra | 22:24 | |
*** rhallisey_ has joined #openstack-infra | 22:24 | |
*** rhallisey_ has quit IRC | 22:24 | |
*** sdake has quit IRC | 22:24 | |
*** rbuzatu has quit IRC | 22:24 | |
*** rbuzatu has joined #openstack-infra | 22:24 | |
*** amitgandhinz has joined #openstack-infra | 22:31 | |
*** amitgandhinz has quit IRC | 22:35 | |
*** markvoelker has joined #openstack-infra | 22:37 | |
*** markvoelker has quit IRC | 22:41 | |
*** pt_15 has quit IRC | 22:42 | |
*** apetrich has quit IRC | 22:42 | |
*** pt_15 has joined #openstack-infra | 22:44 | |
*** tonytan4ever has joined #openstack-infra | 22:46 | |
*** gouthamr has joined #openstack-infra | 22:46 | |
openstackgerrit | Merged openstack-infra/grafyaml: Remove discover from test-requirements https://review.openstack.org/345798 | 22:46 |
*** tonytan4ever has quit IRC | 22:50 | |
*** harlowja has quit IRC | 22:50 | |
*** rbuzatu has quit IRC | 22:55 | |
openstackgerrit | Monty Taylor proposed openstack-infra/jenkins-job-builder: Add support for stash-pullrequest-builder plugin https://review.openstack.org/355211 | 22:57 |
cloudnull | idk if more infra cores are about but I'd love to bump the quota on the osic usage https://review.openstack.org/#/c/354900 | 22:58 |
*** superdan is now known as dansmith | 22:58 | |
*** rbuzatu has joined #openstack-infra | 22:59 | |
cloudnull | the tenant quota is all ready to go, to up things to 256 but I'd like to guage the environment in steps if at all possible | 23:00 |
clarkb | cloudnull: does that depend on ipv6 working? I have been out ao not sure what the bigger picture is now | 23:01 |
cloudnull | it does | 23:01 |
cloudnull | in checking the cloud usage it seems like openstackci is running on the ipv6 instances | 23:02 |
cloudnull | https://snag.gy/Ccbtzj.jpg | 23:02 |
openstackgerrit | Merged openstack-infra/system-config: Stop expanding hostvars in ansible inventory https://review.openstack.org/355182 | 23:03 |
clarkb | oh we did set ipv6 preferred in there cool | 23:03 |
pleia2 | clarkb: welcome to this morning :) pabelanger et al got all the wheels churning with ipv6 | 23:03 |
clarkb | I assume this means we fixed dns resolvers \o/ | 23:03 |
clarkb | neat | 23:04 |
* clarkb approves | 23:04 | |
openstackgerrit | Merged openstack-infra/system-config: Tell shade that OSIC doesn't need floating ips https://review.openstack.org/355191 | 23:04 |
cloudnull | once that runs for a bit, maybe sometime mid next week, I'd like to push it up even further . | 23:05 |
clarkb | that is great to hear. thank you for getting this going | 23:05 |
cloudnull | thanks for working with me on it :) | 23:05 |
*** rbuzatu has quit IRC | 23:05 | |
cloudnull | sorry it took so long | 23:05 |
pabelanger | clarkb: actually, we haven't updated DNS yet | 23:05 |
clarkb | pleia2: mirning? you must be somewhere west of the west coast :) | 23:06 |
clarkb | pabelanger: oh? | 23:06 |
clarkb | pabelanger: does that mean osic cant resolve stuff or is it nating out to google from the private ip? | 23:06 |
clarkb | I am guessing it NATs and neutron magically makes this work for outbound stuff? | 23:06 |
pabelanger | clarkb: ya, we have ipv6-ipv4 right now | 23:06 |
pabelanger | that is what I assue | 23:06 |
cloudnull | yes. | 23:07 |
pabelanger | however, we should fix dns for sure | 23:07 |
cloudnull | we have v4 plugged into a neutron router. | 23:07 |
clarkb | ya but less urgent than I thought. cool | 23:07 |
cloudnull | so neutron magic should make v4 dns happy | 23:07 |
pleia2 | clarkb: I meant, it happened this morning | 23:08 |
clarkb | pleia2: ah I see | 23:08 |
cloudnull | if we start seeing gate jobs die in a fire due to that we can make some adjustments on our side to bypass the neutron router. | 23:08 |
clarkb | I have been pretty properly checked out. turns out traveling with two 14 month olds is exhausting | 23:08 |
pleia2 | I bet :\ | 23:09 |
*** yamamoto has joined #openstack-infra | 23:09 | |
clarkb | cloudnull: the only differnce with that compared to the old fip aituation is nat on a shared IP right? so more constrained NAT resources? | 23:09 |
mordred | clarkb: I don't follow your last sentence? | 23:15 |
cloudnull | its nat on a shared IP, but no need to grab a FIP or any of that tomfoolery. | 23:16 |
mordred | yay! | 23:16 |
mordred | grabbing FIPs is the worst tomfoolery | 23:16 |
cloudnull | router is has a gate way of our public V4 network, with the v4 subnet as an interface. | 23:16 |
clarkb | mordred: nat is contrained by port availability iirc | 23:16 |
mordred | cloudnull: although I did just land a config patch to prevent us from hitting your FIP endpoint a billion times just to determine that we don't need any :) | 23:17 |
clarkb | mordred: when you 1:1 nat thats not an issue | 23:17 |
clarkb | when you many to one nat it can be | 23:17 |
mordred | ah - gotcha. nod | 23:17 |
cloudnull | clarkb: ++ | 23:17 |
cloudnull | we're running on the router for now, but if it becomes an issue we'll take care of it on the F5 | 23:17 |
mordred | cloudnull: btw - the new FIP workaround patch is now live in shade ... so when we restart nodepool next we should see an improvement in bluebox | 23:17 |
cloudnull | ++ my API will be a lot happier, | 23:18 |
mordred | gah | 23:18 |
* cloudnull hopes | 23:18 | |
mordred | clarkb: ^^ that fip patch was for you | 23:18 |
mordred | cloudnull: yes - I've been looking at a bunch of API call sequences to osic to try to make sure we're not hitting a ton of needless stuff | 23:18 |
mordred | also - for reasons I don't understand yet - shade sees the private ip I get from osic as public | 23:19 |
mordred | once I figure out why, I'll let you know | 23:19 |
cloudnull | if its something i need to change let me know. | 23:19 |
mordred | (it's not a problem for us -just a weird that demands more investigation) | 23:19 |
cloudnull | ^ those are the types of problems I spin on for the longest :) | 23:20 |
mordred | yah. "this isn't breaking anything, but it's wrong, so god knows what it's going to break at 2am in 6 months" | 23:20 |
clarkb | its only not breaking us due to the iov6 preferred flag | 23:21 |
openstackgerrit | Merged openstack-infra/project-config: Increase the quota in the OSIC cloud1 https://review.openstack.org/354900 | 23:21 |
*** yamamoto has quit IRC | 23:21 | |
cloudnull | hahaha! the 2am breakage w/out context is my favorite :D | 23:21 |
cloudnull | woot! | 23:22 |
mordred | clarkb: no, there's another part that _should_ be breaking us even with that flag | 23:22 |
mordred | clarkb: but whatever if causing the "private-is-public" thing is accidentally causing us not to be broken | 23:22 |
mordred | we've landed a patch to fix the breakage that's hidden by the other bug | 23:23 |
mordred | but I think fixing the other bug too is a thing we should do | 23:23 |
mordred | clarkb: when do you back to portlands? | 23:24 |
clarkb | yesterday | 23:25 |
clarkb | but was completely dead after overnight flight with kids | 23:25 |
SpamapS | yeah, that's definitely a deadly activity | 23:25 |
clarkb | turns out they sleep but you dont | 23:25 |
mordred | oy | 23:25 |
SpamapS | more ambien next time | 23:25 |
*** raunak has quit IRC | 23:30 | |
*** amitgandhinz has joined #openstack-infra | 23:32 | |
*** amitgandhinz has quit IRC | 23:36 | |
*** thorst_ has joined #openstack-infra | 23:36 | |
*** markvoelker has joined #openstack-infra | 23:38 | |
cloudnull | clarkb: do we know when the limit will be raised for OSIC "test nodes"? is that something that just needs to be pushed out which will get picked up in the next iteration? | 23:39 |
*** markvoelker has quit IRC | 23:42 | |
*** chem|off has quit IRC | 23:46 | |
*** sdake has joined #openstack-infra | 23:51 | |
prometheanfire | cloudnull: hi :D | 23:52 |
prometheanfire | cloudnull: did you break osic? | 23:53 |
cloudnull | no. | 23:53 |
cloudnull | why? | 23:53 |
cloudnull | everything looks greem | 23:55 |
cloudnull | *green | 23:55 |
clarkb | cloudnull: goes out on the next puppet run | 23:55 |
prometheanfire | cloudnull: just making fun of you | 23:55 |
cloudnull | cool, no worries. | 23:55 |
cloudnull | prometheanfire: ah. | 23:55 |
* cloudnull was in a panic for a moment | 23:55 | |
cloudnull | :P | 23:55 |
*** karthik__ has joined #openstack-infra | 23:56 | |
pabelanger | keeps refreshing grafana | 23:57 |
pabelanger | http://grafana.openstack.org/dashboard/db/nodepool-osic | 23:57 |
cloudnull | f5 | 23:57 |
cloudnull | f5 | 23:57 |
cloudnull | f5 | 23:57 |
cloudnull | :) | 23:57 |
sbezverk | evening folks, any infra cores around? | 23:57 |
sbezverk | we have a trouble with kolla kuberntes gates, some help would be nice. | 23:58 |
sbezverk | https://review.openstack.org/355199 | 23:59 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!