| pabelanger | cloudnull: we'll have to stage the removal first, otherwise nodepool will leave things in database. So, we likely can put osic-cloud1 into max-servers: 0 | 00:00 |
|---|---|---|
| pabelanger | cloudnull: then, another patch to remove images | 00:00 |
| pabelanger | cloudnull: we can add osic-cloud1-disk independent of that | 00:00 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fix change history cycle detection https://review.openstack.org/485368 | 00:02 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add project info to JobDirPlaybook https://review.openstack.org/485273 | 00:02 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Make playbook run meta info less fragile https://review.openstack.org/485284 | 00:02 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add spacer after playbook stats rather than before playbook https://review.openstack.org/485285 | 00:03 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Switch from tox-linters to tox-pep8 https://review.openstack.org/485379 | 00:04 |
| mordred | lbragstad: well - that would certainly explain the errors! | 00:05 |
| *** dangers_away has quit IRC | 00:06 | |
| *** askb has joined #openstack-infra | 00:09 | |
| *** pahuang has quit IRC | 00:10 | |
| *** esberglu has joined #openstack-infra | 00:10 | |
| *** EricGonczer_ has joined #openstack-infra | 00:11 | |
| *** dangers_away has joined #openstack-infra | 00:12 | |
| *** gmann has quit IRC | 00:13 | |
| *** gmann has joined #openstack-infra | 00:13 | |
| *** rhallisey has quit IRC | 00:15 | |
| *** esberglu has quit IRC | 00:15 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Gather facts for tox/run playbook https://review.openstack.org/485380 | 00:16 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Create openstack-py35 job with upper-constraints https://review.openstack.org/483987 | 00:17 |
| *** thorst has joined #openstack-infra | 00:17 | |
| *** thorst has quit IRC | 00:19 | |
| cloudnull | sounds good. | 00:21 |
| cloudnull | I've moved the old flavors over to the other agg group so we're good for now | 00:21 |
| cloudnull | so no rush | 00:21 |
| cloudnull | my connection was just flapping... sorry | 00:21 |
| cloudnull | sounds good, I've moved the old flavors over to the other agg group so we're good for now , so no rush | 00:22 |
| cloudnull | ^ idk if you've seen that | 00:22 |
| *** masber has joined #openstack-infra | 00:23 | |
| cloudnull | pabelanger: do you want me to create a couple of dependent patches? | 00:23 |
| *** pahuang has joined #openstack-infra | 00:23 | |
| *** gildub has joined #openstack-infra | 00:26 | |
| *** aeng has joined #openstack-infra | 00:26 | |
| *** dingyichen has joined #openstack-infra | 00:26 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack-infra/project-config master: Set OSIC cloud1 Region1 to use 0 servers https://review.openstack.org/485383 | 00:28 |
| *** makowals has joined #openstack-infra | 00:29 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Gather facts for tox/run playbook https://review.openstack.org/485380 | 00:30 |
| pabelanger | cloudnull: sure, otherwise we can do it in the morning | 00:30 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack-infra/project-config master: Convert the OSIC to only use disk nodes https://review.openstack.org/485378 | 00:32 |
| *** zhurong has joined #openstack-infra | 00:32 | |
| cloudnull | ^ hum should the new disk cloud be added with the others set to max 0 and then a third pr to delete ? | 00:32 |
| cloudnull | or will the two do ? | 00:32 |
| *** armax has quit IRC | 00:35 | |
| *** vhosakot has quit IRC | 00:37 | |
| *** vhosakot has joined #openstack-infra | 00:41 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Gather facts smartly and cache them https://review.openstack.org/485384 | 00:42 |
| openstackgerrit | Merged openstack-infra/shade master: Updated from global requirements https://review.openstack.org/483327 | 00:43 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Gather facts smartly and cache them https://review.openstack.org/485384 | 00:44 |
| *** abelur_ has joined #openstack-infra | 00:46 | |
| *** abelur_ has quit IRC | 00:47 | |
| *** LindaWang has joined #openstack-infra | 00:47 | |
| *** sbezverk has joined #openstack-infra | 00:49 | |
| *** thorst has joined #openstack-infra | 00:50 | |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config master: Use castellan from source in gate-castellan-dsvm-functional https://review.openstack.org/485386 | 00:50 |
| *** thorst has quit IRC | 00:50 | |
| *** yamamoto has joined #openstack-infra | 00:56 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Switch from tox-linters to tox-pep8 https://review.openstack.org/485379 | 00:56 |
| *** cuongnv has joined #openstack-infra | 00:58 | |
| *** makowals has quit IRC | 01:00 | |
| *** rkukura_ has joined #openstack-infra | 01:01 | |
| *** rkukura has quit IRC | 01:01 | |
| *** rkukura_ is now known as rkukura | 01:01 | |
| *** pahuang has quit IRC | 01:03 | |
| *** yamamoto has quit IRC | 01:05 | |
| *** yamamoto has joined #openstack-infra | 01:06 | |
| *** makowals has joined #openstack-infra | 01:06 | |
| *** pramodrj07 has quit IRC | 01:08 | |
| *** MasterOfBugs has quit IRC | 01:08 | |
| *** jkilpatr has quit IRC | 01:11 | |
| *** xyang1 has quit IRC | 01:12 | |
| *** bobh has joined #openstack-infra | 01:17 | |
| *** yamamoto has quit IRC | 01:18 | |
| *** sflanigan has quit IRC | 01:18 | |
| clarkb | cloudnull: set max servers to 0 and remove the images from the images list (set the images to images: []) | 01:19 |
| *** yamamoto has joined #openstack-infra | 01:19 | |
| clarkb | that will allow nodepool to clean those regions out nicely | 01:19 |
| clarkb | s/regions/providers/ | 01:20 |
| *** pahuang has joined #openstack-infra | 01:20 | |
| *** liujiong has joined #openstack-infra | 01:23 | |
| *** yamamoto has quit IRC | 01:24 | |
| *** bobh has quit IRC | 01:25 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Send websocket traffic to ws:// protocol https://review.openstack.org/485345 | 01:27 |
| EmilienM | panda|off: thanks | 01:27 |
| *** harlowja has quit IRC | 01:32 | |
| *** yamamoto has joined #openstack-infra | 01:32 | |
| *** Apoorva_ has joined #openstack-infra | 01:32 | |
| *** Daisy_ has joined #openstack-infra | 01:34 | |
| *** sflanigan has joined #openstack-infra | 01:35 | |
| *** yamamoto has quit IRC | 01:35 | |
| *** Apoorva has quit IRC | 01:36 | |
| *** bobh has joined #openstack-infra | 01:37 | |
| *** Apoorva_ has quit IRC | 01:37 | |
| mnaser | um | 01:41 |
| mnaser | http://logs.openstack.org/70/485370/1/check/gate-functional-dsvm-magnum-k8s-ubuntu-xenial/d6f34ed/logs/devstacklog.txt.gz#_2017-07-19_23_46_38_202 | 01:41 |
| mnaser | this isn't okay .. is it? | 01:41 |
| *** yamamoto has joined #openstack-infra | 01:41 | |
| mnaser | i mean i can throw a recheck but it's something i've never seen before (and i cant imagine why it would happen... did i catch mirrors mid sync or something?) | 01:42 |
| clarkb | mnaser: are you keeping hashes in your requirements file? | 01:43 |
| clarkb | or I guess that is os-testr? /me looks | 01:44 |
| openstackgerrit | Merged openstack/diskimage-builder master: Fix latest-limit command line https://review.openstack.org/484610 | 01:44 |
| *** yamamoto has quit IRC | 01:44 | |
| mnaser | clarkb - http://git.openstack.org/cgit/openstack/magnum/tree/requirements.txt?h=stable/ocata -- i guess not? this is for https://review.openstack.org/#/c/485370/ | 01:45 |
| openstackgerrit | Merged openstack/diskimage-builder master: Force install during pip-and-virtualenv https://review.openstack.org/484623 | 01:45 |
| openstackgerrit | Merged openstack/diskimage-builder master: yum-minimal: pre-install coreutils https://review.openstack.org/484624 | 01:45 |
| *** AJaeger has quit IRC | 01:45 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add -m flag to setfiles for Fedora 26 https://review.openstack.org/485099 | 01:45 |
| clarkb | mnaser: I don't see hashes in os-testr requirements or in upper-constraints | 01:45 |
| *** Daisy_ has quit IRC | 01:45 | |
| *** yamamoto has joined #openstack-infra | 01:45 | |
| *** Daisy_ has joined #openstack-infra | 01:46 | |
| *** AJaeger has joined #openstack-infra | 01:46 | |
| clarkb | mnaser: if I download manually and double check the md5sum it is the one that pip expected and the md5sum it got is not the md5sum for an empty file | 01:47 |
| clarkb | mnaser: so possibly a bit flip in memory or something? | 01:47 |
| *** yamamoto has quit IRC | 01:47 | |
| mnaser | clarkb i wonder where pip gets its expected md5 from | 01:48 |
| clarkb | mnaser: I think it is in the index of the packages | 01:48 |
| mordred | yup | 01:48 |
| *** yamamoto has joined #openstack-infra | 01:49 | |
| clarkb | mnaser: ya check the links at http://mirror.ord.rax.openstack.org/pypi/simple/pytz/ | 01:49 |
| clarkb | they all have md5sum info in them | 01:49 |
| mnaser | well i guess something went wrong in that vm or network | 01:49 |
| clarkb | I'm willing to write this down as "the reason we check file hashes" unless it becomes a chronic issue | 01:50 |
| mnaser | i'l throw a recheck and see if it happens again | 01:50 |
| *** Daisy_ has quit IRC | 01:50 | |
| *** yamamoto has quit IRC | 01:50 | |
| *** yamamoto has joined #openstack-infra | 01:52 | |
| *** yamamoto has quit IRC | 01:54 | |
| *** camunoz has quit IRC | 01:58 | |
| *** sree has joined #openstack-infra | 01:59 | |
| *** bobh has quit IRC | 02:02 | |
| *** Daisy_ has joined #openstack-infra | 02:02 | |
| *** sflanigan has quit IRC | 02:02 | |
| mnaser | would someone have an example of not running a job for a specific branch in projects.yaml i can learn from ? | 02:03 |
| mnaser | it looks like magnum introduced a new feature which is being tested in gate, but this results in gate failures for the stable branches because the tox env doesnt exist | 02:04 |
| mnaser | so all stable jobs are failing with - ERROR: unknown environment 'functional-swarm-mode' | 02:04 |
| clarkb | mnaser: that exclusion happens in openstack-infra/project-config/zuul/layout.yaml, if you grep for say newton you should find examples | 02:04 |
| mnaser | clarkb cool i'll check it out right now | 02:05 |
| clarkb | mnaser: but basically have the job name in the jobs section and a branch regex for branch selection. You should use negative lookahead to exclude current unworking stable brnaches, then future stable branches will just work as they ar ecut | 02:05 |
| mnaser | ahhh there ya go | 02:05 |
| mnaser | yep i didnt want to make it "master only" but rather "skip anything before ocata" | 02:05 |
| *** jamesmcarthur has joined #openstack-infra | 02:08 | |
| *** vhosakot has quit IRC | 02:09 | |
| *** armax has joined #openstack-infra | 02:10 | |
| openstackgerrit | Mohammed Naser proposed openstack-infra/project-config master: Ignore swarm mode jobs for stable branches https://review.openstack.org/485400 | 02:11 |
| mnaser | strigazi your input is welcome ^ | 02:11 |
| mnaser | given you added the swarm-mode driver | 02:12 |
| *** jamesmcarthur has quit IRC | 02:12 | |
| *** yamamoto has joined #openstack-infra | 02:13 | |
| *** makowals has quit IRC | 02:13 | |
| *** yamamoto has quit IRC | 02:13 | |
| *** vaidy has joined #openstack-infra | 02:15 | |
| *** sflanigan has joined #openstack-infra | 02:15 | |
| *** sflanigan has joined #openstack-infra | 02:15 | |
| *** iyamahat has quit IRC | 02:17 | |
| *** isviridov_away has joined #openstack-infra | 02:17 | |
| *** yamahata has quit IRC | 02:17 | |
| *** ekcs has quit IRC | 02:20 | |
| *** baoli has quit IRC | 02:20 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/devstack-gate master: DNM/WIP: Trying to test boot-from-volume for Ironic https://review.openstack.org/485348 | 02:20 |
| *** yamamoto has joined #openstack-infra | 02:22 | |
| *** yamamoto has quit IRC | 02:29 | |
| *** sree has quit IRC | 02:31 | |
| *** sree has joined #openstack-infra | 02:32 | |
| *** yamamoto has joined #openstack-infra | 02:34 | |
| *** makowals has joined #openstack-infra | 02:36 | |
| *** yamamoto has quit IRC | 02:36 | |
| *** sree has quit IRC | 02:36 | |
| *** yamamoto has joined #openstack-infra | 02:40 | |
| *** tuanluong has joined #openstack-infra | 02:41 | |
| *** yamamoto has quit IRC | 02:41 | |
| *** jerryz has quit IRC | 02:47 | |
| *** thorst has joined #openstack-infra | 02:51 | |
| *** aviau_ has quit IRC | 02:52 | |
| *** aviau has joined #openstack-infra | 02:52 | |
| *** harlowja has joined #openstack-infra | 02:52 | |
| *** sree has joined #openstack-infra | 02:56 | |
| *** thorst has quit IRC | 02:56 | |
| *** Sukhdev_ has joined #openstack-infra | 03:00 | |
| *** Sukhdev has quit IRC | 03:01 | |
| *** pahuang has quit IRC | 03:07 | |
| *** yamahata has joined #openstack-infra | 03:08 | |
| *** markvoelker has quit IRC | 03:09 | |
| *** EricGonczer_ has quit IRC | 03:17 | |
| *** pahuang has joined #openstack-infra | 03:19 | |
| *** ramishra has quit IRC | 03:21 | |
| *** sm_ has quit IRC | 03:22 | |
| *** sm_ has joined #openstack-infra | 03:23 | |
| *** ramishra has joined #openstack-infra | 03:23 | |
| *** sree has quit IRC | 03:26 | |
| *** ramishra has quit IRC | 03:32 | |
| *** ramishra has joined #openstack-infra | 03:34 | |
| *** dougwig has quit IRC | 03:43 | |
| *** amrith has quit IRC | 03:45 | |
| *** amrith has joined #openstack-infra | 03:46 | |
| *** sree has joined #openstack-infra | 03:50 | |
| *** rossella__ has quit IRC | 03:51 | |
| *** thorst has joined #openstack-infra | 03:52 | |
| openstackgerrit | Merged openstack/diskimage-builder master: The correct option for label name in fat and vfat is '-n' https://review.openstack.org/481787 | 03:54 |
| *** rossella__ has joined #openstack-infra | 03:54 | |
| *** sree_ has joined #openstack-infra | 03:54 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Enable console during kernel boot on Power https://review.openstack.org/481712 | 03:55 |
| *** sree_ is now known as Guest84759 | 03:55 | |
| *** Daisy_ has quit IRC | 03:55 | |
| *** sree has quit IRC | 03:55 | |
| *** Daisy_ has joined #openstack-infra | 03:56 | |
| *** jamesmcarthur has joined #openstack-infra | 03:57 | |
| *** thorst has quit IRC | 03:58 | |
| *** Guest84759 has quit IRC | 03:59 | |
| *** Rockyg has joined #openstack-infra | 04:07 | |
| *** jamesmcarthur has quit IRC | 04:11 | |
| *** Daisy_ has quit IRC | 04:12 | |
| *** amrith is now known as Guest75834 | 04:12 | |
| *** Daisy_ has joined #openstack-infra | 04:12 | |
| *** amrith has joined #openstack-infra | 04:12 | |
| *** sm_ has quit IRC | 04:13 | |
| *** amrith has quit IRC | 04:13 | |
| *** sm_ has joined #openstack-infra | 04:13 | |
| *** amrith- has joined #openstack-infra | 04:13 | |
| *** amrith- is now known as amrith | 04:13 | |
| *** mriedem has quit IRC | 04:14 | |
| *** amrith has quit IRC | 04:15 | |
| *** Daisy_ has quit IRC | 04:17 | |
| *** harlowja has quit IRC | 04:18 | |
| *** wolverineav has joined #openstack-infra | 04:19 | |
| *** chlong_ has joined #openstack-infra | 04:20 | |
| *** gyee has quit IRC | 04:21 | |
| *** sm_ has quit IRC | 04:22 | |
| *** sm_ has joined #openstack-infra | 04:23 | |
| *** dave-mccowan has quit IRC | 04:23 | |
| *** wolverineav has quit IRC | 04:23 | |
| *** lbragstad has quit IRC | 04:25 | |
| *** sm_ has quit IRC | 04:27 | |
| *** sm_ has joined #openstack-infra | 04:28 | |
| *** harlowja has joined #openstack-infra | 04:30 | |
| *** ykarel has joined #openstack-infra | 04:30 | |
| *** liujiong has quit IRC | 04:33 | |
| *** adisky__ has joined #openstack-infra | 04:33 | |
| *** rcernin has joined #openstack-infra | 04:34 | |
| ianw | having very deep regrets that i started looking at selinux labeling and dib | 04:40 |
| *** Daisy_ has joined #openstack-infra | 04:40 | |
| *** sm_ has quit IRC | 04:41 | |
| *** sm_ has joined #openstack-infra | 04:43 | |
| *** sree has joined #openstack-infra | 04:44 | |
| bkero | ianw: have you awoken the dragons? | 04:45 |
| *** sree has quit IRC | 04:49 | |
| *** ekcs has joined #openstack-infra | 04:50 | |
| *** nicolasbock has joined #openstack-infra | 04:53 | |
| *** yamamoto has joined #openstack-infra | 04:59 | |
| *** sshnaidm|off has quit IRC | 05:06 | |
| *** markvoelker has joined #openstack-infra | 05:10 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Rework tox -e linters https://review.openstack.org/484836 | 05:14 |
| *** isaacb has joined #openstack-infra | 05:16 | |
| *** jbadiapa has quit IRC | 05:21 | |
| *** chlong_ has quit IRC | 05:26 | |
| *** sm_ has quit IRC | 05:28 | |
| *** sm_ has joined #openstack-infra | 05:29 | |
| *** yamamoto has quit IRC | 05:31 | |
| *** harlowja has quit IRC | 05:33 | |
| *** armax has quit IRC | 05:34 | |
| *** rcernin has quit IRC | 05:36 | |
| *** sm_ has quit IRC | 05:37 | |
| *** sm_ has joined #openstack-infra | 05:39 | |
| *** kjackal_ has quit IRC | 05:42 | |
| *** gouthamr has quit IRC | 05:43 | |
| *** markvoelker has quit IRC | 05:44 | |
| *** sm_ has quit IRC | 05:46 | |
| *** sm_ has joined #openstack-infra | 05:46 | |
| *** Daisy_ has quit IRC | 05:48 | |
| *** Daisy_ has joined #openstack-infra | 05:48 | |
| kornicameister | hi, does anyone know what's wrong with docs gate ? it seems to fail globally with the same error | 05:50 |
| *** rossella__ has quit IRC | 05:50 | |
| *** cshastri has joined #openstack-infra | 05:51 | |
| *** Daisy_ has quit IRC | 05:53 | |
| *** rossella__ has joined #openstack-infra | 05:53 | |
| *** thorst has joined #openstack-infra | 05:53 | |
| *** Sukhdev_ has quit IRC | 05:56 | |
| *** psachin has joined #openstack-infra | 05:57 | |
| *** thorst has quit IRC | 05:58 | |
| *** rcernin has joined #openstack-infra | 05:59 | |
| *** liujiong has joined #openstack-infra | 06:00 | |
| *** markvoelker has joined #openstack-infra | 06:01 | |
| ianw | kornicameister: what's the error? | 06:05 |
| *** yamamoto has joined #openstack-infra | 06:05 | |
| kornicameister | ianw: /home/jenkins/workspace/gate-monasca-log-api-docs-ubuntu-xenial/doc/source/configuration/monasca_log_api.rst:170:Inline literal start-string without end-string. | 06:05 |
| *** Daisy_ has joined #openstack-infra | 06:05 | |
| kornicameister | ianw: observed also in keystone docs gate | 06:05 |
| *** markvoelker has quit IRC | 06:06 | |
| kornicameister | ianw: error is in the line that is not part of the referenced file, but comes from what oslo.config sphinx has generated from config-generator | 06:06 |
| kornicameister | ianw: trying to figure out if that is not related to oslo.config upgrad from yesterday | 06:08 |
| kornicameister | yesterday everything seemed to work correctly | 06:08 |
| *** tuanluong has quit IRC | 06:09 | |
| *** florianf has joined #openstack-infra | 06:10 | |
| *** jamesmcarthur has joined #openstack-infra | 06:12 | |
| *** isaacb has quit IRC | 06:13 | |
| ianw | kornicameister: heh, "it was working yesterday" is the story of my life :) | 06:14 |
| ianw | AJaeger will probably see this soon and may have time to debug | 06:14 |
| kornicameister | ianw: as ordinary as it may sound :D | 06:15 |
| kornicameister | ianw: that's the story :D | 06:15 |
| *** andreas_s has joined #openstack-infra | 06:15 | |
| *** jamesmcarthur has quit IRC | 06:16 | |
| AJaeger | ianw, kornicameister - those are really tricky ;( | 06:17 |
| AJaeger | kornicameister: how can I reproduce? | 06:18 |
| kornicameister | AJaeger: my master...what is wront that it is wrong : | 06:18 |
| kornicameister | :D | 06:18 |
| *** kjackal_ has joined #openstack-infra | 06:18 | |
| kornicameister | AJaeger: for me it fails consistently while using monasca-log-api master or https://review.openstack.org/#/c/484561/ for example (I assume every possible change of log-api will behave in the same way) | 06:19 |
| kornicameister | AJaeger: I just rechecked that one => https://review.openstack.org/#/c/482099/ | 06:19 |
| kornicameister | where I've been actually doing something around the part that is failing | 06:19 |
| kornicameister | will redo test the now | 06:20 |
| kornicameister | with | 06:20 |
| kornicameister | ```tox -r -e venv -- python setup.py build_sphinx``` | 06:20 |
| *** sree has joined #openstack-infra | 06:20 | |
| AJaeger | ah, tricky ;( | 06:21 |
| kornicameister | AJaeger: ok, and locally it just failed | 06:21 |
| kornicameister | AJaeger: just couple of minutes for docs gate to complete on the same change | 06:22 |
| kornicameister | AJaeger: the only real difference between yesterday and today is bumped oslo.config from 4.9.0 to 4.10.0 as far as I checked | 06:22 |
| *** kjackal_ has quit IRC | 06:22 | |
| AJaeger | So, it works with oslo.config version 4.9.0? | 06:23 |
| kornicameister | trying to check that :/ | 06:23 |
| *** yamamoto has quit IRC | 06:23 | |
| kornicameister | don't quite remember how edit-contrainsts was working inside tools/tox_install,sh | 06:23 |
| kornicameister | it keeps on installing 4.10.0 | 06:23 |
| AJaeger | kornicameister: just pip install it in your venv ;) | 06:24 |
| AJaeger | and then run tox without the "-r" | 06:24 |
| AJaeger | so it won't regenerate it | 06:24 |
| kornicameister | lol...over-engineered that | 06:24 |
| *** sree has quit IRC | 06:24 | |
| *** isaacb has joined #openstack-infra | 06:24 | |
| kornicameister | just a sec | 06:25 |
| kornicameister | ok | 06:25 |
| kornicameister | so | 06:25 |
| kornicameister | ```.tox/venv/bin/pip install oslo.config==4.9.0 ; .tox/venv/bin/python setup.py build_sphinx``` | 06:26 |
| kornicameister | worked | 06:26 |
| kornicameister | AJaeger, ianw : not really sure if that counts as good or bad news :D | 06:27 |
| AJaeger | kornicameister: best way for dhellmann to wake up (he might be around after 11:00 UTC) and ask him | 06:27 |
| *** tuanluong has joined #openstack-infra | 06:27 | |
| AJaeger | and then figure out what to do - blacklist that version in requirements repo, fix it directly - or perhaps he knows how to output the raw content for easier debugging. | 06:28 |
| * AJaeger is lost here as well | 06:28 | |
| * kornicameister don't know how to help AJaeger | 06:29 | |
| kornicameister | let's wait for doug then | 06:29 |
| kornicameister | AJaeger: wonder if we should try and introduce temp solution with changing that constraint for log-api or not :/ | 06:30 |
| *** bhavik1 has joined #openstack-infra | 06:30 | |
| kornicameister | but we might loose that fact in future and drive away from requirements, so best will be to wait for dhellman | 06:30 |
| AJaeger | kornicameister: yeah - also, ask on #openstack-oslo. You identified that 4.10.0 really broke it, so check whether somebody else is around | 06:30 |
| kornicameister | anyway, AJaeger thx | 06:30 |
| *** sm_ has quit IRC | 06:30 | |
| AJaeger | kornicameister: you're welcome | 06:30 |
| *** sm_ has joined #openstack-infra | 06:31 | |
| AJaeger | https://review.openstack.org/484848 | 06:33 |
| *** shu-mutou has joined #openstack-infra | 06:34 | |
| AJaeger | kornicameister: that's the only oslo.config change touching sphinx ^. Does reverting that in ouyr .tox/venv fix it (on top of 4.10.0 - or adding to 4.9.0). That's one idea for helping with debugging... | 06:34 |
| kornicameister | AJaeger: hmm...that's definitely part of 4.10.0 | 06:35 |
| kornicameister | there are 4-5 changes between 4.9 and 4.10 | 06:36 |
| kornicameister | in overall I think it goes down to log-api code :/ | 06:36 |
| AJaeger | kornicameister: might be ;( If you figure out how to debug it, consider updting oslo.config on how to do it for the next one, please | 06:37 |
| AJaeger | (but for now: wait for Doug) | 06:37 |
| kornicameister | AJaeger: will do | 06:44 |
| *** kaisers has quit IRC | 06:46 | |
| *** dhajare has joined #openstack-infra | 06:47 | |
| *** winggundamth has joined #openstack-infra | 06:49 | |
| kornicameister | AJaeger: they are very chatty (guess that's correct word) in #openstack-oslo | 06:49 |
| kornicameister | AJaeger: couple of minutes and no response :D | 06:49 |
| kornicameister | AJaeger: usually I get some feedback much faster on other channels | 06:50 |
| *** kaisers has joined #openstack-infra | 06:52 | |
| *** priteau has joined #openstack-infra | 06:52 | |
| *** Daisy__ has joined #openstack-infra | 06:52 | |
| *** Daisy___ has joined #openstack-infra | 06:54 | |
| *** Daisy__ has quit IRC | 06:54 | |
| *** aeng has quit IRC | 06:54 | |
| *** Daisy_ has quit IRC | 06:55 | |
| *** sm_ has quit IRC | 06:56 | |
| *** sm_ has joined #openstack-infra | 06:57 | |
| *** jbadiapa has joined #openstack-infra | 06:59 | |
| *** Daisy_ has joined #openstack-infra | 07:00 | |
| *** Daisy_ has quit IRC | 07:00 | |
| AJaeger | kornicameister: time to go back to bed, I guess ;/ | 07:01 |
| *** Daisy_ has joined #openstack-infra | 07:01 | |
| *** markvoelker has joined #openstack-infra | 07:02 | |
| *** Daisy___ has quit IRC | 07:03 | |
| *** shardy has joined #openstack-infra | 07:04 | |
| rakhmerov | AJaeger: hi, can you please look at https://review.openstack.org/#/c/484691/ ? | 07:05 |
| rakhmerov | not sure if the approach in it is ok | 07:05 |
| *** Daisy__ has joined #openstack-infra | 07:05 | |
| *** pahuang has quit IRC | 07:06 | |
| *** sree has joined #openstack-infra | 07:06 | |
| *** Daisy_ has quit IRC | 07:08 | |
| liujiong | join #openstack-rpm-packaging | 07:09 |
| *** sree has quit IRC | 07:11 | |
| *** milan has quit IRC | 07:11 | |
| *** jascott1 has quit IRC | 07:12 | |
| *** jascott1 has joined #openstack-infra | 07:13 | |
| *** yamamoto has joined #openstack-infra | 07:16 | |
| kornicameister | AJaeger: sweet dreams | 07:16 |
| *** jascott1 has quit IRC | 07:17 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Adding more openSUSE 42.3 variants to existing 42.2 jobs https://review.openstack.org/484499 | 07:17 |
| *** gagehugo has quit IRC | 07:18 | |
| *** ccamacho has joined #openstack-infra | 07:19 | |
| *** tesseract has joined #openstack-infra | 07:19 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Add openSUSE 42.3 as non-voting check to devstack* https://review.openstack.org/485204 | 07:20 |
| *** Douhet has quit IRC | 07:23 | |
| *** Douhet has joined #openstack-infra | 07:23 | |
| *** Rockyg has quit IRC | 07:24 | |
| *** yamamoto has quit IRC | 07:25 | |
| *** Douhet has quit IRC | 07:28 | |
| *** Douhet has joined #openstack-infra | 07:29 | |
| *** sm_ has quit IRC | 07:33 | |
| *** sm_ has joined #openstack-infra | 07:33 | |
| *** eranrom has quit IRC | 07:35 | |
| *** markvoelker has quit IRC | 07:36 | |
| *** eranrom has joined #openstack-infra | 07:36 | |
| *** eranrom has quit IRC | 07:39 | |
| *** alexchadin has joined #openstack-infra | 07:40 | |
| *** hashar has joined #openstack-infra | 07:41 | |
| *** aarefiev_afk is now known as aarefiev | 07:43 | |
| *** milan has joined #openstack-infra | 07:46 | |
| *** egonzalez has joined #openstack-infra | 07:49 | |
| *** thorst has joined #openstack-infra | 07:54 | |
| *** yolanda has quit IRC | 07:58 | |
| *** thorst has quit IRC | 07:58 | |
| *** ralonsoh has joined #openstack-infra | 08:00 | |
| *** dizquierdo has joined #openstack-infra | 08:00 | |
| *** gildub has quit IRC | 08:00 | |
| *** ykarel is now known as ykarel|lunch | 08:04 | |
| *** clarkb has quit IRC | 08:04 | |
| *** gagehugo has joined #openstack-infra | 08:04 | |
| *** clarkb has joined #openstack-infra | 08:05 | |
| *** sree has joined #openstack-infra | 08:08 | |
| *** sm_ has quit IRC | 08:08 | |
| *** sm_ has joined #openstack-infra | 08:11 | |
| *** nicolasbock_ has joined #openstack-infra | 08:12 | |
| *** nicolasbock has quit IRC | 08:12 | |
| *** sree has quit IRC | 08:12 | |
| *** wolverineav has joined #openstack-infra | 08:19 | |
| AJaeger | rakhmerov: your change sets up a single node. And setting up multinode - as you imply in your commit message - is harder since you need network between them. The devstack-gate sets this up properly and thus recommendation is to use that. | 08:21 |
| rakhmerov | AJaeger: I left a comment | 08:21 |
| *** gcb has joined #openstack-infra | 08:21 | |
| *** neiljerram has joined #openstack-infra | 08:21 | |
| rakhmerov | so you mean with devstack-gate it's possible to set up a truly multi VM gate? | 08:21 |
| AJaeger | rakhmerov: I suggest you followup with clarkb | 08:22 |
| *** lucas-afk is now known as lucasgomes | 08:22 | |
| AJaeger | rakhmerov: yes, with devstack-gate it'S possible - adn clarkb is our expert here - but is US east coast based, so better ask later today again. | 08:22 |
| AJaeger | there's little I can help further for now... | 08:22 |
| rakhmerov | yeah, ok. But basically, I didn't want to use neither Devstack nor Tempest. Seems like for my purposes it won't be an overkill | 08:22 |
| rakhmerov | AJaeger: ok, no problem. I'll talk to him | 08:23 |
| AJaeger | rakhmerov: you can use devstack-gate just to setup the environment AFAIU | 08:23 |
| rakhmerov | and, if needed, can I disable devstack itself, right? | 08:24 |
| rakhmerov | because I don't need OpenStack in this case at all | 08:24 |
| rakhmerov | all I want is just run multiple Mistral processes and see if they work well on different scenarios | 08:24 |
| rakhmerov | not necessarily on multiple VMs | 08:25 |
| rakhmerov | multiple VMs could be the next step | 08:25 |
| *** Daisy_ has joined #openstack-infra | 08:30 | |
| *** priteau has quit IRC | 08:31 | |
| *** isaacb has quit IRC | 08:31 | |
| *** isaacb has joined #openstack-infra | 08:32 | |
| *** Daisy___ has joined #openstack-infra | 08:33 | |
| *** markvoelker has joined #openstack-infra | 08:33 | |
| *** gildub has joined #openstack-infra | 08:34 | |
| *** Daisy__ has quit IRC | 08:34 | |
| rakhmerov | s/it won't be an overkill/it will be an overkill | 08:35 |
| AJaeger | rakhmerov: I see - sorry, don't have time now to look further into this. In that case your approach might work. But discuss with clarkb and see what he advises... | 08:35 |
| *** Daisy_ has quit IRC | 08:36 | |
| rakhmerov | AJaeger: sure, thanks for your time | 08:36 |
| *** ykarel|lunch is now known as ykarel | 08:38 | |
| *** dingyichen has quit IRC | 08:38 | |
| *** Hal has joined #openstack-infra | 08:40 | |
| *** amit_777 has joined #openstack-infra | 08:43 | |
| amit_777 | Hi Team ,I truing to run the manila tcs through tempest and getting error that "no test case match found" so after troubleshoot the same found that sitepackage flag set to false in tox.ini file for [tempestenv] | 08:44 |
| amit_777 | so can someone please help to make it true since i am doing it through CICD tempest run | 08:45 |
| *** Daisy_ has joined #openstack-infra | 08:47 | |
| *** Daisy___ has quit IRC | 08:51 | |
| *** alexchadin has quit IRC | 08:52 | |
| *** yolanda has joined #openstack-infra | 08:53 | |
| *** electrofelix has joined #openstack-infra | 08:53 | |
| *** yolanda has quit IRC | 08:54 | |
| *** yolanda has joined #openstack-infra | 08:55 | |
| electrofelix | Anyone online to review changes for git-review? | 08:58 |
| electrofelix | https://review.openstack.org/389701, https://review.openstack.org/244083 & https://review.openstack.org/398353 are all waiting another +2 (or feedback for corrections) | 08:59 |
| *** dizquierdo has quit IRC | 09:00 | |
| electrofelix | Also https://review.openstack.org/424823 was recently abandoned, but it seems like it would be a great usability enhancement in allowing users to paste the entire url in addition to the number | 09:00 |
| *** neiljerram has quit IRC | 09:00 | |
| *** nicolasbock_ has quit IRC | 09:01 | |
| *** nicolasbock has joined #openstack-infra | 09:01 | |
| *** nicolasbock has quit IRC | 09:01 | |
| *** coolsvap has joined #openstack-infra | 09:05 | |
| *** markvoelker has quit IRC | 09:07 | |
| *** winggundamth has quit IRC | 09:15 | |
| *** sambetts|afk is now known as sambetts | 09:16 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Group Create https://review.openstack.org/485102 | 09:21 |
| *** sm_ has quit IRC | 09:21 | |
| *** sm_ has joined #openstack-infra | 09:21 | |
| *** wolverineav has quit IRC | 09:23 | |
| *** wolverineav has joined #openstack-infra | 09:24 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Group List https://review.openstack.org/485108 | 09:24 |
| *** wolverineav has quit IRC | 09:28 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Group Update https://review.openstack.org/485118 | 09:29 |
| *** dhajare has quit IRC | 09:29 | |
| *** sam_wan has quit IRC | 09:30 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Group Delete https://review.openstack.org/485122 | 09:30 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Role Create https://review.openstack.org/482245 | 09:32 |
| *** cshastri has quit IRC | 09:34 | |
| *** katkapilatova has joined #openstack-infra | 09:34 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Role List https://review.openstack.org/482246 | 09:35 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Role Delete https://review.openstack.org/485145 | 09:35 |
| *** sm_ has quit IRC | 09:39 | |
| *** sm_ has joined #openstack-infra | 09:41 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add openSUSE 42.3 as non-voting check to devstack* https://review.openstack.org/485204 | 09:41 |
| openstackgerrit | Merged openstack-infra/project-config master: Make Horizon & D_O_A Django 1.11 jobs voting https://review.openstack.org/485220 | 09:42 |
| openstackgerrit | Merged openstack-infra/project-config master: Ignore swarm mode jobs for stable branches https://review.openstack.org/485400 | 09:43 |
| openstackgerrit | Merged openstack-infra/project-config master: jenkins: scripts: jenkins-sudo-grep.sh: Fix case for empty OLDLOGFILE https://review.openstack.org/484661 | 09:44 |
| *** sergK_ has joined #openstack-infra | 09:44 | |
| *** dhajare has joined #openstack-infra | 09:44 | |
| openstackgerrit | Merged openstack-infra/project-config master: Enable py35 job for monasca-transform https://review.openstack.org/484522 | 09:46 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: Consolidate the use of self._get_and_munchify https://review.openstack.org/485523 | 09:46 |
| *** cshastri has joined #openstack-infra | 09:47 | |
| openstackgerrit | Merged openstack-infra/project-config master: Fix Rally DSVM Designate job https://review.openstack.org/484954 | 09:47 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: Consolidate the use of self._get_and_munchify https://review.openstack.org/485523 | 09:48 |
| openstackgerrit | Merged openstack-infra/project-config master: Upgrade bindep-fallback check on opensuse-423 to voting https://review.openstack.org/484486 | 09:48 |
| sergK_ | hi folks, any chance for review jeepyb patch https://review.openstack.org/#/c/482612/ | 09:48 |
| *** gildub has quit IRC | 09:49 | |
| openstackgerrit | Merged openstack-infra/project-config master: jenkins/jobs/networking-vpp.yaml: Updating disabled_service list https://review.openstack.org/484999 | 09:49 |
| *** yamahata has quit IRC | 09:51 | |
| *** thorst has joined #openstack-infra | 09:55 | |
| *** iyamahat has joined #openstack-infra | 09:56 | |
| *** iyamahat has quit IRC | 09:56 | |
| *** shardy is now known as shardy_mtg | 09:57 | |
| *** rossella__ has quit IRC | 10:00 | |
| *** dtantsur|afk is now known as dtantsur | 10:01 | |
| *** tuanluong has quit IRC | 10:03 | |
| *** markvoelker has joined #openstack-infra | 10:03 | |
| openstackgerrit | Merged openstack-infra/project-config master: Make Py35 gate votable for monasca-notification https://review.openstack.org/482892 | 10:04 |
| *** rossella__ has joined #openstack-infra | 10:04 | |
| openstackgerrit | Merged openstack-infra/project-config master: Updates the acl and adds new config files for api-site https://review.openstack.org/485179 | 10:06 |
| *** shu-mutou is now known as shu-mutou-AWAY | 10:06 | |
| *** sree has joined #openstack-infra | 10:06 | |
| *** dizquierdo has joined #openstack-infra | 10:07 | |
| *** cuongnv has quit IRC | 10:07 | |
| openstackgerrit | Merged openstack-infra/project-config master: tooz: do not run py35-etcd3* on Ocata https://review.openstack.org/484984 | 10:10 |
| *** sree has quit IRC | 10:11 | |
| *** thorst has quit IRC | 10:12 | |
| *** liujiong has quit IRC | 10:13 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add TripleO scenario007 https://review.openstack.org/484943 | 10:14 |
| openstackgerrit | Merged openstack-infra/project-config master: Increase OVN testing coverage https://review.openstack.org/475423 | 10:14 |
| *** sm_ has quit IRC | 10:14 | |
| *** rossella__ has quit IRC | 10:14 | |
| *** sm_ has joined #openstack-infra | 10:14 | |
| *** florianf has quit IRC | 10:14 | |
| *** rossella__ has joined #openstack-infra | 10:16 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: zuul: layout: Prevent ansible-hardening openSUSE job to run on pre-Pike https://review.openstack.org/485537 | 10:19 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: zuul: layout: ansible-hardening: Promote the openSUSE job to gate https://review.openstack.org/485538 | 10:19 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: zuul: layout: Add non-voting openSUSE OpenStack Ansible jobs https://review.openstack.org/485539 | 10:19 |
| *** Daisy_ has quit IRC | 10:25 | |
| *** bhavik1 has quit IRC | 10:27 | |
| *** ansiwen has quit IRC | 10:28 | |
| *** xinliang has quit IRC | 10:29 | |
| *** florianf has joined #openstack-infra | 10:29 | |
| *** ociuhandu_ has quit IRC | 10:31 | |
| *** sm_ has quit IRC | 10:31 | |
| AJaeger | hwoarang: please get ansible folks to review your changes ^ | 10:32 |
| *** sm_ has joined #openstack-infra | 10:32 | |
| hwoarang | AJaeger: yeah I have CC'd a few people. I will ask again on todays' meeting | 10:32 |
| *** rossella__ has quit IRC | 10:32 | |
| *** ansiwen has joined #openstack-infra | 10:32 | |
| *** cshastri has quit IRC | 10:33 | |
| *** dhajare has quit IRC | 10:34 | |
| *** ansiwen has quit IRC | 10:34 | |
| *** sdague has joined #openstack-infra | 10:34 | |
| *** rossella__ has joined #openstack-infra | 10:35 | |
| *** markvoelker has quit IRC | 10:37 | |
| *** ramishra has quit IRC | 10:38 | |
| *** ramishra has joined #openstack-infra | 10:40 | |
| odyssey4me | AJaeger hwoarang done | 10:40 |
| *** xinliang has joined #openstack-infra | 10:41 | |
| *** xinliang has quit IRC | 10:41 | |
| *** xinliang has joined #openstack-infra | 10:41 | |
| *** Hal has quit IRC | 10:44 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: zuul: layout: Add non-voting openSUSE OpenStack Ansible jobs https://review.openstack.org/485539 | 10:47 |
| *** ramishra has quit IRC | 10:47 | |
| *** ramishra has joined #openstack-infra | 10:49 | |
| *** rossella__ has quit IRC | 10:50 | |
| AJaeger | odyssey4me: thanks - will review at another time - but first wanted ansible team to review ;) | 10:50 |
| *** ociuhandu_ has joined #openstack-infra | 10:53 | |
| *** rossella__ has joined #openstack-infra | 10:53 | |
| *** jbadiapa is now known as jbadiapa|lunch | 11:01 | |
| *** dhajare has joined #openstack-infra | 11:01 | |
| *** jkilpatr has joined #openstack-infra | 11:02 | |
| kornicameister | dhellmann: hi, you're there ? | 11:05 |
| *** sm_ has quit IRC | 11:05 | |
| *** sm_ has joined #openstack-infra | 11:06 | |
| dims | sdague : AJaeger : let's get this in please, castellan changes are not really tested before their release otherwise https://review.openstack.org/#/c/485386/ | 11:07 |
| dims | kornicameister : a bit early for dhellmann :) | 11:07 |
| kornicameister | dims: yeah....figured :D | 11:08 |
| *** Hal has joined #openstack-infra | 11:08 | |
| kornicameister | dims: no idea if I will be around he gets here...got some gate problem AJaeger told I could resolve with him ;-) | 11:08 |
| AJaeger | dims: -1 - will you quickly fix? | 11:09 |
| openstackgerrit | Davanum Srinivas (dims) proposed openstack-infra/project-config master: Use castellan from source in gate-castellan-dsvm-functional https://review.openstack.org/485386 | 11:09 |
| dims | AJaeger : done | 11:09 |
| dims | kornicameister : just leave a detailed question and he always checks his backscroll | 11:11 |
| *** markvoelker has joined #openstack-infra | 11:11 | |
| *** jamesmcarthur has joined #openstack-infra | 11:12 | |
| openstackgerrit | Merged openstack/diskimage-builder master: doc: supported_distros: Add openSUSE Leap 42.2/3 and Tumbleweed https://review.openstack.org/421301 | 11:13 |
| umbarkar | Hello All | 11:14 |
| *** sm_ has quit IRC | 11:15 | |
| umbarkar | I am not able to add the nodepool nodes as jenkins slave in jenkins | 11:15 |
| *** sm_ has joined #openstack-infra | 11:15 | |
| umbarkar | I mean the slave with given label are not vivsible in Jenkins UI | 11:16 |
| *** jamesmcarthur has quit IRC | 11:16 | |
| umbarkar | Anybody has idea ...what I am missing here | 11:16 |
| *** shardy_mtg has quit IRC | 11:18 | |
| AJaeger | dims: +2 | 11:19 |
| *** ykarel_ has joined #openstack-infra | 11:19 | |
| *** shardy_mtg has joined #openstack-infra | 11:19 | |
| *** shardy_mtg is now known as shardy | 11:19 | |
| *** dave-mccowan has joined #openstack-infra | 11:21 | |
| *** ykarel has quit IRC | 11:21 | |
| kornicameister | dims: ok, thx | 11:22 |
| *** wolverineav has joined #openstack-infra | 11:23 | |
| kornicameister | dhellmann: recently you had a change https://review.openstack.org/#/c/484848/, after merging it got included in oslo.config 4.10.0 and that somehow start causing docs gate failures (like here -> https://review.openstack.org/#/c/482099/). I noticed that similar problems exists in keystone docs jobs and it can easily reproduced locally with ```tox -evenv python setup.py build_sphinx``` | 11:24 |
| kornicameister | dhellmann: together with AJaeger we tracked down that downgrading to oslo.config==4.9.0 removes the problem | 11:24 |
| *** shardy has quit IRC | 11:24 | |
| kornicameister | dhellmann: AJaeger suggested that you're the person I should contact about that error, I hope that's all :) | 11:25 |
| kornicameister | dhellmann: if you'd have any comments of any sort, just use comments here https://review.openstack.org/#/c/482099/ | 11:25 |
| *** shardy has joined #openstack-infra | 11:25 | |
| *** sergK_ has quit IRC | 11:28 | |
| *** sm_ has quit IRC | 11:32 | |
| *** sm_ has joined #openstack-infra | 11:33 | |
| *** sm_ has quit IRC | 11:38 | |
| *** sergK_ has joined #openstack-infra | 11:38 | |
| *** sm_ has joined #openstack-infra | 11:39 | |
| *** ldnunes has joined #openstack-infra | 11:39 | |
| *** ykarel__ has joined #openstack-infra | 11:42 | |
| *** ykarel_ has quit IRC | 11:44 | |
| rakhmerov | clarkb: hi, when you have a chance I'd like to ask you to look at https://review.openstack.org/#/c/484691/. I'd like to consult with you on that | 11:45 |
| rakhmerov | trying to figure out the best way | 11:46 |
| *** sm_ has quit IRC | 11:48 | |
| *** askb has quit IRC | 11:49 | |
| *** ralonsoh has quit IRC | 11:50 | |
| *** ralonsoh has joined #openstack-infra | 11:50 | |
| *** adisky__ has quit IRC | 11:50 | |
| *** dougwig has joined #openstack-infra | 11:53 | |
| *** thorst has joined #openstack-infra | 11:56 | |
| *** sm_ has joined #openstack-infra | 11:56 | |
| *** amit_777 has quit IRC | 11:57 | |
| *** thorst_ has joined #openstack-infra | 11:57 | |
| *** thorst has quit IRC | 12:01 | |
| *** mattmceuen has joined #openstack-infra | 12:02 | |
| *** trown|outtypewww is now known as trown | 12:07 | |
| *** thorst_ has quit IRC | 12:11 | |
| *** thorst has joined #openstack-infra | 12:11 | |
| *** thorst has quit IRC | 12:12 | |
| *** rossella__ has quit IRC | 12:12 | |
| *** baoli has joined #openstack-infra | 12:15 | |
| *** rossella__ has joined #openstack-infra | 12:15 | |
| *** chlong_ has joined #openstack-infra | 12:16 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/project-config master: Change job type for 3nodes job to move to oooq runner https://review.openstack.org/485590 | 12:17 |
| *** rhallisey has joined #openstack-infra | 12:17 | |
| *** _milan_ has joined #openstack-infra | 12:20 | |
| *** dprince has joined #openstack-infra | 12:21 | |
| *** milan has quit IRC | 12:22 | |
| *** thorst has joined #openstack-infra | 12:22 | |
| *** gordc has joined #openstack-infra | 12:24 | |
| *** thorst has quit IRC | 12:26 | |
| *** rossella__ has quit IRC | 12:26 | |
| *** thorst has joined #openstack-infra | 12:26 | |
| *** rossella__ has joined #openstack-infra | 12:29 | |
| *** panda|off is now known as panda | 12:31 | |
| panda | pabelanger: was something done in the meantime ? queue is back to normal | 12:32 |
| *** sm_ has quit IRC | 12:34 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device https://review.openstack.org/472065 | 12:35 |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 12:35 |
| *** sm_ has joined #openstack-infra | 12:35 | |
| *** alexchadin has joined #openstack-infra | 12:39 | |
| *** mattmceuen has quit IRC | 12:40 | |
| *** rlandy has joined #openstack-infra | 12:40 | |
| *** markvoelker has quit IRC | 12:40 | |
| hwoarang | hello | 12:42 |
| hwoarang | it seems opensuse images are getting some sporadic dns failures | 12:42 |
| hwoarang | http://logs.openstack.org/98/483998/6/check/gate-bifrost-integration-tinyipa-opensuse-422/ae26b1c/console.html#_2017-07-20_10_22_08_658390 | 12:42 |
| fungi | panda: nodepool got unusually confused when some backend storage changes in osic took it by surprise, but after a nodepool restart things mostly caught up | 12:42 |
| *** sshnaidm|off has joined #openstack-infra | 12:42 | |
| hwoarang | and http://logs.openstack.org/98/483998/6/check/gate-bifrost-integration-tinyipa-opensuse-422/ba5d857/console.html#_2017-07-20_09_36_12_302821 | 12:43 |
| hwoarang | does anyone know anything about this? | 12:43 |
| panda | fungi: so network errors and mirror connection was not the issue ? or we should still merge the retries patch ? | 12:43 |
| fungi | panda: nodepool having stopped adding new nodes for a couple hours contributed to the backlog, but the network errors are probably still worth digging into | 12:45 |
| *** camunoz has joined #openstack-infra | 12:45 | |
| panda | fungi: ok, thanks. | 12:45 |
| fungi | hwoarang: dns lookups do sometimes fail. is that job using the local dns cache on the loopback interface or do you think it might be overriding it with some different nameservers? | 12:46 |
| fungi | panda: was it citycloud.sto2 where we had been seeing the mirror connectivity issues for your jobs? | 12:46 |
| fungi | if so, maybe hwoarang's dns lookup failure is related as it also happened there | 12:47 |
| *** bobh has joined #openstack-infra | 12:47 | |
| *** kgiusti has joined #openstack-infra | 12:47 | |
| panda | fungi: I don't have this information | 12:47 |
| fungi | panda: okay, i'll look at your conversation with pabelanger from yesterday | 12:47 |
| hwoarang | fungi: i believe that the job does not mess with the dns at all so it uses whatever is in the image already | 12:48 |
| fungi | yep, pabelanger said it was sto2 as well | 12:48 |
| *** thorst has quit IRC | 12:49 | |
| fungi | so i'm starting to get the impression citycloud's network is overloaded or otherwise broken in their sto2 region | 12:49 |
| *** sm_ has quit IRC | 12:49 | |
| *** LindaWang has quit IRC | 12:50 | |
| *** rossella__ has quit IRC | 12:50 | |
| *** sm_ has joined #openstack-infra | 12:50 | |
| *** thorst has joined #openstack-infra | 12:50 | |
| *** nicolasbock has joined #openstack-infra | 12:50 | |
| *** nicolasbock has quit IRC | 12:51 | |
| *** nicolasbock has joined #openstack-infra | 12:51 | |
| *** markvoelker has joined #openstack-infra | 12:52 | |
| openstackgerrit | Jeremy Stanley proposed openstack-infra/project-config master: Temporarily stop using citycloud-sto2 https://review.openstack.org/485603 | 12:52 |
| *** rossella__ has joined #openstack-infra | 12:52 | |
| fungi | there's a change to take that region out of rotation | 12:52 |
| *** bobh has quit IRC | 12:52 | |
| *** jbadiapa|lunch is now known as jbadiapa | 12:54 | |
| hwoarang | ah i see. Thank you! | 12:56 |
| *** thorst has quit IRC | 12:56 | |
| openstackgerrit | Merged openstack-infra/project-config master: Use castellan from source in gate-castellan-dsvm-functional https://review.openstack.org/485386 | 12:57 |
| *** thorst has joined #openstack-infra | 12:58 | |
| *** sree has joined #openstack-infra | 13:01 | |
| *** thorst has quit IRC | 13:02 | |
| *** gcb has quit IRC | 13:02 | |
| *** gcb has joined #openstack-infra | 13:03 | |
| *** mriedem has joined #openstack-infra | 13:03 | |
| *** Julien-zte has quit IRC | 13:05 | |
| *** jcoufal has joined #openstack-infra | 13:05 | |
| *** EricGonczer_ has joined #openstack-infra | 13:05 | |
| *** sree has quit IRC | 13:06 | |
| *** Julien-zte has joined #openstack-infra | 13:06 | |
| *** thorst has joined #openstack-infra | 13:08 | |
| *** esberglu has joined #openstack-infra | 13:10 | |
| *** LindaWang has joined #openstack-infra | 13:10 | |
| *** ociuhandu_ has quit IRC | 13:11 | |
| *** xyang1 has joined #openstack-infra | 13:12 | |
| openstackgerrit | Paul Bourke (pbourke) proposed openstack-infra/system-config master: Enable irc status and logging for git-upstream https://review.openstack.org/485608 | 13:13 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 13:16 |
| *** gouthamr has joined #openstack-infra | 13:17 | |
| *** raissa_ is now known as raissa | 13:17 | |
| *** zhurong has quit IRC | 13:19 | |
| pabelanger | panda: fungi: http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22No%20more%20mirrors%20to%20try%5C%22%20AND%20voting:1 was the query I used, will consider adding it to elastic-recheck. But ya, looks better today but that could be less active jobs. but citycloud-sto2 is still high | 13:20 |
| pabelanger | panda: fungi: I'd still try retries:0 in yum.conf and see the results | 13:20 |
| panda | pabelanger: patch is in place, we'lll discuss it in 1 hour, hope to get it merged soon | 13:20 |
| *** eharney has joined #openstack-infra | 13:22 | |
| fungi | pabelanger: well, yum retries won't solve the dns lookup failures in citycloud-sto2 like hwoarang linked above | 13:22 |
| *** zzzeek has quit IRC | 13:23 | |
| *** alexchadin has quit IRC | 13:23 | |
| *** lbragstad has joined #openstack-infra | 13:24 | |
| *** zzzeek has joined #openstack-infra | 13:25 | |
| *** jamesdenton has joined #openstack-infra | 13:27 | |
| pabelanger | fungi: right, that's why I suggested mirrorlist to another provider. Or mirrorlist back to static ip? | 13:33 |
| *** baoli has quit IRC | 13:33 | |
| mnaser | anyone seen this sort of failure in tempest before? AttributeError: 'module' object has no attribute 'SSL_ST_INIT' | 13:33 |
| mnaser | http://logs.openstack.org/72/485372/2/check/gate-functional-dsvm-magnum-api-ubuntu-xenial/36da83e/console.html#_2017-07-20_13_23_46_454819 | 13:33 |
| pabelanger | AJaeger: mordred: good discussion on 483987, left comments | 13:33 |
| fungi | pabelanger: the error hwoarang linked was a job failing to look up dns for github.com, so no amount of hostfile entries for mirrors is going to solve that | 13:34 |
| mnaser | it keeps resurfacing on this patch i'm dealing with.. it's a stable/newton patch so i wonder if there's a problem there | 13:34 |
| pabelanger | fungi: ah, I didn't look at log, I thought it was dns issue to our mirror | 13:34 |
| fungi | pabelanger: we need working dns in clouds, and if their network is so broken we can't consistently do dns lookups i'm not sure there's much reason to try workarounds for other things | 13:35 |
| pabelanger | fungi: ya, in fact, I think something like dns failures for jobs might be come more of an issue with zuulv3, since we'll nolonger have nodepool abording DNS failures with ready_script | 13:35 |
| pabelanger | fungi: ++ | 13:35 |
| *** Goneri has joined #openstack-infra | 13:36 | |
| pabelanger | absorbing* | 13:36 |
| *** sm_ has quit IRC | 13:36 | |
| openstackgerrit | Rajat Sharma proposed openstack-infra/shade master: Replace six.itervalues with dict.values() https://review.openstack.org/485633 | 13:36 |
| *** sm_ has joined #openstack-infra | 13:37 | |
| *** yamamoto has joined #openstack-infra | 13:39 | |
| mnaser | looks like stable/newton is installing 16.1.0 and stable/ocata is installing 16.2.0 | 13:40 |
| *** chlong_ has quit IRC | 13:40 | |
| *** Swami has joined #openstack-infra | 13:40 | |
| *** rkukura has quit IRC | 13:41 | |
| *** electrofelix has quit IRC | 13:43 | |
| *** felipemonteiro has joined #openstack-infra | 13:43 | |
| *** electrofelix has joined #openstack-infra | 13:44 | |
| *** electrofelix has quit IRC | 13:44 | |
| *** felipemonteiro_ has joined #openstack-infra | 13:44 | |
| *** sshnaidm|off is now known as sshnaidm\ | 13:45 | |
| *** sshnaidm\ is now known as sshnaidm | 13:45 | |
| AJaeger | infra-root, with https://review.openstack.org/#/c/485179/ merged, we have a new acl, see https://review.openstack.org/#/admin/groups/1825,members . Could you add asettle as initial member, please? | 13:45 |
| asettle | Thanks AJaeger :) | 13:45 |
| jhesketh | AJaeger, asettle: Can do | 13:46 |
| asettle | Jesus christ jhesketh what are you doing awake? | 13:46 |
| jhesketh | asettle: this is my natural time | 13:47 |
| asettle | True, creature of the evening | 13:47 |
| asettle | Still very late! | 13:47 |
| jhesketh | AJaeger, asettle: done | 13:47 |
| *** mattmceuen has joined #openstack-infra | 13:48 | |
| fungi | he's in his element! don't discourage him ;) | 13:48 |
| jhesketh | asettle: sadly not compared to my recent habits | 13:48 |
| *** ykarel__ has quit IRC | 13:48 | |
| jhesketh | heh, it's true, this is the time of night I'm likely to get stuff done | 13:48 |
| *** felipemonteiro has quit IRC | 13:49 | |
| asettle | Sorry sorry :P don't let me discourage you jhesketh | 13:49 |
| *** yamamoto has quit IRC | 13:50 | |
| *** eranrom has joined #openstack-infra | 13:53 | |
| *** makowals has quit IRC | 13:54 | |
| *** makowals has joined #openstack-infra | 13:56 | |
| *** tono has joined #openstack-infra | 13:59 | |
| *** bobh has joined #openstack-infra | 14:00 | |
| *** ihrachys has joined #openstack-infra | 14:00 | |
| openstackgerrit | Giulio Fidente proposed openstack-infra/tripleo-ci master: Create a loop device in multinode subnodes https://review.openstack.org/484963 | 14:04 |
| *** prateek has quit IRC | 14:05 | |
| *** sm_ has quit IRC | 14:05 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: zuul: layout: Add non-voting openSUSE OpenStack Ansible jobs https://review.openstack.org/485539 | 14:06 |
| *** dhajare has quit IRC | 14:09 | |
| *** sm_ has joined #openstack-infra | 14:09 | |
| *** tono has quit IRC | 14:09 | |
| pabelanger | AJaeger: fungi: +3 on sto2 disable | 14:13 |
| pabelanger | cloudnull: left comment on your osic-cloud1 change | 14:13 |
| *** EricGonczer_ has quit IRC | 14:13 | |
| AJaeger | thanks, jhesketh | 14:14 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device https://review.openstack.org/472065 | 14:14 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: Add settings for OVB in RDO Cloud https://review.openstack.org/480950 | 14:15 |
| EmilienM | fungi: good morning! do you know if there is some content (I searched on https://docs.openstack.org/infra/system-config) about any policy regarding what software we're allowed to install in CI jobs? ( cc weshay ) | 14:15 |
| openstackgerrit | Merged openstack-infra/project-config master: Temporarily stop using citycloud-sto2 https://review.openstack.org/485603 | 14:17 |
| *** LindaWang has quit IRC | 14:18 | |
| *** jaypipes has joined #openstack-infra | 14:19 | |
| *** LindaWang has joined #openstack-infra | 14:19 | |
| AJaeger | EmilienM: what is the background? Which software you need? | 14:19 |
| *** vhosakot has joined #openstack-infra | 14:19 | |
| *** Daisy_ has joined #openstack-infra | 14:20 | |
| EmilienM | AJaeger: use case: tripleo wants to be tested with sdn tools | 14:20 |
| EmilienM | AJaeger: and I'm wondering about some sdns which have different licenses | 14:20 |
| EmilienM | AJaeger: not only sdn but it's an example | 14:20 |
| AJaeger | EmilienM: would that license *anybody* to run the tests? | 14:21 |
| AJaeger | That would be my main consideration - can I run the same test on my local system according to their license? | 14:21 |
| *** rbrndt has joined #openstack-infra | 14:22 | |
| AJaeger | If not, I don't think it should be in OpenStack CI | 14:22 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 14:22 |
| *** Daisy_ has quit IRC | 14:24 | |
| *** sm_ has quit IRC | 14:25 | |
| *** rwsu has joined #openstack-infra | 14:25 | |
| *** sm_ has joined #openstack-infra | 14:26 | |
| dhellmann | kornicameister : looking | 14:28 |
| *** katkapilatova has left #openstack-infra | 14:28 | |
| *** _milan_ has quit IRC | 14:28 | |
| *** _milan_ has joined #openstack-infra | 14:29 | |
| fungi | EmilienM: AJaeger: yeah, we don't have a written policy i'm aware of, though what's the incentive to the openstack community or the tripleo team in particular to test proprietary software? isn't that something the software vendor would do on their own? | 14:29 |
| *** isaacb has quit IRC | 14:30 | |
| *** EricGonc_ has joined #openstack-infra | 14:31 | |
| AJaeger | fungi, EmilienM https://governance.openstack.org/tc/reference/new-projects-requirements.html has "The project must have no library dependencies which effectively restrict how the project may be distributed or deployed" and "The proposed project uses an open source license (preferably the Apache v2.0 license, since it is necessary if the project wants to be used in an OpenStack trademark program)" | 14:31 |
| fungi | and i agree with AJaeger that at least it should be possible (even if hard) to be able to run the same tests myself if i propose a patch to a project and get back a failure on that job | 14:31 |
| EmilienM | fungi: right, we don't want to test proprioeratry software at all | 14:31 |
| EmilienM | AJaeger: perfect, it fits with what we plan to do | 14:32 |
| *** annegentle has joined #openstack-infra | 14:32 | |
| fungi | yeah, if the question is just about "other" free software licenses, there's already plenty of that going on | 14:32 |
| umbarkar | Hello everyone | 14:33 |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device https://review.openstack.org/472065 | 14:33 |
| *** armax has joined #openstack-infra | 14:33 | |
| umbarkar | I have setup thethirdparty CI.... while trggering the ci for one of the gerrit patch getting error in ZUUL | 14:34 |
| umbarkar | eror log - https://gist.github.com/anonymous/f0166cf27959fc1f33e40d2ccc591717 | 14:35 |
| fungi | EmilienM: see also the "Projects run as part of the OpenStack Infrastructure" section at https://governance.openstack.org/tc/reference/licensing.html | 14:35 |
| fungi | EmilienM: that's probably the closest we have to a policy as to what official projects can rely on anyway | 14:35 |
| EmilienM | fungi: great, thanks again | 14:35 |
| *** _milan_ has quit IRC | 14:36 | |
| fungi | umbarkar: what version of zuul are you running? and how did you install it? | 14:36 |
| fungi | tracebacks are generally most helpful when we know what version of the source code we should be comparing them to | 14:37 |
| *** yamamoto has joined #openstack-infra | 14:37 | |
| umbarkar | fungi : zuul 2.5.1.. I installed it via the puppet command | 14:37 |
| *** wolverineav has quit IRC | 14:38 | |
| *** sm_ has quit IRC | 14:38 | |
| fungi | umbarkar: okay, thanks. i'll look in the source and see if i can tell under what conditions repo might not yet be assigned | 14:38 |
| *** wolverineav has joined #openstack-infra | 14:38 | |
| openstackgerrit | yolanda.robla proposed openstack/diskimage-builder master: [WIP] LVM support for dib-block-device https://review.openstack.org/472065 | 14:38 |
| *** ggillies has quit IRC | 14:40 | |
| umbarkar | fungi : ok | 14:40 |
| *** sm_ has joined #openstack-infra | 14:41 | |
| fungi | umbarkar: worth noting, zuul 2.5.2 has a lot of bug fixes over 2.5.1 | 14:41 |
| *** marst has joined #openstack-infra | 14:41 | |
| *** ggillies has joined #openstack-infra | 14:42 | |
| fungi | including some for zuul-merger | 14:42 |
| *** wolverineav has quit IRC | 14:42 | |
| openstackgerrit | John Trowbridge proposed openstack-infra/tripleo-ci master: WIP Testing changes required to move 3nodes job to quickstart https://review.openstack.org/483077 | 14:43 |
| umbarkar | fungi : I am upgrading the zuul version tp 2.5.2 | 14:44 |
| fungi | umbarkar: it would also help to have some of the log entries leading up to the exception. for example are you seeing "host key verification failed" there? | 14:45 |
| fungi | it looks like zuul-merger may short-circuit before defining the repo object if it fails to connect | 14:46 |
| umbarkar | fungi : yes "Host key verification failed." is there in logs | 14:46 |
| fungi | umbarkar: okay, in that case the easy solution is to populate your ~zuul/.ssh/known_hosts file with the host key reported by gerrit. you can find it at https://review.openstack.org/#/settings/ssh-keys (it's the first of the two "server host key" entries there, the one with "ssh-rsa" in it) | 14:54 |
| *** rkukura has joined #openstack-infra | 14:54 | |
| *** sm_ has quit IRC | 14:55 | |
| *** jbadiapa has quit IRC | 14:55 | |
| *** yamamoto has quit IRC | 14:55 | |
| *** sm_ has joined #openstack-infra | 14:55 | |
| fungi | umbarkar: though you should make sure that your ~zuul/.ssh/ directory also has an id_rsa file, and make sure that the corresponding id_rsa.pub file was added as a key for your account at that same url | 14:56 |
| *** yamamoto has joined #openstack-infra | 14:57 | |
| umbarkar | fungi : okay. For me the ~zuul/.ssh/ has the id_rsa file | 14:57 |
| umbarkar | I am verifying the other things | 14:57 |
| *** chlong_ has joined #openstack-infra | 14:57 | |
| *** LindaWang1 has joined #openstack-infra | 14:58 | |
| *** LindaWang has quit IRC | 15:00 | |
| *** LindaWang1 is now known as LindaWang | 15:00 | |
| *** xarses_ has quit IRC | 15:01 | |
| fungi | oh, and make sure that ~zuul/.ssh and the files in it are readable by the zuul user (and _only_ the zuul user, particularly not world-readable) | 15:02 |
| *** yamamoto has quit IRC | 15:03 | |
| *** Julien-zte has quit IRC | 15:05 | |
| *** LindaWang has quit IRC | 15:06 | |
| *** Julien-zte has joined #openstack-infra | 15:06 | |
| *** Julien-zte has quit IRC | 15:07 | |
| *** LindaWang has joined #openstack-infra | 15:07 | |
| *** Julien-zte has joined #openstack-infra | 15:08 | |
| *** Julien-zte has quit IRC | 15:08 | |
| *** Julien-zte has joined #openstack-infra | 15:09 | |
| umbarkar | fungi : yeh the files are readable by the zuul user only | 15:10 |
| *** felipemonteiro_ has quit IRC | 15:11 | |
| *** thorst has quit IRC | 15:11 | |
| *** xarses has joined #openstack-infra | 15:12 | |
| *** jamesmcarthur has joined #openstack-infra | 15:12 | |
| *** isaacb has joined #openstack-infra | 15:13 | |
| *** sm_ has quit IRC | 15:14 | |
| *** dmsimard is now known as dmsimard|cave | 15:14 | |
| *** sm_ has joined #openstack-infra | 15:14 | |
| *** Daisy_ has joined #openstack-infra | 15:15 | |
| *** jamesmcarthur has quit IRC | 15:17 | |
| *** xarses has quit IRC | 15:17 | |
| fungi | umbarkar: also, when you say that you "installed it via the puppet command" were you following the instructions at https://docs.openstack.org/infra/openstackci/ ? i just want to make sure that if we have any gaps in our documentation we get it updated so nobody else runs into the same issue | 15:19 |
| *** Julien-zte has quit IRC | 15:19 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 15:19 |
| *** Daisy_ has quit IRC | 15:20 | |
| *** Julien-zte has joined #openstack-infra | 15:20 | |
| *** Julien-zte has quit IRC | 15:21 | |
| umbarkar | fungi : yes I was following https://docs.openstack.org/infra/openstackci | 15:21 |
| *** Julien-zte has joined #openstack-infra | 15:21 | |
| *** Julien-zte has quit IRC | 15:21 | |
| *** Julien-zte has joined #openstack-infra | 15:22 | |
| *** rodrigopaiva has joined #openstack-infra | 15:22 | |
| *** Julien-zte has quit IRC | 15:22 | |
| *** Julien-zte has joined #openstack-infra | 15:23 | |
| *** Julien-zte has quit IRC | 15:23 | |
| *** annegentle has quit IRC | 15:25 | |
| *** rcernin has quit IRC | 15:25 | |
| *** ccamacho has quit IRC | 15:26 | |
| *** armax has quit IRC | 15:27 | |
| dhellmann | kornicameister : https://review.openstack.org/485717 | 15:27 |
| *** annegentle has joined #openstack-infra | 15:27 | |
| *** armax has joined #openstack-infra | 15:29 | |
| *** sm_ has quit IRC | 15:30 | |
| *** sm_ has joined #openstack-infra | 15:31 | |
| *** thorst has joined #openstack-infra | 15:33 | |
| *** Apoorva has joined #openstack-infra | 15:35 | |
| *** Apoorva_ has joined #openstack-infra | 15:35 | |
| chandankumar | Hello | 15:37 |
| chandankumar | for this review https://review.openstack.org/#/c/485574/ puppet ci job for centos is passing but for ubuntu is failing | 15:38 |
| chandankumar | sorry | 15:38 |
| chandankumar | wrong review | 15:38 |
| chandankumar | for this review https://review.openstack.org/#/c/485477/ puppet ci job for centos is passing but for ubuntu is failing | 15:38 |
| *** Rockyg has joined #openstack-infra | 15:38 | |
| *** Apoorva has quit IRC | 15:39 | |
| chandankumar | As per the jon console logs it looks ok http://logs.openstack.org/77/485477/4/check/gate-puppet-openstack-integration-4-scenario001-tempest-ubuntu-xenial/35741bf/console.html | 15:39 |
| *** Apoorva_ has quit IRC | 15:39 | |
| chandankumar | but zuul is reporting it as a failure | 15:39 |
| chandankumar | please have a look, thanks :-) | 15:39 |
| *** Apoorva has joined #openstack-infra | 15:39 | |
| *** andreas_s has quit IRC | 15:39 | |
| *** sm_ has quit IRC | 15:40 | |
| *** ykarel__ has joined #openstack-infra | 15:40 | |
| *** sm_ has joined #openstack-infra | 15:40 | |
| *** flepied has quit IRC | 15:40 | |
| *** psachin has quit IRC | 15:41 | |
| *** felipemonteiro has joined #openstack-infra | 15:43 | |
| *** Apoorva has quit IRC | 15:44 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:44 | |
| *** apetrich has quit IRC | 15:45 | |
| *** dhajare has joined #openstack-infra | 15:46 | |
| *** apetrich has joined #openstack-infra | 15:46 | |
| *** Apoorva has joined #openstack-infra | 15:47 | |
| *** felipemonteiro has quit IRC | 15:48 | |
| *** sm_ has quit IRC | 15:48 | |
| *** _milan_ has joined #openstack-infra | 15:49 | |
| fungi | chandankumar: did you read the log? like there at the end where it says "standard output/error still open after child exited ... Task exit code: 1" | 15:51 |
| *** sm_ has joined #openstack-infra | 15:51 | |
| chandankumar | mwhahaha: ^^ | 15:51 |
| *** lucasgomes is now known as lucas-afk | 15:51 | |
| fungi | the "task" it's referring to (according to zuul's ansible log archived along with that) is the one which ends by calling your run_tests.sh | 15:51 |
| mwhahaha | right but why is that a failure and is there anyway to figure out what is still open? | 15:52 |
| fungi | so given it's happening consistently with all your puppet 4 scenarios, i'm guessing puppet 4 is not properly terminating something puppet 3 does | 15:52 |
| *** baoli has joined #openstack-infra | 15:53 | |
| mwhahaha | it works fine on centos so it's not puppet | 15:53 |
| mwhahaha | chandankumar: thats why i said i wonder if it's an issue with the pip installed version of testr | 15:53 |
| fungi | oh, right that's centos vs ubuntu, not puppet 3 vs puppet 4 | 15:54 |
| fungi | now i see those are all puppet 4 | 15:54 |
| mwhahaha | i wish it told us what was still open :/ | 15:54 |
| fungi | so is this happening to all puppet-openstack-integration changes, or just this change to your run_tests.sh? | 15:54 |
| *** coolsvap has quit IRC | 15:54 | |
| mwhahaha | just that change | 15:55 |
| chandankumar | fungi: nope, it is happenign with my patch only. | 15:55 |
| fungi | mwhahaha: i wish ssh would tell me what's still open when i try to run commands remotely and the connection hangs on termination. usually it's some child process not properly disassociating itself from the parent's file descriptors | 15:55 |
| mwhahaha | chandankumar: you could try printing out an lsof :D | 15:56 |
| chandankumar | mwhahaha: sure. | 15:56 |
| fungi | i can think of a variety of reasons why you might see behavior like that on one distro and not another when running some complex task which forks or execs lots of children | 15:57 |
| *** neiljerram has joined #openstack-infra | 15:58 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 15:59 |
| inc0 | hey, good morning, qq, regular jobs have same envs as post jobs? | 16:01 |
| *** annegentle has quit IRC | 16:01 | |
| *** egonzalez has quit IRC | 16:01 | |
| AJaeger | inc0: not all zuul variables are the same - otherwise: Yes | 16:02 |
| AJaeger | Check the ansible logs to see what is set | 16:02 |
| *** Apoorva has quit IRC | 16:02 | |
| inc0 | where can I find post job logs? | 16:03 |
| *** Apoorva has joined #openstack-infra | 16:03 | |
| inc0 | specifically after this change https://review.openstack.org/#/c/485357/ | 16:03 |
| *** sm_ has quit IRC | 16:06 | |
| *** neiljerram has quit IRC | 16:07 | |
| *** isaacb has quit IRC | 16:11 | |
| *** dhajare has quit IRC | 16:11 | |
| fungi | inc0: look at the git history. post jobs run on merged commits rather than change numbers, so logs are organized by either the merge commit's sha1 or the sha1 of the change itself if it was able to fast-forward the branch | 16:11 |
| fungi | inc0: the log pattern is https://logs.openstack.org/ab/abcd where ab is whatever the first two hexadecimal digits of the sha1 are, and then abcd is whatever the complete sha1 is | 16:12 |
| inc0 | thanks that's very helpful | 16:14 |
| *** sergK_ has quit IRC | 16:15 | |
| *** shardy has quit IRC | 16:16 | |
| *** chlong_ has quit IRC | 16:19 | |
| fungi | inc0: also, the same works for tag-based pipelines (like release), you just need to use the sha1 of the tag object and not the sha1 of whatever commit was tagged. you can get it with `git show-ref <tagname>` | 16:20 |
| *** LindaWang has quit IRC | 16:20 | |
| clarkb | rakhmerov: I think it likely worthwhile to use devstack-gate to get the right git repos checked out and for networking overlay stuff (among other smaller items) | 16:21 |
| clarkb | rakhmerov: but without knowing more about what you want to test and how you want to test it hard to say more | 16:21 |
| fungi | clarkb: after clarification, it sounds like the plan was actually to fire up services in parallel on one node, not actually make a multi-node job | 16:22 |
| fungi | though getting the right refs checked out is still a useful feature of d-g for that | 16:23 |
| *** dizquierdo has quit IRC | 16:23 | |
| *** tesseract has quit IRC | 16:32 | |
| *** rcernin has joined #openstack-infra | 16:33 | |
| *** sm_ has joined #openstack-infra | 16:33 | |
| *** dtantsur is now known as dtantsur|afk | 16:43 | |
| *** Apoorva has quit IRC | 16:50 | |
| *** bhavik1 has joined #openstack-infra | 16:50 | |
| *** dprince has quit IRC | 16:51 | |
| *** thorst has quit IRC | 16:52 | |
| *** sm_ has quit IRC | 16:52 | |
| *** david-lyle has quit IRC | 16:52 | |
| *** david-lyle has joined #openstack-infra | 16:52 | |
| *** sm_ has joined #openstack-infra | 16:53 | |
| openstackgerrit | Sam Betts proposed openstack-infra/glean master: Break systemd unit dependency cycle https://review.openstack.org/485748 | 16:53 |
| *** prateek has joined #openstack-infra | 16:53 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 16:57 |
| *** baoli has quit IRC | 17:01 | |
| *** ekcs has quit IRC | 17:01 | |
| *** baoli has joined #openstack-infra | 17:01 | |
| *** baoli has quit IRC | 17:01 | |
| *** ralonsoh has quit IRC | 17:02 | |
| *** hashar has quit IRC | 17:03 | |
| *** sambetts is now known as sambetts|afk | 17:03 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Remove hardcoded LOGNAME for ansible-playbook https://review.openstack.org/485749 | 17:05 |
| *** alex_xu has quit IRC | 17:05 | |
| *** bobh has quit IRC | 17:06 | |
| *** dprince has joined #openstack-infra | 17:08 | |
| *** Swami has quit IRC | 17:09 | |
| *** sm_ has quit IRC | 17:09 | |
| *** thorst has joined #openstack-infra | 17:10 | |
| *** baoli has joined #openstack-infra | 17:11 | |
| *** vhosakot has quit IRC | 17:12 | |
| *** felipemonteiro_ has quit IRC | 17:12 | |
| *** EricGonc_ has quit IRC | 17:12 | |
| *** felipemonteiro has joined #openstack-infra | 17:12 | |
| *** vhosakot has joined #openstack-infra | 17:12 | |
| *** thorst_ has joined #openstack-infra | 17:12 | |
| *** alex_xu has joined #openstack-infra | 17:13 | |
| *** trown is now known as trown|lunch | 17:14 | |
| *** EricGonczer_ has joined #openstack-infra | 17:14 | |
| *** thorst has quit IRC | 17:15 | |
| *** thorst_ has quit IRC | 17:17 | |
| *** tesseract has joined #openstack-infra | 17:18 | |
| *** Apoorva has joined #openstack-infra | 17:19 | |
| *** Apoorva has quit IRC | 17:19 | |
| *** Apoorva has joined #openstack-infra | 17:20 | |
| *** bobh has joined #openstack-infra | 17:22 | |
| *** felipemonteiro_ has joined #openstack-infra | 17:22 | |
| *** prateek has quit IRC | 17:22 | |
| *** harlowja has joined #openstack-infra | 17:23 | |
| *** sm_ has joined #openstack-infra | 17:23 | |
| *** david-lyle has quit IRC | 17:26 | |
| *** felipemonteiro has quit IRC | 17:26 | |
| *** harlowja has quit IRC | 17:27 | |
| *** jerryz has joined #openstack-infra | 17:28 | |
| *** rbrndt has quit IRC | 17:32 | |
| *** xarses has joined #openstack-infra | 17:32 | |
| *** chlong_ has joined #openstack-infra | 17:33 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/project-config master: Remove #openstack-gslb from IRC bot https://review.openstack.org/485753 | 17:37 |
| *** mriedem is now known as mriedem_afk | 17:39 | |
| *** ykarel__ has quit IRC | 17:39 | |
| *** ykarel__ has joined #openstack-infra | 17:40 | |
| *** Swami has joined #openstack-infra | 17:41 | |
| *** breton has quit IRC | 17:42 | |
| *** breton has joined #openstack-infra | 17:43 | |
| openstackgerrit | Graham Hayes proposed openstack-infra/system-config master: Remove #openstack-gslb from IRC bot https://review.openstack.org/485754 | 17:43 |
| *** ykarel__ has quit IRC | 17:44 | |
| *** rodrigopaiva has quit IRC | 17:46 | |
| fungi | thanks mugsie! | 17:47 |
| mugsie | no problem - I should have done it a while ago :) | 17:47 |
| fungi | every bit of cleanup helps | 17:48 |
| fungi | especially when we're up against a hard limit | 17:48 |
| mugsie | yeah - I always forget the freenode limit | 17:48 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Gather facts smartly and cache them https://review.openstack.org/485384 | 17:49 |
| fungi | mugsie: looks like you have some cruft at the top of the file on 485754 | 17:49 |
| openstackgerrit | Graham Hayes proposed openstack-infra/system-config master: Remove #openstack-gslb from IRC bot https://review.openstack.org/485754 | 17:51 |
| mugsie | so I do - fixed ^ | 17:51 |
| openstackgerrit | Ashwin Agate proposed openstack-infra/project-config master: Fix devstack py35 functional test for monasca-transform https://review.openstack.org/485756 | 17:51 |
| *** yamahata has joined #openstack-infra | 17:53 | |
| *** krtaylor has quit IRC | 17:56 | |
| *** jascott1 has joined #openstack-infra | 17:58 | |
| *** ykarel has joined #openstack-infra | 17:59 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Check out implicit branch in timer jobs https://review.openstack.org/485329 | 18:00 |
| *** EricGonc_ has joined #openstack-infra | 18:01 | |
| fungi | pabelanger: clarkb: i'm finally getting to e-mailing daniel at citynet about the random/intermittent sto2 network connectivity failures... any indication of how recently this started to become an issue? | 18:01 |
| *** thorst has joined #openstack-infra | 18:02 | |
| *** jamesdenton has quit IRC | 18:02 | |
| *** david-lyle has joined #openstack-infra | 18:03 | |
| *** EricGonczer_ has quit IRC | 18:03 | |
| *** harlowja has joined #openstack-infra | 18:06 | |
| *** ykarel has quit IRC | 18:06 | |
| *** jamesdenton has joined #openstack-infra | 18:07 | |
| *** raissa has quit IRC | 18:09 | |
| *** yamahata has quit IRC | 18:11 | |
| *** trown|lunch is now known as trown | 18:12 | |
| *** makowals has quit IRC | 18:12 | |
| *** Rockyg has quit IRC | 18:12 | |
| *** eharney has quit IRC | 18:13 | |
| *** thorst has quit IRC | 18:16 | |
| AJaeger | fungi, I think we need to merge the system-config change by mugsie first - is there a time today when it's safe to merge that? | 18:17 |
| *** dougwig has quit IRC | 18:24 | |
| *** bobh has quit IRC | 18:25 | |
| *** rbrndt has joined #openstack-infra | 18:25 | |
| *** krtaylor has joined #openstack-infra | 18:28 | |
| *** Sukhdev has joined #openstack-infra | 18:28 | |
| *** annegentle has joined #openstack-infra | 18:29 | |
| *** vhosakot has quit IRC | 18:35 | |
| *** bhavik1 has quit IRC | 18:35 | |
| *** vhosakot has joined #openstack-infra | 18:36 | |
| jeblair | AJaeger, fungi: in 1 hour and 15 minutes we're clear. | 18:44 |
| AJaeger | then we just need another system-config core to +2A 485754... Thanks, jeblair | 18:47 |
| *** rtjure has quit IRC | 18:47 | |
| *** rtjure has joined #openstack-infra | 18:47 | |
| *** yamahata has joined #openstack-infra | 18:48 | |
| fungi | AJaeger: yeah, i figured we'd need the system-config change in first and then rechecking the project-config one should work | 18:50 |
| fungi | i just wanted to make sure it already had a +2 handy | 18:50 |
| *** baoli has quit IRC | 18:52 | |
| *** Daisy_ has joined #openstack-infra | 18:53 | |
| *** baoli has joined #openstack-infra | 18:53 | |
| *** boris-42____ has joined #openstack-infra | 18:54 | |
| *** ccamacho has joined #openstack-infra | 18:54 | |
| *** baoli has quit IRC | 18:54 | |
| *** Daisy_ has quit IRC | 18:57 | |
| *** eharney has joined #openstack-infra | 19:01 | |
| *** thorst has joined #openstack-infra | 19:01 | |
| *** mriedem_afk is now known as mriedem | 19:01 | |
| *** baoli has joined #openstack-infra | 19:04 | |
| *** baoli has quit IRC | 19:04 | |
| *** thorst_ has joined #openstack-infra | 19:11 | |
| *** thorst has quit IRC | 19:12 | |
| *** baoli has joined #openstack-infra | 19:14 | |
| *** isaacb has joined #openstack-infra | 19:20 | |
| pabelanger | fungi: clarkb: not sure, just that we seem to have a higher rate of failure launching nodes in nodepool with sto2 also | 19:21 |
| fungi | pabelanger: when did you notice/start looking into it? | 19:22 |
| fungi | i can be vague but would like to include some sort of timeframe for reference, even if fuzzy | 19:24 |
| *** kzaitsev1pi has joined #openstack-infra | 19:25 | |
| pabelanger | fungi: trying to get data from graphite, but I think we've always had launch fails in nodepool since it came online | 19:25 |
| fungi | well, yeah the instances which report two ip addresses have happened off and on there | 19:25 |
| jeblair | fungi, AJaeger: the only meeting scheduled for this hour seems not to have happened, so i will +3. | 19:26 |
| fungi | thanks jeblair! | 19:26 |
| pabelanger | fungi: right, and these are multi-node jobs also. And that seems to be the nodes we fail to launch in nodepool also | 19:26 |
| *** hughsaunders has quit IRC | 19:26 | |
| *** kzaitsev_pi has quit IRC | 19:26 | |
| pabelanger | fungi: maybe we should try removing multi-node jobs in sto2 and see the result. | 19:28 |
| *** dmsimard|cave is now known as dmsimard | 19:28 | |
| fungi | pabelanger: the failure hwoarang mentioned was for gate-bifrost-integration-tinyipa-opensuse-422 which isn't multi-node as far as i can tell | 19:29 |
| *** hughsaunders has joined #openstack-infra | 19:30 | |
| fungi | plus i'm not sure that being multi-node or not would have any impact on arbitrary dns lookup failures. i expect their networking (at least their edge) is probably overloaded or they have some misbehaving gear dropping packets/flows | 19:30 |
| pabelanger | fungi: going to check and see how dns is setup on sto2 | 19:31 |
| pabelanger | wonder if unbound is not working | 19:31 |
| fungi | worth also checking that unbound is set up correctly on opensuse-422 i suppose | 19:31 |
| openstackgerrit | Merged openstack-infra/system-config master: Remove #openstack-gslb from IRC bot https://review.openstack.org/485754 | 19:32 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 19:34 |
| pabelanger | unbound looks okay on centos nodes and ubuntu for city-cloud | 19:34 |
| pabelanger | nameserver is 127.0.0.1 | 19:34 |
| pabelanger | will check opensuse | 19:35 |
| pabelanger | so, opensuse on osic is not using unbound | 19:36 |
| pabelanger | it has dns servers from google | 19:36 |
| AJaeger | speaking about unbound: here's a debian change that needs review: https://review.openstack.org/#/c/476442/ | 19:37 |
| pabelanger | but xenial is setup properly on osic | 19:37 |
| pabelanger | trying to get an opensuse node in city-cloud | 19:37 |
| fungi | pabelanger: that could certainly amplify the impact of network connectivity issues if we're not locally caching dns lookups on opensuse | 19:37 |
| pabelanger | fungi: ya, looking to see why that is | 19:38 |
| AJaeger | hwoarang, dirk ^ | 19:38 |
| *** dprince has quit IRC | 19:39 | |
| AJaeger | looking at nodepool/elements/nodepool-base/finalise.d/89-unbound , I see some opensuse handling - is this not working? | 19:41 |
| fungi | probably need to find where in the dib logs that's getting called | 19:42 |
| pabelanger | so, glean is currently pulling dns from cloud-drive in osic. this is on both xenial and opensuse, however xenial seems to change it back to 127.0.0.1 at some point | 19:42 |
| pabelanger | really need to patch glean for the config file support and disable handing dns | 19:43 |
| fungi | or at least be able to substitute values | 19:44 |
| fungi | i think following a similar design pattern to common dhcp clients makes sense (they let you ignore some options and substitute your own values in place of those from the response for others) | 19:44 |
| AJaeger | looking at http://nb03.openstack.org/dib.opensuse-422.log it starts at "2017-07-18 18:18:09,892" to configure unbound | 19:44 |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 19:45 |
| inc0 | hey, have you seen these? http://logs.openstack.org/39/485739/1/check/gate-kolla-python35/a615f36/console.html | 19:45 |
| AJaeger | this is in ubuntu-xenial-citycloud-lon1-9976468 ^ | 19:45 |
| *** nicolasbock has quit IRC | 19:46 | |
| AJaeger | error is "Could not resolve host: zm06.openstack.org'" | 19:46 |
| fungi | neat, more dns failures in citycloud | 19:46 |
| * inc0 hates to be bearer of bad news :( | 19:46 | |
| fungi | though this time in a different region, and on a node type we just confirmed should be relying on a local cache | 19:46 |
| AJaeger | should we merge the debian unbound change https://review.openstack.org/#/c/476442/ now? | 19:47 |
| pabelanger | fungi: easy fix for osic, is ask cloudnull to not provide dns in cloud-drive | 19:48 |
| pabelanger | fungi: but ya, fixing it in glean is the right step | 19:48 |
| cloudnull | ++ do you need this ? | 19:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Check out implicit branch in timer jobs https://review.openstack.org/485329 | 19:49 |
| *** rwsu has quit IRC | 19:52 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove #openstack-gslb from IRC bot https://review.openstack.org/485753 | 19:54 |
| *** EricGonc_ has quit IRC | 19:55 | |
| *** openstack has joined #openstack-infra | 19:58 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 19:59 |
| fungi | AJaeger: i've approved it. worth noting, /etc/debian_version exists on ubuntu (and other debian derivatives as well) but i assume that's not a concern | 20:00 |
| *** dprince has joined #openstack-infra | 20:00 | |
| *** EricGonczer_ has joined #openstack-infra | 20:02 | |
| *** Apoorva_ has joined #openstack-infra | 20:03 | |
| openstackgerrit | Merged openstack-infra/project-config master: Let unbound find rc.local on Debian stretch in DIB https://review.openstack.org/476442 | 20:03 |
| AJaeger | thanks, fungi | 20:05 |
| *** jkilpatr has quit IRC | 20:05 | |
| dirk | AJaeger: fungi : so that patch fixes it? | 20:06 |
| *** Apoorva has quit IRC | 20:06 | |
| AJaeger | dirk: no, that's Debian only. | 20:06 |
| *** iyamahat has joined #openstack-infra | 20:07 | |
| dirk | So is the issue that unbound isn't running or that resolv.conf isn't pointing to localhost? | 20:09 |
| *** iyamahat_ has joined #openstack-infra | 20:09 | |
| * dirk bets it's wicked interfering | 20:11 | |
| *** iyamahat has quit IRC | 20:11 | |
| *** EricGonc_ has joined #openstack-infra | 20:12 | |
| *** EricGonczer_ has quit IRC | 20:12 | |
| *** isaacb has quit IRC | 20:12 | |
| *** makowals has joined #openstack-infra | 20:13 | |
| dirk | fungi: could you add my ssh key to one of the machines where that happens? | 20:13 |
| *** gouthamr has quit IRC | 20:14 | |
| *** armax has quit IRC | 20:15 | |
| pabelanger | Hmm | 20:15 |
| pabelanger | cat /etc/resolv.conf | 20:15 |
| pabelanger | # This file intentionally left blank | 20:15 |
| pabelanger | that is on opensuse | 20:15 |
| *** armax has joined #openstack-infra | 20:15 | |
| pabelanger | but /etc/resolve.conf.netconfig exists | 20:16 |
| pabelanger | with wrong dns servers | 20:16 |
| hwoarang | hmm maybe a bad /etc/sysconfig/network/config configuration :/ | 20:16 |
| pabelanger | think I see the issue | 20:17 |
| pabelanger | 1 sec | 20:17 |
| *** openstackgerrit has quit IRC | 20:17 | |
| *** isaacb has joined #openstack-infra | 20:19 | |
| *** bobh has joined #openstack-infra | 20:19 | |
| *** kgiusti has left #openstack-infra | 20:19 | |
| *** openstackgerrit has joined #openstack-infra | 20:20 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Avoid dynamic modification of resolv.conf on openSUSE https://review.openstack.org/485809 | 20:20 |
| pabelanger | so, dhclient.conf setting on not setup on opensuse | 20:20 |
| pabelanger | we seem to skip that | 20:20 |
| pabelanger | http://git.openstack.org/cgit/openstack-infra/project-config/tree/nodepool/elements/nodepool-base/finalise.d/89-unbound#n141 | 20:20 |
| pabelanger | we likely need to do that for opensuse also | 20:20 |
| dirk | pabelanger: ^^ | 20:21 |
| pabelanger | let me test | 20:21 |
| hwoarang | hmm | 20:21 |
| pabelanger | dirk: file doesn't exist | 20:22 |
| pabelanger | /etc/sysconfig/dhcp | 20:22 |
| *** isaacb_ has joined #openstack-infra | 20:22 | |
| *** csomerville has joined #openstack-infra | 20:22 | |
| *** hamzy has quit IRC | 20:22 | |
| pabelanger | /etc/sysconfig/network/dhcp does | 20:23 |
| *** wolverineav has joined #openstack-infra | 20:23 | |
| dirk | pabelanger: ah, yes that's the one I meant | 20:24 |
| *** rwsu has joined #openstack-infra | 20:25 | |
| *** isaacb has quit IRC | 20:25 | |
| *** cody-somerville has quit IRC | 20:26 | |
| *** gouthamr has joined #openstack-infra | 20:26 | |
| openstackgerrit | Devang Doshi proposed openstack-infra/project-config master: new-project: vmware-nsx-tempest-plugin https://review.openstack.org/484990 | 20:28 |
| hwoarang | dirk: where is this option explained? I can't find it neither in /etc/sysconfig/network/dhcp nor in the ifcfg-dhcp man page | 20:29 |
| pabelanger | dirk: hwoarang I am testing NETCONFIG_DNS_STATIC_SERVERS now | 20:29 |
| hwoarang | hmm this will merge the static settings along with the dynamic ones so the google dns will probably not vanish | 20:31 |
| dirk | pabelanger: I think that adds a dns, not replace it | 20:32 |
| pabelanger | yup, that is what I am seeing | 20:32 |
| pabelanger | next test NETCONFIG_DNS_POLICY='' and manually apply it | 20:32 |
| dirk | pabelanger: so is it coming via dhcp? | 20:33 |
| pabelanger | correct | 20:33 |
| dirk | Abd my patch doesn't help? | 20:33 |
| dirk | E.g. with a correct path? | 20:33 |
| pabelanger | dirk: with other images we change dhclient.conf above, but not on opensuse. I tested my own dhclient.conf and still was added | 20:33 |
| pabelanger | dirk: no change | 20:33 |
| pabelanger | NETCONFIG_DNS_POLICY='' seems to be the winner | 20:34 |
| dirk | pabelanger: yes, because it isn't the only one doing it. | 20:34 |
| pabelanger | that removes /etc/resolv.conf.netconf and changes to /etc/resolv.conf persist | 20:34 |
| dirk | Yep, wfm | 20:35 |
| dirk | pabelanger: are you editing my review and overwrite it with the correct fix? | 20:36 |
| pabelanger | dirk: I can | 20:38 |
| *** eharney has quit IRC | 20:38 | |
| pabelanger | dirk: Hmm, rc.local doesn't seem to be used by opensuse at boot | 20:41 |
| pabelanger | that is where we appear to setup nameserver 127.0.0.1 | 20:42 |
| *** Daisy_ has joined #openstack-infra | 20:42 | |
| dirk | pabelanger: yep, it is called /etc/init.d/boot.local | 20:42 |
| pabelanger | k | 20:42 |
| dirk | But why not directly inject it into the image? | 20:43 |
| pabelanger | we can do the disable I think | 20:43 |
| pabelanger | but nameserver has been runtime for a while | 20:43 |
| pabelanger | there is history | 20:43 |
| pabelanger | dirk: do you mind looking to see how to get dhclient.conf settings working? | 20:44 |
| dirk | I believe that is going to be non trivial | 20:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: gzip console log before uploading it https://review.openstack.org/483611 | 20:45 |
| dirk | Suse has its own network stack not respecting dhclient.conf I think | 20:45 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove hardcoded LOGNAME for ansible-playbook https://review.openstack.org/485749 | 20:45 |
| pabelanger | dirk: k, so you know if there is a way to supersede domain-name-servers 127.0.0.1 ? | 20:46 |
| fungi | the reason for doing nameserver setup in the image is that services start at boot which may fail to get dns replies when we're spiking parallel boot count and overload centralized nameservers | 20:46 |
| pabelanger | or stop appending DNS to resolv.conf stati | 20:46 |
| *** flepied has joined #openstack-infra | 20:47 | |
| *** Daisy_ has quit IRC | 20:47 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Gather facts smartly and cache them https://review.openstack.org/485384 | 20:47 |
| fungi | so among other things, it keeps our boot failures somewhat more in check | 20:47 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Simplify bindep logic removing fallback support https://review.openstack.org/482650 | 20:48 |
| dirk | pabelanger: the policy should avoid any dhcp induced dns.. so all we need is echo ... > /etc/resolv.conf | 20:48 |
| dirk | Reading https://github.com/openSUSE/wicked/blob/master/README now | 20:49 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Simplify bindep logic removing fallback support https://review.openstack.org/482650 | 20:49 |
| pabelanger | dirk: ya, we could use /etc/init.d/boot.local. just seeing if a better way | 20:49 |
| dirk | fungi: sure, the q for me was why don't it during boot rather than during build time in the image | 20:51 |
| dirk | If you preload a resolv.conf and set dns policy to static you should be good i think | 20:52 |
| dirk | Unless unbound is somehow started very late or so | 20:52 |
| fungi | ahh, yeah that's possible if we bundle some file content splatting into the service init | 20:53 |
| *** Sukhdev has quit IRC | 20:53 | |
| fungi | or inject another init script/unit before it, though that may require setting some dependency ordering (i thought we were relying on the distro package default service startup) | 20:54 |
| openstackgerrit | Ben Nemec proposed openstack-infra/tripleo-ci master: Calculate both create and update times for heat resources https://review.openstack.org/485821 | 20:55 |
| pabelanger | fungi: dirk: we don't update resolv.conf in DIB because it will also start using that DNS during image creation. Thats the main reason to do it at boot | 20:55 |
| pabelanger | so /etc/init.d/boot.local echo nameserver and NETCONFIG_DNS_POLICY='' should be enough | 20:56 |
| pabelanger | dirk: do you mind doing that?^ | 20:56 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Remove OOM check from tox role https://review.openstack.org/485377 | 20:56 |
| dirk | pabelanger: yep | 20:58 |
| dirk | pabelanger: will do | 20:59 |
| *** rloo has joined #openstack-infra | 20:59 | |
| dirk | fungi: hmm, thats a very good reason | 21:00 |
| *** dprince has quit IRC | 21:00 | |
| *** jascott1 has quit IRC | 21:01 | |
| *** jascott1 has joined #openstack-infra | 21:02 | |
| *** makowals has quit IRC | 21:03 | |
| *** _milan_ has quit IRC | 21:04 | |
| *** thorst_ has quit IRC | 21:05 | |
| *** rhallisey has quit IRC | 21:05 | |
| *** jascott1_ has joined #openstack-infra | 21:06 | |
| *** jascott1 has quit IRC | 21:06 | |
| openstackgerrit | Dirk Mueller proposed openstack-infra/project-config master: Avoid dynamic modification of resolv.conf on openSUSE https://review.openstack.org/485809 | 21:06 |
| *** hamzy has joined #openstack-infra | 21:06 | |
| dirk | pabelanger: ^^ not fully tested | 21:06 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove nodepool DIB specific logic https://review.openstack.org/485824 | 21:07 |
| *** krtaylor has quit IRC | 21:07 | |
| dirk | alternatively one could touch a file in /etc/sysconfig/network/if-up.d/.. | 21:08 |
| dirk | I'm not convinced that is better though. boot.local is executed pretty late, so that is a safer approach (unbound is likely running already by then) | 21:09 |
| *** thorst has joined #openstack-infra | 21:09 | |
| *** Apoorva_ has quit IRC | 21:10 | |
| *** Apoorva has joined #openstack-infra | 21:10 | |
| *** trown is now known as trown|outtypewww | 21:11 | |
| *** thorst has quit IRC | 21:13 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Check out implicit branch in timer jobs https://review.openstack.org/485329 | 21:13 |
| *** ldnunes has quit IRC | 21:15 | |
| *** chlong_ has quit IRC | 21:16 | |
| *** jcoufal has quit IRC | 21:17 | |
| *** Goneri has quit IRC | 21:19 | |
| *** gouthamr has quit IRC | 21:26 | |
| hwoarang | dirk: btw the if-up.d/* scripts are not being used by wicked at all. i had a chat with marius a few days ago | 21:26 |
| hwoarang | if you want a script to be executed on network up/down you have to use POST_{UP,DOWN}_SCRIPT in the ifcfg files or in netconfig | 21:27 |
| *** vhosakot has quit IRC | 21:28 | |
| *** vhosakot has joined #openstack-infra | 21:28 | |
| *** dave-mccowan has quit IRC | 21:31 | |
| *** esberglu has quit IRC | 21:32 | |
| *** aeng has joined #openstack-infra | 21:36 | |
| *** jamesdenton has quit IRC | 21:38 | |
| *** thorst has joined #openstack-infra | 21:38 | |
| clarkb | fungi: dirk we edit and restart unbound long after boot (when nodepool runs ready script) | 21:40 |
| clarkb | this is to set ipv6 resolvers when ipv6 is glovally routable and ipv4 otherwise | 21:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Improve display of simple error messages https://review.openstack.org/485833 | 21:41 |
| *** wolverineav has quit IRC | 21:41 | |
| *** wolverineav has joined #openstack-infra | 21:42 | |
| *** thorst has quit IRC | 21:42 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Improve display of simple error messages https://review.openstack.org/485833 | 21:42 |
| *** wolverineav has quit IRC | 21:46 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Improve display of simple error messages https://review.openstack.org/485833 | 21:47 |
| fungi | true | 21:50 |
| fungi | and recent, but important | 21:51 |
| *** esberglu has joined #openstack-infra | 21:51 | |
| *** florianf has quit IRC | 21:52 | |
| *** jascott1_ has quit IRC | 21:54 | |
| *** jascott1 has joined #openstack-infra | 21:54 | |
| *** esberglu has quit IRC | 21:56 | |
| *** xyang1 has quit IRC | 21:56 | |
| *** jascott1 has quit IRC | 21:56 | |
| *** jascott1 has joined #openstack-infra | 21:56 | |
| *** yamamoto has joined #openstack-infra | 21:57 | |
| *** esberglu has joined #openstack-infra | 22:00 | |
| *** yamamoto has quit IRC | 22:00 | |
| *** felipemonteiro_ has quit IRC | 22:01 | |
| *** jascott1 has quit IRC | 22:01 | |
| *** iyamahat__ has joined #openstack-infra | 22:02 | |
| *** baoli has quit IRC | 22:03 | |
| *** iyamahat_ has quit IRC | 22:04 | |
| *** baoli has joined #openstack-infra | 22:04 | |
| *** baoli has quit IRC | 22:05 | |
| *** rwsu has quit IRC | 22:05 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove gather_facts: true https://review.openstack.org/485834 | 22:06 |
| *** dave-mccowan has joined #openstack-infra | 22:06 | |
| *** jkilpatr has joined #openstack-infra | 22:07 | |
| *** vhosakot has quit IRC | 22:17 | |
| openstackgerrit | Gabriele Cerami proposed openstack-infra/tripleo-ci master: WIP: containers periodic test https://review.openstack.org/475747 | 22:18 |
| *** marst has quit IRC | 22:19 | |
| *** jascott1 has joined #openstack-infra | 22:19 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Improve display of simple error messages https://review.openstack.org/485833 | 22:20 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove validate-host from unittests/pre.yaml https://review.openstack.org/485836 | 22:23 |
| *** jascott1 has quit IRC | 22:24 | |
| *** dave-mccowan has quit IRC | 22:24 | |
| *** Daisy_ has joined #openstack-infra | 22:26 | |
| *** bobh has quit IRC | 22:28 | |
| *** gordc has quit IRC | 22:30 | |
| *** Daisy_ has quit IRC | 22:31 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: gzip console log before uploading it https://review.openstack.org/483611 | 22:33 |
| *** camunoz has quit IRC | 22:33 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Check out implicit branch in timer jobs https://review.openstack.org/485329 | 22:37 |
| *** tesseract has quit IRC | 22:37 | |
| *** panda is now known as panda|off | 22:40 | |
| *** iyamahat_ has joined #openstack-infra | 22:42 | |
| *** iyamahat__ has quit IRC | 22:44 | |
| ianw | ahh the old rc.local debate | 22:44 |
| *** jascott1 has joined #openstack-infra | 22:48 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: WIP: Move subunit processing https://review.openstack.org/485840 | 22:49 |
| *** baoli has joined #openstack-infra | 22:50 | |
| *** annegentle has quit IRC | 22:51 | |
| *** rbrndt has quit IRC | 22:53 | |
| *** rbrndt has joined #openstack-infra | 22:54 | |
| *** rbrndt has quit IRC | 22:54 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: WIP: Check out implicit branch in timer jobs https://review.openstack.org/485329 | 22:55 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: WIP: Move subunit processing https://review.openstack.org/485840 | 22:56 |
| *** annegentle has joined #openstack-infra | 22:58 | |
| *** yamamoto has joined #openstack-infra | 23:01 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: WIP: Move subunit processing https://review.openstack.org/485840 | 23:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Check out implicit branch in timer jobs https://review.openstack.org/485329 | 23:03 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Rename tags job variable jobtags https://review.openstack.org/485845 | 23:06 |
| *** yamamoto has quit IRC | 23:07 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: WIP: Move subunit processing https://review.openstack.org/485840 | 23:07 |
| *** gouthamr has joined #openstack-infra | 23:08 | |
| *** baoli has quit IRC | 23:09 | |
| *** ihrachys has quit IRC | 23:10 | |
| boris-42____ | @jeblair hi there | 23:12 |
| boris-42____ | I was trying to fix one of the gate jobs Rally-Designate | 23:13 |
| boris-42____ | and I am geeting strange error | 23:13 |
| boris-42____ | http://logs.openstack.org/50/485750/6/check/gate-rally-dsvm-designate-rally-pdns4-ubuntu-xenial-nv/31cf67f/logs/devstack-early.txt.gz | 23:13 |
| boris-42____ | ./stack.sh: line 540: generate-subunit: command not found | 23:13 |
| boris-42____ | https://review.openstack.org/#/c/484954/ | 23:13 |
| boris-42____ | here is the patch and everything seems lie in other jobs .. | 23:13 |
| *** askb has joined #openstack-infra | 23:14 | |
| *** esberglu has quit IRC | 23:16 | |
| *** Sukhdev has joined #openstack-infra | 23:16 | |
| clarkb | boris-42____: the log you linked and the cahnge you linked are different | 23:17 |
| boris-42____ | @clarkb change is for Infra | 23:17 |
| clarkb | 484954 and 485750 | 23:17 |
| boris-42____ | @clarkb logs are for patch in Rally | 23:17 |
| boris-42____ | @clarkb that patch doesn't affect designate scenarios so it's safe to use it | 23:18 |
| boris-42____ | @clarkb I did recently change in Infra (that I pointed) to fix rally-designate job (the link that I shared) | 23:18 |
| boris-42____ | but I am really out of ideas why it says | ./stack.sh: line 540: generate-subunit: command not found | 23:18 |
| clarkb | boris-42____: looking at the error log the subunit error is I think just a side effect, the real error appears to be that you haven't provided a password value and we aren't running with a tty to get one from the user | 23:19 |
| clarkb | however the password is set in the local.conf | 23:19 |
| clarkb | perhaps /opt/stack/new/devstack/functions-common: line 691: hexdump: command not found is actual error? I'm not sure | 23:21 |
| boris-42____ | @clarkb btw here is the job description https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/rally.yaml#L191-L235 | 23:22 |
| *** csomerville has quit IRC | 23:23 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: WIP: Move subunit processing https://review.openstack.org/485840 | 23:24 |
| clarkb | boris-42____: if you look at that code path it definitely looks like it isn't wanting to use the existing password in local.conf. Perhaps https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/rally.yaml#L224-L225 is related, specifically if hcnaging the dir there causes problems | 23:25 |
| ianw | boris-42____: localrc and local.conf:[[local]] both exist, using localrc ... i think your setup is making localrc, which overrides local.conf | 23:25 |
| *** jaypipes has quit IRC | 23:25 | |
| clarkb | boris-42____: basically devstack isn't seeing a password set so it needs you to interactively set one | 23:25 |
| clarkb | ianw: ah | 23:25 |
| boris-42____ | woow | 23:25 |
| ianw | clarkb: yeah, i've seen that before, you loose the "generate password" defs we setup in gate | 23:25 |
| boris-42____ | @clarkb so I should just remove gate hook? | 23:26 |
| boris-42____ | @clarkb or use DevstackLOCALCONF | 23:26 |
| boris-42____ | env variable | 23:26 |
| boris-42____ | https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/designate.yaml#L26 like here * | 23:26 |
| boris-42____ | yep? | 23:26 |
| clarkb | boris-42____: well I'm not sure what you are trying to accomplish | 23:26 |
| boris-42____ | @clarkb get job working=) | 23:26 |
| clarkb | boris-42____: right but why cd into that dir and run a rnadom script? | 23:26 |
| clarkb | what is its purpose? | 23:26 |
| boris-42____ | @clarkb so because I can't rich anybody from designate team I just went to their jobs that are passing and tried to copy paste it * | 23:27 |
| boris-42____ | yep seems like they don't have this hook | 23:28 |
| boris-42____ | if they use this new syntax | 23:28 |
| boris-42____ | will push fix soon | 23:28 |
| ianw | http://git.openstack.org/cgit/openstack/designate/tree/devstack/gate/gate_hook.sh#n12 <- that's the issue | 23:28 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Rename uuid to build https://review.openstack.org/485851 | 23:32 |
| openstackgerrit | Boris Pavlovic proposed openstack-infra/project-config master: Fix gate-rally-dsvm-designate-* jobs https://review.openstack.org/485852 | 23:33 |
| *** armax has quit IRC | 23:33 | |
| boris-42____ | @ianw thanks | 23:33 |
| boris-42____ | @ianw ^ I just pushed the changes that removes it | 23:34 |
| boris-42____ | hope job is going to start working | 23:34 |
| boris-42____ | now | 23:34 |
| *** pahuang has joined #openstack-infra | 23:34 | |
| *** thorst has joined #openstack-infra | 23:37 | |
| *** Swami has quit IRC | 23:37 | |
| *** Apoorva_ has joined #openstack-infra | 23:37 | |
| *** thorst has quit IRC | 23:38 | |
| pabelanger | clarkb: what is the difference between .testrepository/0.2 and .testrepository/0 ? | 23:40 |
| pabelanger | are they generated by different things? | 23:40 |
| boris-42____ | @clarkb if you find some time https://review.openstack.org/#/c/485852/ could you please +2 it (just removing those lines) | 23:41 |
| boris-42____ | thnaks | 23:41 |
| *** Apoorva has quit IRC | 23:41 | |
| clarkb | pabelanger: 0.2 is subunit v2 format and 0 is v3 by default | 23:41 |
| clarkb | pabelanger: same data but serialized in two different ways | 23:42 |
| pabelanger | clarkb: I see, is anything still using subunit v2 today? | 23:42 |
| clarkb | pabelanger: I'm not sure, I think we may have kept it around because it is more easily human readable | 23:42 |
| clarkb | pabelanger: but v3 is what all the parsing tooling should use as its faster | 23:43 |
| pabelanger | clarkb: thanks, how does tox know to use v3 now? | 23:43 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add zuul.items to job vars https://review.openstack.org/485853 | 23:44 |
| pabelanger | clarkb: I mean, if I wanted to to force v2 format, how do I do that? | 23:44 |
| clarkb | oh I may have got things confused by zuul version its v2 and v1 | 23:45 |
| clarkb | but you use subunit-2to1 iirc | 23:45 |
| clarkb | and 1to2 | 23:45 |
| pabelanger | okay, thanks | 23:46 |
| clarkb | pabelanger: also tox doens't do anything with subunit its completely separate | 23:46 |
| clarkb | subunit is the testr (and os-testr and stestr etc) logging format | 23:46 |
| *** annegentle has quit IRC | 23:48 | |
| *** Sukhdev has quit IRC | 23:48 | |
| pabelanger | clarkb: ya, I am trying to ansiblify http://git.openstack.org/cgit/openstack-infra/project-config/tree/jenkins/scripts/run-tox.sh#n37 and mostly curious what is using /0.2 and /0 today | 23:48 |
| pabelanger | but nodepool and zuul have .testrepository/0 | 23:49 |
| pabelanger | both* | 23:49 |
| pabelanger | but haven't found .testrepository/0.2 yet | 23:49 |
| clarkb | pabelanger: I think that may be an artifact of the transition between testr versions | 23:51 |
| clarkb | pabelanger: at this point it is probably fine to assume everything uses latest subunit version | 23:51 |
| pabelanger | clarkb: ya, that is what I am thinking | 23:51 |
| pabelanger | cool | 23:51 |
| clarkb | pabelanger: would would just be .testrepository/0 | 23:51 |
| pabelanger | ack | 23:52 |
| *** david-lyle has quit IRC | 23:54 | |
| boris-42____ | @ianw but why this one works then https://github.com/openstack-infra/project-config/blob/master/jenkins/jobs/designate.yaml#L109-L157 | 23:56 |
| boris-42____ | @ianw there it doesn't export enabled services | 23:56 |
| boris-42____ | or I am missing something there? | 23:56 |
| ianw | boris-42____: ohhh, http://git.openstack.org/cgit/openstack/designate/tree/devstack/settings#n71 , i guess it enables it | 23:58 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Log items in loops better https://review.openstack.org/485864 | 23:58 |
| *** oomichi has quit IRC | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!