| *** ijw has quit IRC | 00:00 | |
| dmsimard | jeblair: I'll have a comment for the git patch, gimme a few to write something down | 00:00 |
|---|---|---|
| *** greghaynes has quit IRC | 00:00 | |
| openstackgerrit | Merged openstack-infra/project-config master: Zuul v3: Add use-cached-repos role https://review.openstack.org/498619 | 00:02 |
| clarkb | which leads to me second question is the whitespace after opening quotes on the with_* intentionaL/ | 00:03 |
| clarkb | with_items: " {{ zuul.projects }}" for example has space after opening quote but other with_* do it too | 00:03 |
| clarkb | (and maybe it doesn't matter beacuse that is in ansible magic and not ansible) | 00:03 |
| clarkb | *not yaml | 00:03 |
| clarkb | jlvillal: rama_y release happens in ~12 hours. Do you think you could modify https://review.openstack.org/#/c/492231/ tomorrow as suggested by tonyb and then we can get it in? | 00:03 |
| *** greghaynes has joined #openstack-infra | 00:04 | |
| *** sflanigan has quit IRC | 00:04 | |
| *** pahuang has quit IRC | 00:04 | |
| rama_y | clarkb, I will post the patch update soon | 00:04 |
| *** mwarad has joined #openstack-infra | 00:05 | |
| jlvillal | rama_y: As a note, I think it might need to be reversed: "stable/newton stable/ocata stable/pike" =~ $ZUUL_BRANCH | 00:06 |
| *** pahuang has joined #openstack-infra | 00:06 | |
| rama_y | I will test it out on my devstack-gate test patch as well | 00:06 |
| jlvillal | rama_y: To: $ZUUL_BRANCH =~ "stable/newton stable/ocata stable/pike" | 00:06 |
| jlvillal | rama_y: But I'm not sure. I'm just reading the man page :) | 00:06 |
| rama_y | thanks jlvillal | 00:06 |
| jlvillal | rama_y: Actually I am probably wrong... | 00:06 |
| tonyb | jlvillal: No thew syntax I used was correct | 00:07 |
| jlvillal | tonyb: Thanks | 00:07 |
| rama_y | tonyb, clarkb, thanks | 00:07 |
| tonyb | http://paste.openstack.org/show/619842 is how I tested it | 00:07 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Remove whitespace from use-cached-repos role https://review.openstack.org/498991 | 00:18 |
| dmsimard | jeblair: bah I guess you didn't wait for my comment but I added it anyway | 00:19 |
| dmsimard | see https://review.openstack.org/#/c/498619/4 | 00:19 |
| dmsimard | mordred: ^ | 00:19 |
| jeblair | dmsimard: sorry, i +wd before you mentioned you were reviewing. i'm happy to engage in post-hoc review | 00:20 |
| dmsimard | jeblair: no offense taken :P | 00:20 |
| *** sflanigan has joined #openstack-infra | 00:20 | |
| openstackgerrit | Ramamani Yeleswarapu proposed openstack-infra/project-config master: Enable TLS in ironic gate jobs except grenade https://review.openstack.org/492231 | 00:21 |
| *** thorst_afk has joined #openstack-infra | 00:22 | |
| *** hongbin has quit IRC | 00:23 | |
| openstackgerrit | James E. Blair proposed openstack-infra/devstack-gate master: Zuul v3: add a devstack-legacy job https://review.openstack.org/497699 | 00:23 |
| jeblair | dmsimard: replied | 00:23 |
| dmsimard | jeblair: so should I send a follow up patch to merge the tasks ? | 00:24 |
| pabelanger | :( | 00:24 |
| pabelanger | 2017-08-30 00:18:27.279 | localhost | FAILED | fix_disk_layout : Fix the disk layout | rc=1 >> | 00:25 |
| pabelanger | really not doing well this evening | 00:25 |
| jeblair | dmsimard: yeah, it's worth a discussion | 00:25 |
| dmsimard | pabelanger: again ? it's literally happened 3 times in last 10 days according to elastic recheck | 00:25 |
| pabelanger | http://logs.openstack.org/74/498074/12/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/41e5b9b/logs/devstack-gate-setup-host.txt | 00:25 |
| pabelanger | dmsimard: ya, that is about the 4th time in the last 1hour I have hit it | 00:25 |
| dmsimard | pabelanger: maybe there is something different with the role than with the script but it was copied verbatim | 00:25 |
| dmsimard | pabelanger: I'll re-review https://review.openstack.org/#/c/496935/ in case there's something obviously wrong | 00:26 |
| jeblair | dmsimard, pabelanger: is it possible that previously the script failed without terminating the job? | 00:27 |
| clarkb | pabelanger: dmsimard its possible that running it under ansible or moving it from setup_workspace to _host is triggering the race more frequently for some reason | 00:27 |
| clarkb | jeblair: no it failed previously and failed the jobs (we are tracking it with e-r) | 00:27 |
| openstackgerrit | Ramamani Yeleswarapu proposed openstack-infra/devstack-gate master: [TESTING][DO NOT MERGE] Testing TLS in Ironic jobs https://review.openstack.org/492661 | 00:27 |
| clarkb | jeblair: but at the rate of like 4 times a week not 4 times an hour | 00:27 |
| dmsimard | jeblair: btw the in-line jinja stuff might look ugly at first but you learn to embrace it and the flexibility it provides is super powerful. I learned it from openstack-ansible | 00:27 |
| pabelanger | jeblair: not sure, I'll have to check logstash | 00:28 |
| pabelanger | clarkb: ya, I wonder if it is getting setup sooner now | 00:28 |
| dmsimard | pabelanger: it is | 00:29 |
| dmsimard | it's part of setup_host so it occurs earlier | 00:29 |
| dmsimard | should it not be part of setup_host ? | 00:29 |
| *** thorst_afk has quit IRC | 00:29 | |
| dmsimard | feels appropriate.. | 00:29 |
| *** thorst_afk has joined #openstack-infra | 00:30 | |
| *** Swami has quit IRC | 00:30 | |
| jeblair | the issue is that /dev/xvde has been repartitioned, but /dev/xvde1 doesn't show up yet? | 00:31 |
| dmsimard | clarkb: hm, I wonder if it would be the set -ex causing the script to exit on a failure we don't really care about while it would have otherwise not before | 00:31 |
| openstackgerrit | Sam Yaple proposed openstack-infra/shade master: Allow domain_id for roles https://review.openstack.org/496992 | 00:32 |
| clarkb | no it definitely caused failures before | 00:32 |
| clarkb | we are trackng it in e-r for this reason | 00:32 |
| pabelanger | jeblair: I believe so, clarkb knows more | 00:33 |
| dmsimard | clarkb: do you see an explicit "set -e" ? I see -x but no -e's. That might have been added as part of the new role | 00:34 |
| clarkb | jeblair: yes so we added a sync and partprobe | 00:34 |
| pabelanger | dmsimard: http://logs.openstack.org/81/428481/14/check/gate-tempest-dsvm-py35-ubuntu-xenial/b28fc52/logs/devstack-gate-setup-workspace-new.txt is a failure from last week | 00:34 |
| dmsimard | -e will make the script exit on anything that exits non-zero | 00:34 |
| *** thorst_afk has quit IRC | 00:34 | |
| clarkb | jeblair: sync wasnt expected to help as thats fs but the partprobe should update devfs if the partition is there | 00:34 |
| dmsimard | but I guess it's really failing because of the missing xvde1 so set -e wouldn't change that .. | 00:36 |
| dmsimard | clarkb: we could consider looping/retrying/sleeping for a while ? | 00:36 |
| * dmsimard writes something | 00:36 | |
| pabelanger | I think we might consider a revert and more testing? | 00:37 |
| jeblair | clarkb: what about 'kpartx -s' ? | 00:37 |
| *** olaph1 has joined #openstack-infra | 00:38 | |
| *** olaph has quit IRC | 00:38 | |
| clarkb | jeblair: ya we could try that | 00:39 |
| clarkb | maybe put a 10 minute timeout on it | 00:39 |
| jeblair | clarkb, pabelanger, dmsimard: if we're unsure about whether the playbook change has destabilized this somehow, maybe we should revert and collect more data? | 00:41 |
| *** skelso has joined #openstack-infra | 00:41 | |
| pabelanger | ya, I think we should | 00:42 |
| pabelanger | another failure in gate: http://logs.openstack.org/72/498772/2/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/3531a69/logs/devstack-gate-setup-host.txt | 00:42 |
| *** mwarad has quit IRC | 00:42 | |
| *** sekelso has joined #openstack-infra | 00:42 | |
| jeblair | pabelanger: are all the failures in tripleo? | 00:43 |
| *** pvaneck has quit IRC | 00:43 | |
| pabelanger | jeblair: so far, from what I have seen ya. But, I haven't been looking at other jobs | 00:43 |
| pabelanger | I can check that now | 00:43 |
| jeblair | oh i assumed you were using logstash | 00:44 |
| *** lbragstad has joined #openstack-infra | 00:44 | |
| pabelanger | no, just looking at status.o.o/zuul | 00:44 |
| pabelanger | nothing in logstash yet | 00:44 |
| *** zhurong has joined #openstack-infra | 00:45 | |
| pabelanger | actually, I lied | 00:45 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Retry for a while if the block device is not ready https://review.openstack.org/498993 | 00:45 |
| pabelanger | message:"/dev/xvde1: No such file or directory" AND tags:"console" is the new query | 00:45 |
| pabelanger | and we have a large spike | 00:45 |
| *** olaph1 is now known as olaf | 00:45 | |
| *** olaf is now known as olaph | 00:45 | |
| dmsimard | clarkb, pabelanger, jeblair: ^ would something like that make sense ? | 00:46 |
| jeblair | dmsimard: yeah, but let's land a revert, then add that to an unrevert | 00:46 |
| dmsimard | sure. | 00:46 |
| *** skelso has quit IRC | 00:46 | |
| jeblair | dmsimard: and we can recheck it a lot to get some samples; hopefully catch it in action | 00:46 |
| jeblair | pabelanger: are you proposing a revert? | 00:46 |
| dmsimard | hopefully an approach like that will get rid of any raciness | 00:46 |
| dmsimard | let me propose the revert since I'm not core | 00:47 |
| dmsimard | so you can all +5 | 00:47 |
| pabelanger | okay, not limited to tripleo, shade just hit it too: http://logs.openstack.org/92/496992/7/check/gate-shade-functional-legacy/2a631d0/logs/devstack-gate-setup-host.txt | 00:47 |
| jeblair | dmsimard: i'd like to also experiment with using kpartx instead of looping (since it has a sync option) | 00:47 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Revert "Move fix_disk_layout to an Ansible role in setup_host" https://review.openstack.org/498994 | 00:47 |
| jeblair | dmsimard: but we can propose both of those things and see how they work | 00:47 |
| dmsimard | jeblair: I'm not familiar with kpartx, but sure | 00:48 |
| dmsimard | revert in https://review.openstack.org/498994 | 00:48 |
| pabelanger | +2 | 00:48 |
| bkero | kpartx++ | 00:48 |
| bkero | dmsimard: Basically it scans a file for partitions, then creates block devices for them in /dev/mapper | 00:49 |
| jeblair | i'm going to promote the enqueue to top of gate | 00:49 |
| pabelanger | jeblair: thanks | 00:49 |
| bkero | kpartx -a /home/dmsimard/file1.dd will result in /dev/mapper/file1p1 and /dev/mapper/file1p2 | 00:49 |
| dmsimard | a wild bkero has appeared | 00:50 |
| dmsimard | haven't seen you in ages | 00:50 |
| dmsimard | hi :) | 00:50 |
| bkero | dmsimard: Aye. :) | 00:50 |
| bkero | Hello there | 00:50 |
| bkero | Congrats on the ARA work | 00:50 |
| *** ijw has joined #openstack-infra | 00:50 | |
| dmsimard | thanks, I'm trying hard :) | 00:51 |
| bkero | I hope dayjob is letting you contribute part or full time. | 00:51 |
| bkero | I am deep in kolla-land now. Not upstream yet though. | 00:51 |
| dmsimard | bkero: ehhh, mostly on my personal time still | 00:52 |
| dmsimard | I don't think I would want to work on ara full time anyway, I'm not a professional programmer.. just a sysadmin who tends to like programming things :) | 00:52 |
| jeblair | promoted | 00:52 |
| dmsimard | I think coding things full time for a living would drive me nuts :D | 00:53 |
| pabelanger | danke | 00:53 |
| mnaser | wow i've never seen status.o.o this quiet :o | 00:54 |
| *** ijw has quit IRC | 00:54 | |
| *** rlandy|bbl is now known as rlandy | 00:54 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Remove whitespace from use-cached-repos role https://review.openstack.org/498991 | 00:56 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Fix errors in use-cache-repos https://review.openstack.org/498995 | 00:56 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Create zuul_executor_dest variable for fetch-sphinx-output https://review.openstack.org/498624 | 00:57 |
| *** LindaWang has joined #openstack-infra | 00:57 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Fix errors in mirro-workspace-git-repos https://review.openstack.org/498997 | 00:58 |
| *** jamesmcarthur has joined #openstack-infra | 00:58 | |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Remove query for bug 1674681 https://review.openstack.org/498974 | 00:59 |
| openstack | bug 1674681 in tripleo "buildlogs.centos.org CDN issues" [Critical,In progress] https://launchpad.net/bugs/1674681 | 00:59 |
| *** thorst_afk has joined #openstack-infra | 01:02 | |
| *** ijw has joined #openstack-infra | 01:03 | |
| *** thorst_afk has quit IRC | 01:03 | |
| *** mwarad has joined #openstack-infra | 01:03 | |
| *** rama_y has quit IRC | 01:04 | |
| *** ijw has quit IRC | 01:07 | |
| *** ijw has joined #openstack-infra | 01:07 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Retry for a while if the block device is not ready https://review.openstack.org/498993 | 01:07 |
| *** annegentle has joined #openstack-infra | 01:11 | |
| *** timrc has quit IRC | 01:12 | |
| *** timrc has joined #openstack-infra | 01:13 | |
| *** baoli has joined #openstack-infra | 01:13 | |
| clarkb | are we going with ^ over kpartx? | 01:13 |
| clarkb | also I'm not sure if kpartx is included in our base images | 01:14 |
| *** pahuang has quit IRC | 01:17 | |
| *** pahuang has joined #openstack-infra | 01:20 | |
| pabelanger | ya, same. we likey need to make sure devstack-gate installs it | 01:22 |
| fungi | just now catching up before i pass out, but a busy-wait checking for the device seems reasonable (and probably safer?) | 01:27 |
| *** masayukig has quit IRC | 01:28 | |
| *** masayukig has joined #openstack-infra | 01:29 | |
| dmsimard | clarkb: not saying we don't want to use kpartx or not | 01:31 |
| dmsimard | But at least trying to make that patch pass so we can gather data | 01:31 |
| clarkb | ya we can always switch to kpartx later | 01:31 |
| clarkb | dmsimard: looks like your change failed pretty quickly though | 01:32 |
| dmsimard | Yeah I'm going to test it locally, syntax error somewhere | 01:32 |
| clarkb | dmsimard: missing a then on the if ; then | 01:33 |
| dmsimard | Doh | 01:33 |
| clarkb | I had to read the error before I saw it | 01:33 |
| clarkb | I blame python | 01:33 |
| dmsimard | aye, also struggling with the context switching from ansible to jinja to python to bash to whatever else :p | 01:34 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Retry for a while if the block device is not ready https://review.openstack.org/498993 | 01:35 |
| dmsimard | Thank god there's not a lot of UI/UX work in ara 1.0, frontend is something that does not excite me very much. | 01:35 |
| clarkb | I always end up with the equivalent of stick figures when doing UI | 01:36 |
| dmsimard | I hacked my way through with patternfly, lots of copy pasta from their great docs http://www.patternfly.org/ | 01:36 |
| dmsimard | plus, it's a layer on top of twitter bootstrap which I was already relatively familiar with | 01:37 |
| clarkb | dmsimard: telnet://104.239.174.149:19885 that job is running on rax-iad and should exercise your change | 01:42 |
| dmsimard | oh yeah I love exercise | 01:42 |
| dmsimard | that reminds me, something I found weird about pabelanger's failure from earlier I forgot to mention | 01:43 |
| dmsimard | http://logs.openstack.org/74/498074/12/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/41e5b9b/logs/devstack-gate-setup-host.txt | 01:43 |
| dmsimard | One node succeeds fix_disk_layout (because it doesn't have xvde) and the other fails (because it has xvde and runs into the race) | 01:43 |
| dmsimard | Two VMs in a single region are not provided with the same configuration layout ? | 01:44 |
| dmsimard | or are we missing something | 01:44 |
| clarkb | dmsimard: yes in rax we know we don't get homogenous instances | 01:44 |
| clarkb | the flavor and image are all the same but it is possible to end up with different hypervisors and cpus | 01:44 |
| clarkb | though in this case the cpus are the same | 01:45 |
| clarkb | we discovered this problem when getting live migration testing working | 01:45 |
| dmsimard | hmmm, but looking at the host facts from that run, both instances do have an xvde drive | 01:45 |
| clarkb | which resulted in finding a nova bug | 01:45 |
| dmsimard | http://logs.openstack.org/74/498074/12/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/41e5b9b/logs/ara/ | 01:46 |
| clarkb | dmsimard: ya xvde exists and we partition it in both cases | 01:46 |
| clarkb | dmsimard: its the result of that partitioning xvde1 that doesn't show up in /dev (or is otherwise not valid for mkswapping) | 01:46 |
| dmsimard | but the set -x doesn't display the code path for the xvde partitioning | 01:47 |
| dmsimard | here, this one succeeded http://logs.openstack.org/74/498074/12/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/41e5b9b/logs/ara/result/2dfde402-9409-41a0-9a23-3e264c67be52/ | 01:47 |
| dmsimard | this one failed: http://logs.openstack.org/74/498074/12/gate/gate-tripleo-ci-centos-7-scenario003-multinode-oooq-puppet/41e5b9b/logs/ara/result/f87e8060-440d-4faa-a092-03611fd16694/ | 01:47 |
| dmsimard | wait nevermind it does | 01:48 |
| dmsimard | I was looking at the wrong field | 01:48 |
| dmsimard | T_T | 01:48 |
| clarkb | http://paste.openstack.org/show/619846/ that is from the build on rax | 01:48 |
| clarkb | it retried once | 01:48 |
| clarkb | so I guess this is a race | 01:48 |
| clarkb | infra-root based on ^ I'm going to approve that change now | 01:48 |
| dmsimard | clarkb: sweet, so that'd fix it then | 01:48 |
| dmsimard | clarkb: hang on | 01:49 |
| clarkb | ok | 01:49 |
| dmsimard | clarkb: this isn't submitted as a revert though | 01:49 |
| *** cuongnv has joined #openstack-infra | 01:49 | |
| dmsimard | did we want to revert the revert 6 | 01:49 |
| dmsimard | ? | 01:49 |
| clarkb | did we revert already? | 01:49 |
| dmsimard | yeah | 01:49 |
| clarkb | oh I Missed that | 01:49 |
| dmsimard | https://review.openstack.org/#/c/498994/ | 01:49 |
| dmsimard | is the revert | 01:49 |
| pabelanger | ya, can we hold off and get more data? | 01:49 |
| pabelanger | like recheck 10 times | 01:49 |
| clarkb | sure | 01:50 |
| pabelanger | see if swap fails | 01:50 |
| dmsimard | yeah, I'll recheck a few times -- but that retry showed that the disk wasn't ready, it retried once and it was | 01:50 |
| dmsimard | no need to rush things though | 01:50 |
| clarkb | dmsimard: yup so I am fairly confident in it | 01:50 |
| dmsimard | clarkb: I'll re-submit it as a proper revert revert | 01:50 |
| clarkb | we'll only have a problem if it takes longer than 10 seconds to resolve the race (in which case I think we haev bigger problems) | 01:50 |
| dmsimard | clarkb: yeah.. I mean we can put more than 10 seconds but it should be largely sufficient | 01:51 |
| pabelanger | line 23 on pastebin should be moved to line 26 | 01:51 |
| dmsimard | I don't see why it would take more than that | 01:51 |
| pabelanger | for zero based counter | 01:51 |
| *** hongbin has joined #openstack-infra | 01:51 | |
| dmsimard | pabelanger: that's from https://review.openstack.org/#/c/498993/3/playbooks/roles/fix_disk_layout/tasks/main.yaml | 01:51 |
| dmsimard | mind commenting there ? | 01:51 |
| dmsimard | oh, I see what you mean I think | 01:51 |
| pabelanger | left comment | 01:52 |
| dmsimard | yeah, I'll do that in a proper revert, ty | 01:53 |
| pabelanger | dmsimard: clarkb: maybe how long do we want to wait for device to come online? I mean, we could wait until the jobs times out, but is capping at 20secs enough? | 01:53 |
| *** tbarron|errand is now known as tbarron | 01:53 | |
| dmsimard | pabelanger: it should be near instantaneous, the race is just because the next command occurs *immediately* after the partition is stood up | 01:54 |
| clarkb | pabelanger: I would hope so. I think if it takes longer than a few seconds the job will fail anyawys due to slow IO | 01:54 |
| pabelanger | k | 01:54 |
| pabelanger | I wonder if there is an ansible role / task to do this | 01:54 |
| clarkb | well technically this is one :P | 01:55 |
| dmsimard | pabelanger: you can do retries with ansible | 01:55 |
| dmsimard | pabelanger: the problem is we're passing a dumb shell script on purpose | 01:55 |
| pabelanger | ya, I mean, once we ansilbfy this. I wonder if ansible has already solved the issue | 01:56 |
| clarkb | maybe? the problem is likely in the linux kernel | 01:56 |
| clarkb | so aside from retrying/waiting/polling I doubt you'd be able to correct it | 01:56 |
| pabelanger | ya | 01:56 |
| dmsimard | pabelanger: I started writing fix_disk_layout in ansible, few minutes draft https://gist.github.com/dmsimard/d3d818462292faf92dded7e2caf67bab | 01:56 |
| clarkb | partprobe should fix it but clearly I misunderstand partprobe | 01:56 |
| *** gcb has joined #openstack-infra | 01:58 | |
| ianw | from looking at the partprobe source a bit ago with that trusty issue, i think partprobe might just skip it | 01:58 |
| clarkb | ianw: so its a noop? | 01:59 |
| dmsimard | ianw: what do you think of https://review.openstack.org/#/c/498993/3/playbooks/roles/fix_disk_layout/tasks/main.yaml ? | 01:59 |
| *** kukacz has quit IRC | 02:00 | |
| ianw | maybe, for non-fs based partitions. i dunno, don't quote me ... any day i have to open util-linux/libfdisk/* it's never for a fun reason ... and it seems to happen semi frequently :) | 02:01 |
| *** kukacz has joined #openstack-infra | 02:01 | |
| ianw | did we ever have a udevadm settle in there? | 02:02 |
| clarkb | ianw: I don't think so | 02:02 |
| ianw | that *may* help too, and we do that in dib | 02:03 |
| ianw | of course, that may also be exactly equal to a "sleep 2" just in a different form | 02:03 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/elastic-recheck master: Add additional signature for xvde failures https://review.openstack.org/499005 | 02:03 |
| clarkb | that may be a good alternative to kpartx depending on what packages are installed | 02:04 |
| dmsimard | pabelanger: ^ added your query, hopefully I did it right | 02:04 |
| clarkb | ianw: jeblair had also suggested kpartx -s | 02:04 |
| *** thorst_afk has joined #openstack-infra | 02:04 | |
| ianw | in dib we were not doing a fsync() after writing the partition table, and "kpartx -s" didn't see the updated partition table and went ahead anyway. but, again, from memory of looking at parted code, it should do this correctly on exit | 02:06 |
| *** lbragstad has quit IRC | 02:07 | |
| ianw | so, yeah, i'd say that's another valid option | 02:07 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Revert "Revert "Move fix_disk_layout to an Ansible role in setup_host"" https://review.openstack.org/499007 | 02:07 |
| *** thorst_afk has quit IRC | 02:09 | |
| *** tinwood has quit IRC | 02:10 | |
| *** tinwood has joined #openstack-infra | 02:11 | |
| *** cody-somerville has joined #openstack-infra | 02:12 | |
| *** cody-somerville has quit IRC | 02:12 | |
| *** cody-somerville has joined #openstack-infra | 02:12 | |
| *** jamesmcarthur has quit IRC | 02:14 | |
| pabelanger | dmsimard: left comment | 02:15 |
| dmsimard | pabelanger: hah, good point. | 02:15 |
| openstackgerrit | Merged openstack-infra/shade master: Fix switched params https://review.openstack.org/498132 | 02:16 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/elastic-recheck master: Add additional signature for xvde failures https://review.openstack.org/499005 | 02:16 |
| *** benj_ has quit IRC | 02:17 | |
| *** pahuang has quit IRC | 02:19 | |
| *** benj_ has joined #openstack-infra | 02:21 | |
| *** sflanigan has quit IRC | 02:23 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Revert "Move fix_disk_layout to an Ansible role in setup_host" https://review.openstack.org/498994 | 02:24 |
| *** salv-orlando has joined #openstack-infra | 02:26 | |
| *** yamamoto has joined #openstack-infra | 02:30 | |
| *** sflanigan has joined #openstack-infra | 02:35 | |
| *** sflanigan has joined #openstack-infra | 02:35 | |
| *** pahuang has joined #openstack-infra | 02:36 | |
| *** mwarad has quit IRC | 02:37 | |
| *** mwarad has joined #openstack-infra | 02:37 | |
| *** gouthamr has quit IRC | 02:46 | |
| *** yamamoto has quit IRC | 02:48 | |
| *** baoli has quit IRC | 02:54 | |
| *** baoli has joined #openstack-infra | 02:55 | |
| *** bobh has joined #openstack-infra | 02:56 | |
| *** edisonxiang has quit IRC | 02:59 | |
| *** mriedem has quit IRC | 03:03 | |
| *** dingyichen has joined #openstack-infra | 03:03 | |
| *** thorst_afk has joined #openstack-infra | 03:05 | |
| *** thorst_afk has quit IRC | 03:10 | |
| *** sree has joined #openstack-infra | 03:14 | |
| *** udesale has joined #openstack-infra | 03:18 | |
| *** iyamahat has quit IRC | 03:18 | |
| *** iyamahat has joined #openstack-infra | 03:18 | |
| *** chlong has quit IRC | 03:21 | |
| *** ijw has quit IRC | 03:22 | |
| *** sree has quit IRC | 03:23 | |
| *** iyamahat has quit IRC | 03:23 | |
| *** ramishra has joined #openstack-infra | 03:26 | |
| *** yamahata has quit IRC | 03:27 | |
| *** hongbin has quit IRC | 03:29 | |
| *** sflanigan has quit IRC | 03:29 | |
| *** sekelso has quit IRC | 03:30 | |
| *** pahuang has quit IRC | 03:31 | |
| *** yamamoto has joined #openstack-infra | 03:33 | |
| *** bobh has quit IRC | 03:37 | |
| *** lbragstad has joined #openstack-infra | 03:37 | |
| *** dave-mccowan has quit IRC | 03:40 | |
| *** links has joined #openstack-infra | 03:40 | |
| *** yamamoto has quit IRC | 03:41 | |
| *** sflanigan has joined #openstack-infra | 03:42 | |
| *** pahuang has joined #openstack-infra | 03:45 | |
| ianw | wow, so kpartx -s is way more complicated that first glance ... spans about 3 libraries | 03:47 |
| *** baoli has quit IRC | 03:51 | |
| *** annegentle has quit IRC | 03:52 | |
| dmsimard | ianw: are you in the matrix yet | 03:52 |
| *** stakeda has quit IRC | 03:58 | |
| dmsimard | ianw, pabelanger, clarkb: wow.. so there's certainly something about fix_disk_layout being in Ansible that exacerbates the xvde issue | 03:59 |
| dmsimard | Out of one patchset, 4 jobs and 6 nodes landed on RAX | 03:59 |
| dmsimard | Out of those 6 nodes, all had to retry once | 03:59 |
| dmsimard | I put a first batch of data in https://review.openstack.org/#/c/499007/1/playbooks/roles/fix_disk_layout/tasks/main.yaml -- I'll recheck once all the jobs complete | 03:59 |
| ianw | dmsimard: i just dropped a comment on that, i won't repeat it, but maybe it can help root cause? | 04:00 |
| dmsimard | The good news is that the retry worked in all cases | 04:00 |
| dmsimard | ianw: so you'd replace the sync and partprobe by "udevadm settle --exit-if-exists ${DEV}" ? | 04:02 |
| ianw | dmsimard: maybe ... but i think the better part would be putting in the queue check to see if it's actually likely to do anything | 04:03 |
| ianw | of course, just the time to fork udevadm might be enough for things to clear out, so it's not a slam-dunk | 04:04 |
| ianw | but, if we did see the udev queue with things in it, and the swap device wasn't there, well then that's a positive data point | 04:04 |
| ianw | ... to suggest that a "settle" isn't just a placebo, but really the right thing to do | 04:05 |
| *** thorst_afk has joined #openstack-infra | 04:06 | |
| dmsimard | ianw: ok I think I see what you mean | 04:09 |
| *** lbragstad has quit IRC | 04:09 | |
| dmsimard | ianw: there's probably no point in doing the while if we can just do a udevadm settle -t 10 --exit-if-exists ${DEV} ? | 04:09 |
| dmsimard | It likely produces the same result | 04:09 |
| ianw | true, both end up sleeping & timing out anyway | 04:10 |
| dmsimard | It would print the queue if there are things in it ? | 04:10 |
| *** thorst_afk has quit IRC | 04:10 | |
| ianw | i'm presuming "udevadm settle --timeout=0" exits with !0 if there is a queue? | 04:11 |
| dmsimard | hard to tell, it's kinda hard to reproduce :P | 04:11 |
| ianw | A value of 0 will check if the queue is empty and always return immediately. | 04:11 |
| ianw | thanks manual page, that doesn't really help :) | 04:11 |
| dmsimard | yeah doesn't tell the exit code | 04:12 |
| ianw | udev is in systemd now, til | 04:13 |
| dmsimard | ianw: headed to bed, I'll pick it back up tomorrow morning, thanks for the ideas | 04:14 |
| *** ykarel has joined #openstack-infra | 04:19 | |
| clarkb | ${DEV}1 | 04:23 |
| clarkb | since $DEV does exist | 04:23 |
| ianw | dmsimard: np. dropped some more comments confirming the behaviour after looking at the code | 04:24 |
| ianw | i'll leave it for you since you're into it :) | 04:24 |
| *** claudiub|2 has joined #openstack-infra | 04:24 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Multinode jobs should not build images https://review.openstack.org/498772 | 04:26 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: In-tree ovs_vxlan_bridge function from devstack-gate https://review.openstack.org/498985 | 04:37 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Don't use docker-network.yaml env https://review.openstack.org/497720 | 04:43 |
| *** adisky__ has joined #openstack-infra | 04:45 | |
| *** yamahata has joined #openstack-infra | 04:45 | |
| *** sree has joined #openstack-infra | 04:54 | |
| *** salv-orlando has quit IRC | 04:58 | |
| openstackgerrit | Merged openstack-infra/shade master: De-client-ify Service Delete https://review.openstack.org/482197 | 05:01 |
| *** armax has quit IRC | 05:01 | |
| *** rama_y has joined #openstack-infra | 05:03 | |
| *** thorst_afk has joined #openstack-infra | 05:07 | |
| *** gcb has quit IRC | 05:10 | |
| *** gcb has joined #openstack-infra | 05:11 | |
| *** thorst_afk has quit IRC | 05:11 | |
| *** udesale__ has joined #openstack-infra | 05:13 | |
| *** udesale has quit IRC | 05:15 | |
| *** stakeda has joined #openstack-infra | 05:16 | |
| *** sflanigan has quit IRC | 05:18 | |
| *** yolanda has quit IRC | 05:21 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 05:22 | |
| *** salv-orlando has joined #openstack-infra | 05:23 | |
| *** cuongnv has quit IRC | 05:26 | |
| *** cuongnv has joined #openstack-infra | 05:27 | |
| *** dhajare has joined #openstack-infra | 05:30 | |
| *** sflanigan has joined #openstack-infra | 05:31 | |
| *** sflanigan has joined #openstack-infra | 05:31 | |
| *** rama_y has quit IRC | 05:31 | |
| *** chenying has quit IRC | 05:37 | |
| *** chenying has joined #openstack-infra | 05:37 | |
| *** pgadiya has joined #openstack-infra | 05:47 | |
| *** cody-somerville has quit IRC | 05:53 | |
| *** yamamoto has joined #openstack-infra | 05:59 | |
| *** honza has quit IRC | 06:06 | |
| *** honza has joined #openstack-infra | 06:07 | |
| *** honza is now known as Guest74283 | 06:07 | |
| *** thorst_afk has joined #openstack-infra | 06:07 | |
| *** jascott1 has quit IRC | 06:10 | |
| *** jascott1 has joined #openstack-infra | 06:11 | |
| *** thorst_afk has quit IRC | 06:12 | |
| *** jascott1 has quit IRC | 06:15 | |
| *** claudiub|2 has quit IRC | 06:18 | |
| *** iyamahat has joined #openstack-infra | 06:19 | |
| *** iyamahat has quit IRC | 06:21 | |
| *** iyamahat has joined #openstack-infra | 06:22 | |
| *** iyamahat has quit IRC | 06:23 | |
| *** hashar has joined #openstack-infra | 06:23 | |
| *** iyamahat has joined #openstack-infra | 06:23 | |
| *** iyamahat has quit IRC | 06:24 | |
| *** iyamahat_ has joined #openstack-infra | 06:24 | |
| *** iyamahat has joined #openstack-infra | 06:25 | |
| *** iyamahat_ has quit IRC | 06:25 | |
| *** rossella_s has quit IRC | 06:28 | |
| *** iyamahat has quit IRC | 06:29 | |
| *** iyamahat has joined #openstack-infra | 06:29 | |
| *** iyamahat_ has joined #openstack-infra | 06:30 | |
| *** iyamahat has quit IRC | 06:30 | |
| *** sree has quit IRC | 06:30 | |
| *** iyamahat_ has quit IRC | 06:35 | |
| *** iyamahat__ has joined #openstack-infra | 06:35 | |
| *** iyamahat__ has quit IRC | 06:38 | |
| *** iyamahat__ has joined #openstack-infra | 06:38 | |
| *** alexchadin has joined #openstack-infra | 06:39 | |
| *** sree has joined #openstack-infra | 06:39 | |
| *** sree has quit IRC | 06:42 | |
| *** rcernin has joined #openstack-infra | 06:42 | |
| *** pcaruana has joined #openstack-infra | 06:43 | |
| *** jtomasek has joined #openstack-infra | 06:45 | |
| *** Guest74283 is now known as honza_ | 06:48 | |
| *** slaweq has joined #openstack-infra | 06:50 | |
| *** liujiong has joined #openstack-infra | 06:51 | |
| *** florianf has joined #openstack-infra | 06:52 | |
| *** NileshSawant has joined #openstack-infra | 06:54 | |
| *** cuongnv has quit IRC | 06:54 | |
| *** gtrxcb has quit IRC | 06:54 | |
| *** cuongnv has joined #openstack-infra | 06:55 | |
| *** slaweq has quit IRC | 06:55 | |
| *** yolanda has joined #openstack-infra | 06:57 | |
| *** iyamahat__ has quit IRC | 06:59 | |
| *** iyamahat__ has joined #openstack-infra | 06:59 | |
| *** iyamahat_ has joined #openstack-infra | 07:01 | |
| *** iyamahat__ has quit IRC | 07:05 | |
| NileshSawant | Hello All, Most of the CI are failing http://52.35.51.88/23/495123/3/check/dsvm-veritas-hyperscale-cinder-driver/612bcec/console.html | 07:07 |
| NileshSawant | do we have any bug opened for this ? | 07:07 |
| *** iyamahat_ has quit IRC | 07:08 | |
| *** david-lyle has quit IRC | 07:08 | |
| *** iyamahat_ has joined #openstack-infra | 07:08 | |
| *** david-lyle has joined #openstack-infra | 07:08 | |
| *** thorst_afk has joined #openstack-infra | 07:08 | |
| *** honza_ is now known as honza | 07:09 | |
| *** jamielennox has quit IRC | 07:09 | |
| *** gus has quit IRC | 07:09 | |
| *** gus has joined #openstack-infra | 07:10 | |
| *** thorst_afk has quit IRC | 07:13 | |
| *** ralonsoh has joined #openstack-infra | 07:14 | |
| *** jamielennox has joined #openstack-infra | 07:14 | |
| *** iyamahat_ has quit IRC | 07:18 | |
| *** iyamahat has joined #openstack-infra | 07:18 | |
| *** jpich has joined #openstack-infra | 07:18 | |
| *** tesseract has joined #openstack-infra | 07:19 | |
| *** iyamahat_ has joined #openstack-infra | 07:20 | |
| *** iyamahat has quit IRC | 07:24 | |
| *** jascott1 has joined #openstack-infra | 07:25 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add gate-monasca-api-docs-ubuntu-xenial job https://review.openstack.org/498837 | 07:28 |
| openstackgerrit | Merged openstack-infra/project-config master: Remove whitespace from use-cached-repos role https://review.openstack.org/498991 | 07:29 |
| openstackgerrit | Merged openstack-infra/project-config master: Make barbican-tempest-plugin voting in barbican https://review.openstack.org/498832 | 07:30 |
| openstackgerrit | Merged openstack-infra/project-config master: Skip non-doc jobs in certain cases https://review.openstack.org/494027 | 07:31 |
| openstackgerrit | Merged openstack-infra/project-config master: Add novajoin repo for tempest tests https://review.openstack.org/496407 | 07:31 |
| openstackgerrit | Merged openstack-infra/project-config master: Add upload instructions to build-image.sh https://review.openstack.org/498689 | 07:31 |
| openstackgerrit | Merged openstack-infra/project-config master: Add test job for solum with separate tempest plugin https://review.openstack.org/498423 | 07:33 |
| *** jpena|off is now known as jpena | 07:34 | |
| *** egonzalez has joined #openstack-infra | 07:41 | |
| *** florianf has quit IRC | 07:47 | |
| *** yamamoto has quit IRC | 07:53 | |
| *** sree has joined #openstack-infra | 07:54 | |
| *** florianf has joined #openstack-infra | 07:57 | |
| *** tosky has joined #openstack-infra | 08:02 | |
| *** iyamahat__ has joined #openstack-infra | 08:08 | |
| *** thorst_afk has joined #openstack-infra | 08:09 | |
| *** yuanying_ has joined #openstack-infra | 08:10 | |
| *** iyamahat_ has quit IRC | 08:11 | |
| *** Hal has joined #openstack-infra | 08:12 | |
| *** Hal is now known as Guest66250 | 08:12 | |
| *** yuanying has quit IRC | 08:13 | |
| *** thorst_afk has quit IRC | 08:14 | |
| *** sshnaidm has quit IRC | 08:15 | |
| *** raissa has joined #openstack-infra | 08:15 | |
| *** lucas-afk is now known as lucasagomes | 08:17 | |
| *** ykarel is now known as ykarel|lunch | 08:22 | |
| *** efoley has joined #openstack-infra | 08:30 | |
| *** NileshSawant has quit IRC | 08:31 | |
| *** iyamahat__ has quit IRC | 08:34 | |
| openstackgerrit | zhurong proposed openstack-infra/project-config master: Add the missing quote in jenkins/jobs/solum.yaml https://review.openstack.org/499078 | 08:35 |
| *** yamamoto has joined #openstack-infra | 08:37 | |
| *** dingyichen has quit IRC | 08:41 | |
| *** andreas_s has joined #openstack-infra | 08:44 | |
| *** psachin has joined #openstack-infra | 08:44 | |
| *** andreas_s has quit IRC | 08:44 | |
| *** andreas_s has joined #openstack-infra | 08:45 | |
| *** andreas_s has quit IRC | 08:46 | |
| *** andreas_s has joined #openstack-infra | 08:47 | |
| *** andreas_s has quit IRC | 08:47 | |
| *** ykarel|lunch is now known as ykarel | 08:53 | |
| *** salv-orlando has quit IRC | 08:55 | |
| *** jaosorior has quit IRC | 08:55 | |
| *** salv-orlando has joined #openstack-infra | 08:57 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add the missing quote in jenkins/jobs/solum.yaml https://review.openstack.org/499078 | 08:57 |
| *** jaosorior has joined #openstack-infra | 09:00 | |
| *** sshnaidm has joined #openstack-infra | 09:06 | |
| *** andreas_s has joined #openstack-infra | 09:10 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 09:10 | |
| *** thorst_afk has joined #openstack-infra | 09:10 | |
| *** psachin has quit IRC | 09:12 | |
| *** thorst_afk has quit IRC | 09:14 | |
| *** sambetts|afk is now known as sambetts | 09:15 | |
| *** electrofelix has joined #openstack-infra | 09:23 | |
| *** dims has quit IRC | 09:28 | |
| *** quite has quit IRC | 09:30 | |
| *** quite has joined #openstack-infra | 09:37 | |
| *** hashar has quit IRC | 09:39 | |
| *** hashar has joined #openstack-infra | 09:39 | |
| *** hashar has quit IRC | 09:42 | |
| *** hashar has joined #openstack-infra | 09:44 | |
| *** alexchadin has quit IRC | 09:44 | |
| *** jpich has quit IRC | 09:45 | |
| *** yamamoto has quit IRC | 09:45 | |
| openstackgerrit | Attila Darazs proposed openstack-infra/tripleo-ci master: Use release specific repos during containers build https://review.openstack.org/498688 | 09:50 |
| *** yamamoto has joined #openstack-infra | 09:52 | |
| *** alexchadin has joined #openstack-infra | 09:56 | |
| *** sdague has joined #openstack-infra | 09:57 | |
| *** e0ne has joined #openstack-infra | 09:57 | |
| *** dims has joined #openstack-infra | 09:58 | |
| *** cuongnv has quit IRC | 09:58 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/project-config master: Remove redundant OVb jobs from TripleO https://review.openstack.org/499097 | 09:59 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/499099 | 10:05 |
| *** hashar has quit IRC | 10:07 | |
| *** priteau has joined #openstack-infra | 10:07 | |
| *** hashar has joined #openstack-infra | 10:07 | |
| *** thorst_afk has joined #openstack-infra | 10:11 | |
| *** hashar_ has joined #openstack-infra | 10:13 | |
| *** hashar has quit IRC | 10:13 | |
| *** thorst_afk has quit IRC | 10:15 | |
| *** askb has quit IRC | 10:15 | |
| *** kjackal has joined #openstack-infra | 10:16 | |
| *** salv-orlando has quit IRC | 10:17 | |
| *** salv-orlando has joined #openstack-infra | 10:18 | |
| *** alexchadin has quit IRC | 10:22 | |
| *** alexchadin has joined #openstack-infra | 10:28 | |
| *** dave-mccowan has joined #openstack-infra | 10:29 | |
| *** kjackal__ has joined #openstack-infra | 10:36 | |
| *** jkilpatr has quit IRC | 10:36 | |
| *** kjackal has quit IRC | 10:39 | |
| *** e0ne has quit IRC | 10:39 | |
| *** kjackal has joined #openstack-infra | 10:40 | |
| *** kjackal__ has quit IRC | 10:44 | |
| *** stakeda has quit IRC | 10:45 | |
| *** _mwarad_ has joined #openstack-infra | 10:46 | |
| *** mwarad has quit IRC | 10:49 | |
| *** sshnaidm is now known as sshnaidm|afk | 10:51 | |
| *** zhurong has quit IRC | 10:52 | |
| *** kjackal has quit IRC | 10:57 | |
| fungi | infra-root: project-config-core: reminder, pike release activity is underway now so let's try to keep anything in the ci which could remotely impact that on hold until later... thanks! | 11:00 |
| *** yongwc has joined #openstack-infra | 11:01 | |
| yongwc | hello, I setup a CI for cinder gate test locally, however, when test finish, there is a process called ara create so many little files, how can i avoid the generate of ara logs, anybody can help me? | 11:03 |
| *** kjackal has joined #openstack-infra | 11:05 | |
| *** liujiong has quit IRC | 11:09 | |
| *** jkilpatr has joined #openstack-infra | 11:09 | |
| *** thorst_afk has joined #openstack-infra | 11:12 | |
| fungi | dmsimard: ^ you probably know the answer to yongwc's question if you're already awake (i'm trying to keep an eye on release jobs right this moment so don't have time to dig up the config option for that) | 11:15 |
| *** lucasagomes is now known as lucas-hungry | 11:16 | |
| *** thorst_afk has quit IRC | 11:16 | |
| *** kjackal__ has joined #openstack-infra | 11:17 | |
| *** kjackal has quit IRC | 11:18 | |
| *** pbourke has quit IRC | 11:20 | |
| *** iyamahat has joined #openstack-infra | 11:21 | |
| *** pbourke has joined #openstack-infra | 11:22 | |
| *** iyamahat has quit IRC | 11:22 | |
| *** iyamahat has joined #openstack-infra | 11:23 | |
| *** mat128 has joined #openstack-infra | 11:26 | |
| *** hashar_ is now known as hashar | 11:36 | |
| *** yamahata has quit IRC | 11:37 | |
| dmsimard | yongwc: ara provides a report of the ansible tasks that ran, the files are a statically generated version of that report | 11:37 |
| *** iyamahat has quit IRC | 11:38 | |
| dmsimard | I guess there is no toggle to deactivate it if you're not interested in it right now, the easiest would be to delete the directory if you don't care about it. | 11:39 |
| yongwc | dmsimard: thanks a lot. I know that, but that procedure consume so may time, and only one process do that. | 11:40 |
| yongwc | it too slow, than I want to turn it off if I can. | 11:41 |
| *** wolverineav has joined #openstack-infra | 11:41 | |
| dmsimard | yongwc: how slow is it ? It takes less than 5 seconds for a very large playbook, and devstack-gate is a small playbook | 11:42 |
| dmsimard | Oh, are you running the same test more than once on the same machine ? | 11:43 |
| fungi | a lot of third-party ci deployments reuse the same test nodes over and over instead of doing something along teh lines of nodepool to assign fresh single-use nodes on each job run | 11:44 |
| yongwc | dmsimard: yes, I do the test on the same machine as I'm not family with the nodepool tech. | 11:44 |
| fungi | and presumably they've just figured out how to deal with recovering their ci systems from testing broken changes that destroy their test nodes | 11:45 |
| *** dprince has joined #openstack-infra | 11:45 | |
| fungi | maybe whatever the clean step is needs to remove that tree | 11:45 |
| dmsimard | yongwc: ok, a workaround would be to delete the file ~/.ara/ansible.sqlite after every run | 11:46 |
| dmsimard | The problem is that you end up with many runs inside the database | 11:46 |
| dmsimard | So it takes longer to generate | 11:46 |
| dmsimard | I'll send a patch to implement a toggle to disable ara so that you can disable it if you're not interested. | 11:48 |
| *** dtantsur|afk is now known as dtantsur | 11:48 | |
| *** coolsvap has joined #openstack-infra | 11:50 | |
| yongwc | dmsimard: maybe I should first clean the ansible.sqlite first, now that file in my machine is so large. | 11:50 |
| yongwc | dmsimard: Thanks a million | 11:51 |
| *** pgadiya has quit IRC | 11:54 | |
| *** thorst_afk has joined #openstack-infra | 11:56 | |
| *** psachin has joined #openstack-infra | 11:56 | |
| *** mat128 has quit IRC | 11:57 | |
| *** sshnaidm|afk is now known as sshnaidm | 11:57 | |
| *** e0ne has joined #openstack-infra | 11:58 | |
| *** kjackal__ has quit IRC | 11:58 | |
| *** kjackal has joined #openstack-infra | 11:59 | |
| *** jpena is now known as jpena|lunch | 12:02 | |
| *** yongwc has quit IRC | 12:04 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Clean up stable/pike-specific ACLs https://review.openstack.org/499122 | 12:05 |
| ttx | err | 12:06 |
| pabelanger | fungi: ++ | 12:06 |
| *** kjackal has quit IRC | 12:07 | |
| *** e0ne has quit IRC | 12:07 | |
| *** hashar has quit IRC | 12:07 | |
| *** priteau has quit IRC | 12:07 | |
| *** egonzalez has quit IRC | 12:07 | |
| *** ykarel has quit IRC | 12:07 | |
| *** olaph has quit IRC | 12:07 | |
| *** ianychoi has quit IRC | 12:07 | |
| *** niska has quit IRC | 12:07 | |
| *** Shrews has quit IRC | 12:07 | |
| *** lennyb has quit IRC | 12:07 | |
| *** arturb has quit IRC | 12:07 | |
| *** jbernard has quit IRC | 12:07 | |
| *** lifeless has quit IRC | 12:07 | |
| *** AJaeger has quit IRC | 12:07 | |
| *** Qiming has quit IRC | 12:07 | |
| *** Jeffrey4l has quit IRC | 12:07 | |
| *** logan- has quit IRC | 12:07 | |
| *** filler has quit IRC | 12:07 | |
| *** jeblair has quit IRC | 12:07 | |
| *** hamzy has quit IRC | 12:07 | |
| *** dpawlik has quit IRC | 12:07 | |
| *** dasanind has quit IRC | 12:07 | |
| *** deduped has quit IRC | 12:07 | |
| *** liusheng has quit IRC | 12:07 | |
| *** beisner has quit IRC | 12:07 | |
| *** kmARC has quit IRC | 12:07 | |
| *** admcleod has quit IRC | 12:07 | |
| *** fdegir has quit IRC | 12:07 | |
| *** mrhillsman has quit IRC | 12:07 | |
| *** sweston has quit IRC | 12:07 | |
| *** rguillebert has quit IRC | 12:07 | |
| *** jbryce has quit IRC | 12:07 | |
| *** amotoki has quit IRC | 12:07 | |
| *** ianychoi_ has joined #openstack-infra | 12:07 | |
| *** jeblair_ has joined #openstack-infra | 12:07 | |
| *** trown|outtypewww is now known as trown | 12:07 | |
| *** admcleod has joined #openstack-infra | 12:07 | |
| *** liusheng has joined #openstack-infra | 12:07 | |
| *** Jeffrey4l has joined #openstack-infra | 12:07 | |
| *** ykarel has joined #openstack-infra | 12:07 | |
| *** psachin has quit IRC | 12:07 | |
| *** egonzalez has joined #openstack-infra | 12:07 | |
| *** hamzy has joined #openstack-infra | 12:07 | |
| *** e0ne has joined #openstack-infra | 12:08 | |
| fungi | infra-root: project-config-core: release activity is over. reviews of 499122 appreciated but otherwise the flood gates are open again | 12:08 |
| *** rtjure has quit IRC | 12:09 | |
| *** mrodden has quit IRC | 12:09 | |
| *** niska has joined #openstack-infra | 12:09 | |
| *** bytekitten has quit IRC | 12:09 | |
| *** lucas-hungry is now known as lucasagomes | 12:10 | |
| *** Qiming has joined #openstack-infra | 12:10 | |
| *** filler has joined #openstack-infra | 12:11 | |
| *** amotoki has joined #openstack-infra | 12:11 | |
| *** tesseract has quit IRC | 12:11 | |
| *** biancat has joined #openstack-infra | 12:11 | |
| *** rtjure has joined #openstack-infra | 12:12 | |
| *** mrodden has joined #openstack-infra | 12:12 | |
| *** ldnunes has joined #openstack-infra | 12:12 | |
| *** jpich has joined #openstack-infra | 12:14 | |
| *** rhallisey has joined #openstack-infra | 12:16 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/project-config master: Clean up stable/pike-specific ACLs https://review.openstack.org/499122 | 12:17 |
| *** eharney has quit IRC | 12:18 | |
| *** petevg_ has joined #openstack-infra | 12:19 | |
| *** petevg_ is now known as petevg | 12:19 | |
| *** mat128 has joined #openstack-infra | 12:20 | |
| *** jcoufal has joined #openstack-infra | 12:20 | |
| *** mwarad has joined #openstack-infra | 12:20 | |
| *** hashar has joined #openstack-infra | 12:20 | |
| *** mat128 has quit IRC | 12:21 | |
| *** dougshelley66 has joined #openstack-infra | 12:22 | |
| *** lifeless_ has joined #openstack-infra | 12:22 | |
| *** kjackal has joined #openstack-infra | 12:22 | |
| *** priteau has joined #openstack-infra | 12:22 | |
| *** olaph has joined #openstack-infra | 12:22 | |
| *** Shrews has joined #openstack-infra | 12:22 | |
| *** lennyb has joined #openstack-infra | 12:22 | |
| *** arturb has joined #openstack-infra | 12:22 | |
| *** jbernard has joined #openstack-infra | 12:22 | |
| *** AJaeger has joined #openstack-infra | 12:22 | |
| *** logan- has joined #openstack-infra | 12:22 | |
| *** dpawlik has joined #openstack-infra | 12:22 | |
| *** dasanind has joined #openstack-infra | 12:22 | |
| *** beisner has joined #openstack-infra | 12:22 | |
| *** kmARC has joined #openstack-infra | 12:22 | |
| *** fdegir has joined #openstack-infra | 12:22 | |
| *** mrhillsman has joined #openstack-infra | 12:22 | |
| *** sweston has joined #openstack-infra | 12:22 | |
| *** rguillebert has joined #openstack-infra | 12:22 | |
| *** jbryce has joined #openstack-infra | 12:22 | |
| *** _mwarad_ has quit IRC | 12:22 | |
| *** mat128 has joined #openstack-infra | 12:22 | |
| *** mrodden has quit IRC | 12:24 | |
| *** mrodden has joined #openstack-infra | 12:24 | |
| *** biancat has quit IRC | 12:25 | |
| *** salv-orlando has quit IRC | 12:25 | |
| *** amotoki has quit IRC | 12:25 | |
| *** biancat has joined #openstack-infra | 12:26 | |
| *** tesseract has joined #openstack-infra | 12:26 | |
| *** amotoki has joined #openstack-infra | 12:27 | |
| *** rlandy has joined #openstack-infra | 12:31 | |
| *** e0ne has quit IRC | 12:31 | |
| *** dprince has quit IRC | 12:31 | |
| *** e0ne has joined #openstack-infra | 12:32 | |
| *** dprince has joined #openstack-infra | 12:33 | |
| mordred | dmsimard: yah - I think a disable-ara patch for current d-g sounds like a good idea | 12:35 |
| *** slaweq has joined #openstack-infra | 12:41 | |
| *** abelur_ has quit IRC | 12:43 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Don't use docker-network.yaml env https://review.openstack.org/497720 | 12:43 |
| *** jascott1 has quit IRC | 12:44 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Use local cirros image for tempest tests https://review.openstack.org/498315 | 12:44 |
| *** kgiusti has joined #openstack-infra | 12:48 | |
| *** LindaWang has quit IRC | 12:49 | |
| *** jamesmcarthur has joined #openstack-infra | 12:53 | |
| *** mat128 has quit IRC | 12:59 | |
| *** links has quit IRC | 13:00 | |
| *** mat128 has joined #openstack-infra | 13:01 | |
| *** piuge has joined #openstack-infra | 13:04 | |
| *** gcb has quit IRC | 13:06 | |
| *** jpena|lunch is now known as jpena | 13:06 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add comment to top of zuul.yaml pointing to other files https://review.openstack.org/499142 | 13:07 |
| *** skelso has joined #openstack-infra | 13:07 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add comment to top of zuul.yaml pointing to other files https://review.openstack.org/499143 | 13:10 |
| *** esberglu has joined #openstack-infra | 13:10 | |
| *** kjackal has quit IRC | 13:11 | |
| *** andreas_s has quit IRC | 13:11 | |
| *** srobert has joined #openstack-infra | 13:15 | |
| *** mat128 has quit IRC | 13:15 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add comment to top of zuul.yaml pointing to other files https://review.openstack.org/499147 | 13:16 |
| *** mat128 has joined #openstack-infra | 13:18 | |
| openstackgerrit | Merged openstack-infra/project-config master: Clean up stable/pike-specific ACLs https://review.openstack.org/499122 | 13:19 |
| *** gouthamr has joined #openstack-infra | 13:19 | |
| *** Goneri has joined #openstack-infra | 13:23 | |
| *** eharney has joined #openstack-infra | 13:24 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add openstack-python-jobs and openstack-python35-jobs https://review.openstack.org/499150 | 13:25 |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add openstack-python-jobs and openstack-python35-jobs https://review.openstack.org/499150 | 13:26 |
| mordred | fungi: +2 | 13:27 |
| openstackgerrit | Merged openstack-infra/shade master: Support domain_id for user operations https://review.openstack.org/497483 | 13:27 |
| openstackgerrit | Merged openstack-infra/shade master: Add domain_id to groups https://review.openstack.org/497537 | 13:28 |
| mordred | fungi, pabelanger: https://review.openstack.org/#/c/498623 and https://review.openstack.org/#/c/499150 would be helpful, as would https://review.openstack.org/#/c/498914/ | 13:29 |
| mordred | fungi, pabelanger: also, https://review.openstack.org/499142 https://review.openstack.org/499143 and https://review.openstack.org/499147 are trivial/easy | 13:29 |
| *** Guest66250 has quit IRC | 13:30 | |
| *** baoli has joined #openstack-infra | 13:32 | |
| *** Hal has joined #openstack-infra | 13:34 | |
| *** Hal is now known as Guest63550 | 13:34 | |
| *** mwarad has quit IRC | 13:37 | |
| *** annegentle has joined #openstack-infra | 13:38 | |
| *** lbragstad has joined #openstack-infra | 13:44 | |
| *** camunoz has joined #openstack-infra | 13:44 | |
| *** jamesmcarthur has quit IRC | 13:49 | |
| *** trown is now known as trown|brb | 13:54 | |
| *** dhajare has quit IRC | 13:56 | |
| *** wolverineav has quit IRC | 13:56 | |
| *** wolverineav has joined #openstack-infra | 13:56 | |
| *** wolverineav has quit IRC | 13:57 | |
| *** wolverineav has joined #openstack-infra | 13:57 | |
| *** trown|brb is now known as trown | 13:59 | |
| *** LindaWang has joined #openstack-infra | 13:59 | |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups master: Upgrade views to 3.18 https://review.openstack.org/499159 | 14:00 |
| *** salv-orlando has joined #openstack-infra | 14:01 | |
| *** marst has joined #openstack-infra | 14:02 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add release-announce job and publish-to-pypi template https://review.openstack.org/498623 | 14:03 |
| *** alexchadin has quit IRC | 14:05 | |
| *** links has joined #openstack-infra | 14:05 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add comment to top of zuul.yaml pointing to other files https://review.openstack.org/499147 | 14:05 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add openstack-python-jobs and openstack-python35-jobs https://review.openstack.org/499150 | 14:05 |
| *** deduped has joined #openstack-infra | 14:06 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add comment to top of zuul.yaml pointing to other files https://review.openstack.org/499143 | 14:06 |
| *** links has quit IRC | 14:06 | |
| *** pcaruana has quit IRC | 14:06 | |
| *** mriedem has joined #openstack-infra | 14:07 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix errors in mirro-workspace-git-repos https://review.openstack.org/498997 | 14:08 |
| openstackgerrit | Merged openstack-infra/groups master: Upgrade views to 3.18 https://review.openstack.org/499159 | 14:09 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Create zuul_executor_dest variable for fetch-sphinx-output https://review.openstack.org/498624 | 14:11 |
| *** hongbin has joined #openstack-infra | 14:13 | |
| *** eharney_ has joined #openstack-infra | 14:13 | |
| *** eharney has quit IRC | 14:13 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Revert "Add comment to top of zuul.yaml pointing to other files" https://review.openstack.org/499165 | 14:13 |
| *** eharney_ is now known as eharney | 14:14 | |
| *** rbrndt has joined #openstack-infra | 14:14 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add comment to top of zuul.yaml pointing to other files https://review.openstack.org/499142 | 14:14 |
| *** armax has joined #openstack-infra | 14:14 | |
| *** jeblair_ is now known as jeblair | 14:17 | |
| openstackgerrit | Merged openstack-infra/puppet-openstackid master: Install Laravel schedule https://review.openstack.org/493275 | 14:21 |
| openstackgerrit | Merged openstack-infra/project-config master: Add bindep_command and bindep_fallback to site-variables https://review.openstack.org/498914 | 14:22 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add a role to remove an ssh private key https://review.openstack.org/498530 | 14:23 |
| *** sshnaidm_ has joined #openstack-infra | 14:29 | |
| openstackgerrit | Eric Fried proposed openstack-infra/project-config master: Add stable branches to nova patchbot reporting https://review.openstack.org/499167 | 14:29 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Delete .pypirc file at end of task https://review.openstack.org/498843 | 14:29 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Move .pypirc into tmpfs https://review.openstack.org/498844 | 14:30 |
| *** sekelso has joined #openstack-infra | 14:30 | |
| *** sshnaidm has quit IRC | 14:30 | |
| jeblair | mordred, fungi, pabelanger: https://review.openstack.org/498995 would help on the devstack-gate front | 14:31 |
| *** skelso has quit IRC | 14:31 | |
| *** olaph1 has joined #openstack-infra | 14:31 | |
| *** olaph has quit IRC | 14:32 | |
| mriedem | gantt has been dead since 2015 at least, but still shows up in infra files, like https://review.openstack.org/#/c/499167/1/gerritbot/channels.yaml - how much scrubbing should i care about doing for stuff like that? | 14:33 |
| *** sree has quit IRC | 14:34 | |
| jeblair | mriedem: i don't think any other person or process will catch that, so i think cleanup like that is welcome. | 14:35 |
| openstackgerrit | Merged openstack-infra/project-config master: Normalize projects.yaml https://review.openstack.org/499099 | 14:36 |
| AJaeger | mriedem: it still exits completely in our infrastructure - the retireiment process is documented at https://docs.openstack.org/infra/manual/drivers.html#retiring-a-project - if you can do this for gantt, would be great! | 14:37 |
| mriedem | ok | 14:37 |
| clarkb | NileshSawant is gone but if they return the cause of that is us unpinning paramiko. This works for us because we get the paramiko wheel from pypi. I'm guessing NileshSawant's job nodes are reused and have cached up some pip caches of non wheels? Anyways you will want to look at why you aren't getting the wheel from pypi | 14:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Partially Revert "Add comment to top of zuul.yaml pointing to other files" https://review.openstack.org/499165 | 14:39 |
| *** ykarel has quit IRC | 14:40 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Add the stable/pike for Packstack's gerritbot notifications https://review.openstack.org/499175 | 14:41 |
| *** Guest63550 has quit IRC | 14:45 | |
| *** annegentle has quit IRC | 14:48 | |
| AJaeger | efried: not sure whether we support "stable/*" in gerritbot - if we do, might be a nice idea to use this. | 14:48 |
| *** wolverineav has quit IRC | 14:49 | |
| efried | AJaeger Agree | 14:49 |
| efried | AJaeger Would take me a while to figger that out... | 14:49 |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups master: Upgrade entity reference to 1.5 https://review.openstack.org/499178 | 14:49 |
| *** wolverineav has joined #openstack-infra | 14:50 | |
| AJaeger | efried: perhaps somebody here knows what gerritbot handles... | 14:51 |
| efried | That would surely be easier than what I was planning :) | 14:52 |
| mgagne | AJaeger: can't find evidence of support for regex with branches in source: https://github.com/openstack-infra/gerritbot/blob/master/gerritbot/bot.py | 14:52 |
| openstackgerrit | Eric Fried proposed openstack-infra/project-config master: Update patchbot stable branches https://review.openstack.org/499181 | 14:52 |
| pabelanger | clarkb: since pinning DNS in infracloud-vanilla to a buildslogs.centos .US server, I haven't seen a job failure in that region. So, rotating DNS to .eu is likely the reason for all our troubles | 14:52 |
| efried | There's one that updates everybody to n/o/p | 14:53 |
| efried | it'll conflict with the one gibi mentioned in -nova... | 14:53 |
| mgagne | I sure would appreciate such feature though =) | 14:53 |
| efried | Oh; I guess we can't just wholesale assume <=mitaka is EOL. | 14:55 |
| *** slaweq has quit IRC | 14:55 | |
| *** slaweq has joined #openstack-infra | 14:55 | |
| openstackgerrit | Merged openstack-infra/project-config master: Fix errors in use-cache-repos https://review.openstack.org/498995 | 14:56 |
| openstackgerrit | Eric Fried proposed openstack-infra/project-config master: Update patchbot stable branches https://review.openstack.org/499181 | 14:56 |
| *** rama_y has joined #openstack-infra | 14:56 | |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: Update URIs linked in TripleO-CI documentation https://review.openstack.org/489636 | 14:56 |
| openstackgerrit | Jose Luis Franco proposed openstack-infra/tripleo-ci master: WIP: Disable properly services api_cfn and api_cloudwatch. https://review.openstack.org/499182 | 14:56 |
| *** baoli has quit IRC | 14:59 | |
| *** slaweq has quit IRC | 15:00 | |
| *** baoli has joined #openstack-infra | 15:00 | |
| *** baoli has quit IRC | 15:00 | |
| *** ykarel has joined #openstack-infra | 15:00 | |
| *** eharney has quit IRC | 15:01 | |
| clarkb | pabelanger: thats good. Maybe we can dial back some of the changes we made to try and address the problems there? | 15:02 |
| *** annegentle has joined #openstack-infra | 15:02 | |
| clarkb | pabelanger: specifically thinking it might be good to be able to reuse connections for longer (as it will cut down on number of new connections to backends that need to be made) | 15:03 |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Use release specific repos during containers build https://review.openstack.org/498688 | 15:03 |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci master: In-tree ovs_vxlan_bridge function from devstack-gate https://review.openstack.org/498985 | 15:04 |
| pabelanger | clarkb: ya, I think that is a good idea also | 15:04 |
| openstackgerrit | Merged openstack-infra/groups master: Upgrade entity reference to 1.5 https://review.openstack.org/499178 | 15:05 |
| *** jcoufal has quit IRC | 15:06 | |
| *** rcernin has quit IRC | 15:09 | |
| *** thegreenhundred has joined #openstack-infra | 15:09 | |
| *** ijw has joined #openstack-infra | 15:09 | |
| *** baoli has joined #openstack-infra | 15:10 | |
| clarkb | pabelanger: EmilienM now with the tripleo fires under control, it might be good to do a quick audit and make sure that tripleo isn't doing other things that aren't necessary. In particular the git clones should maybe be looked at? | 15:11 |
| clarkb | just thinking we had multiple cases of redundant/unnecessary steps that were causing failures. Would be good to double check we don't have others | 15:12 |
| rama_y | Hi clarkb, tonyb, jlvillal, morning! posted the patch update: https://review.openstack.org/#/c/492231/ | 15:12 |
| clarkb | rama_y: thank! I will take a look | 15:12 |
| *** sai is now known as sai-mtg | 15:13 | |
| EmilienM | clarkb: right now isn't a good time for me, we're still working on releasing pike rc2 | 15:13 |
| EmilienM | clarkb: and I spend most of my time trying to get patches merged and reviewed on time before the deadline | 15:13 |
| EmilienM | clarkb: the audit thing should be done imho, but maybe by someone else in the team | 15:13 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Remove github projects https://review.openstack.org/499188 | 15:14 |
| jeblair | mordred: ^ | 15:14 |
| efried | clarkb Looks like you may have written the chunk of the patchbot that I'm digging into... | 15:14 |
| rama_y | Thanks clarkb! | 15:14 |
| *** eharney has joined #openstack-infra | 15:15 | |
| clarkb | rama_y: I think there is actualyl a small problem here... We apply the grenade options before we apply the devstack-virtual-ironic options | 15:15 |
| clarkb | rama_y: so that TLSPROXY=0 will be overwritten later if the branch is newer | 15:15 |
| pabelanger | clarkb: EmilienM: Ya, audit on my list to do. I can only thing they are used by dlrn, but might be possible tripleo already handles that part also | 15:15 |
| rama_y | clarkb, Oh I see | 15:15 |
| *** jcoufal has joined #openstack-infra | 15:15 | |
| clarkb | rama_y: I think we might need to drop the TLSPROXY=0 and make the devstack-virtual-ironic check stronger | 15:15 |
| clarkb | but I'm not sure what that check should be off the top of my head | 15:15 |
| rama_y | ok | 15:16 |
| openstackgerrit | Ben Nemec proposed openstack-infra/project-config master: Add py35 job to tripleo-validations https://review.openstack.org/499189 | 15:16 |
| *** weshay is now known as weshay_interview | 15:17 | |
| clarkb | rama_y: looks like we set DEVSTACK_GATE_GRENADE in the grenade options so I think you want if [ -z "$DEVSTACK_GATE_GRENADE] && [ ! stable branches =~ $BRANCH ] ; then | 15:17 |
| rama_y | clarkb, did the ordering of the jobs change? | 15:18 |
| rama_y | To have grenade first? | 15:18 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Only add changes to status page with jobs https://review.openstack.org/499191 | 15:18 |
| clarkb | rama_y: no its there if you search for grenade you will see those builders come before the devstack-virtual-ironic builder in the jobs | 15:18 |
| hongbin | hi, i wonder how to configure LB to have the Series and milestones, right now, we have only "truck", i saw other projects has pike, queens, etc. | 15:18 |
| *** slaweq has joined #openstack-infra | 15:19 | |
| clarkb | rama_y: I'm leaving a comment, should be posteod shortly | 15:20 |
| rama_y | clarkb, thanks | 15:20 |
| clarkb | rama_y: it is posted | 15:20 |
| clarkb | efried: gerritbot you mean? ya I did a bunch of the event mapping to sets of channels stuff | 15:21 |
| clarkb | years ago | 15:21 |
| efried | clarkb So what I'm working up is wildcard support for project and branch names | 15:21 |
| clarkb | you could probably add the wildcard string to the set then do a regex match rather than string comparison? | 15:22 |
| clarkb | (its been forever since I last looked at the code) | 15:22 |
| *** gmann has quit IRC | 15:22 | |
| clarkb | rama_y: oh wait | 15:22 |
| efried | So in the yaml you can e.g. under projects say openstack/fuel-*; or under branches you can say stable/* | 15:22 |
| clarkb | rama_y: you know I am probably completely wrong because we sourec at the end | 15:22 |
| *** gmann has joined #openstack-infra | 15:22 | |
| clarkb | these ironic jobs are really complicated... | 15:23 |
| *** rama_y_ has joined #openstack-infra | 15:23 | |
| efried | And yeah, I could do straight up regex, except existing data has some regexy metachars in there. That's *probably* okay, tbh. | 15:23 |
| *** baoli has quit IRC | 15:23 | |
| clarkb | rama_y: I think you can ignore my comment | 15:23 |
| clarkb | rama_y: I will reply to myself | 15:23 |
| *** slaweq has quit IRC | 15:23 | |
| *** baoli has joined #openstack-infra | 15:24 | |
| efried | clarkb Any tips on how to test this prior to throwing it over the fence would be much appreciated :) | 15:25 |
| *** baoli has quit IRC | 15:25 | |
| clarkb | efried: you can run it locally (anyone can stream gerrit events) and just have it connect to a test channel on freenode like #efried-test-gerritbot | 15:25 |
| *** baoli has joined #openstack-infra | 15:26 | |
| efried | clarkb You make it sound so simple... Will play, thanks! | 15:26 |
| *** rama_y has quit IRC | 15:26 | |
| *** olaph has joined #openstack-infra | 15:26 | |
| *** udesale__ has quit IRC | 15:26 | |
| *** olaph1 has quit IRC | 15:27 | |
| rama_y_ | Hi clarkb, thanks. "source ironic-extra-vars" will set it back to zero for grenade. | 15:31 |
| clarkb | rama_y_: yup I finally realized that and updated my review | 15:31 |
| clarkb | rama_y_: so your change is fine as is | 15:31 |
| rama_y_ | Yes, thanks clarkb | 15:32 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/reviewstats master: Update projects for nova https://review.openstack.org/499197 | 15:33 |
| *** felipemonteiro has joined #openstack-infra | 15:37 | |
| *** Hal has joined #openstack-infra | 15:38 | |
| *** felipemonteiro_ has joined #openstack-infra | 15:38 | |
| *** Hal is now known as Guest15021 | 15:38 | |
| *** sekelso has quit IRC | 15:39 | |
| *** salv-orlando has quit IRC | 15:41 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Added more debug logging for github requests https://review.openstack.org/499207 | 15:41 |
| *** felipemonteiro has quit IRC | 15:41 | |
| *** sekelso has joined #openstack-infra | 15:42 | |
| *** salv-orlando has joined #openstack-infra | 15:42 | |
| *** felipemonteiro_ has quit IRC | 15:44 | |
| *** thegreenhundred has quit IRC | 15:48 | |
| *** manjaroi3 has joined #openstack-infra | 15:48 | |
| *** rama_y_ has quit IRC | 15:49 | |
| *** jamesmcarthur has joined #openstack-infra | 15:49 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add afsdocs_secret secret for publishing https://review.openstack.org/498267 | 15:50 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Add publish-openstack-python-docs jobs https://review.openstack.org/498621 | 15:50 |
| *** iyamahat has joined #openstack-infra | 15:50 | |
| *** strigazi is now known as strigazi_AFK | 15:50 | |
| clarkb | andreaf: mtreinish: dhellmann: do you know if someone has pushed out periodic bit rot jobs for pike yet? | 15:50 |
| *** sekelso has quit IRC | 15:50 | |
| AJaeger | clarkb: dhellmann did - see I769cb4ca0a53d2916debfea3335321d59263b668 | 15:51 |
| AJaeger | clarkb: best to double check it covers all projects, some might not have been ready when that merged | 15:51 |
| *** yamahata has joined #openstack-infra | 15:52 | |
| clarkb | AJaeger: would you be willign to review https://review.openstack.org/#/c/492231/ ? | 15:52 |
| clarkb | AJaeger: we probably want to double check dtantsur is ok with that? | 15:52 |
| AJaeger | clarkb: yes, this needs dtantsur's review first | 15:52 |
| *** HeOS has quit IRC | 15:53 | |
| *** gouthamr has quit IRC | 15:53 | |
| *** pcaruana has joined #openstack-infra | 15:54 | |
| AJaeger | clarkb: I won't have time to review before Monday - will travel... | 15:54 |
| *** sree has joined #openstack-infra | 15:54 | |
| clarkb | AJaeger: no problem | 15:55 |
| *** manjaroi3 has quit IRC | 15:56 | |
| *** Rockyg has joined #openstack-infra | 15:56 | |
| *** thegreenhundred has joined #openstack-infra | 15:56 | |
| * dtantsur checks | 15:57 | |
| *** thegreenhundred has quit IRC | 15:58 | |
| *** thegreenhundred has joined #openstack-infra | 15:58 | |
| dtantsur | clarkb: I have to admin, I'm confused by the change.. it seems to always set "export DEVSTACK_GATE_TLSPROXY=0" | 15:59 |
| *** vhosakot has joined #openstack-infra | 16:00 | |
| dtantsur | ah, wait, right. this is expected :) | 16:00 |
| *** Guest15021 has quit IRC | 16:00 | |
| *** jascott1 has joined #openstack-infra | 16:00 | |
| *** camunoz has quit IRC | 16:01 | |
| dtantsur | jlvillal, mind checking https://review.openstack.org/#/c/492231/ again? | 16:02 |
| jlvillal | dtantsur: looking | 16:03 |
| *** sshnaidm_ is now known as sshnaidm | 16:03 | |
| *** lucasagomes is now known as lucas-afk | 16:03 | |
| *** weshay_interview is now known as weshay | 16:03 | |
| jlvillal | dtantsur, clarkb : +1 | 16:04 |
| *** esberglu has quit IRC | 16:04 | |
| jlvillal | dtantsur: I tried to review: https://review.openstack.org/#/c/495443/ But I'll admit that I don't completely understand your code and therefore the change to it confuses me. | 16:05 |
| *** esberglu has joined #openstack-infra | 16:05 | |
| * jlvillal notices wrong channel for that discussion | 16:06 | |
| *** esberglu has quit IRC | 16:06 | |
| *** salv-orlando has quit IRC | 16:08 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Added more debug logging for github requests https://review.openstack.org/499207 | 16:12 |
| *** Hal has joined #openstack-infra | 16:13 | |
| *** Hal is now known as Guest66397 | 16:13 | |
| *** gouthamr has joined #openstack-infra | 16:16 | |
| *** LindaWang has quit IRC | 16:17 | |
| clarkb | dtantsur: its always setting it for grenade since we can't really do it until both old and new branches support it | 16:18 |
| clarkb | dtantsur: but should set it on >= master for non grenade jobs | 16:18 |
| *** esberglu has joined #openstack-infra | 16:18 | |
| dtantsur | yeah, thanks, I think I've got it | 16:18 |
| openstackgerrit | Matt Riedemann proposed openstack-infra/reviewstats master: Add the ability to get reviewer stats across all stable branches https://review.openstack.org/499219 | 16:19 |
| mriedem | tonyb: ^ | 16:19 |
| *** iyamahat has quit IRC | 16:19 | |
| *** iyamahat has joined #openstack-infra | 16:19 | |
| *** iyamahat has quit IRC | 16:21 | |
| *** iyamahat has joined #openstack-infra | 16:21 | |
| *** piuge has left #openstack-infra | 16:22 | |
| *** iyamahat has quit IRC | 16:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Try getting project branches authenticated https://review.openstack.org/499222 | 16:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Cache branches for a project and use it on rate limit errors https://review.openstack.org/499223 | 16:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Keep a cache of branches for projects and update on events https://review.openstack.org/499224 | 16:23 |
| *** iyamahat has joined #openstack-infra | 16:23 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Cache branches for a project and use it on rate limit errors https://review.openstack.org/499223 | 16:25 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Try getting project branches authenticated https://review.openstack.org/499222 | 16:25 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Keep a cache of branches for projects and update on events https://review.openstack.org/499224 | 16:25 |
| *** sshnaidm has quit IRC | 16:26 | |
| *** camunoz has joined #openstack-infra | 16:27 | |
| *** dtantsur is now known as dtantsur|afk | 16:28 | |
| *** Apoorva has joined #openstack-infra | 16:31 | |
| mgagne | so I'm trying to add tests to gerritbot because why not. I'm hitting a classic problem with pbr but don't know how to fix it (and why it happens): http://paste.openstack.org/show/619918/ | 16:31 |
| mgagne | changes I made so far: https://github.com/mgagne/gerritbot/tree/tests | 16:32 |
| *** markvoelker has joined #openstack-infra | 16:32 | |
| mgagne | argh, going for lunch, will check later =) | 16:32 |
| *** tesseract has quit IRC | 16:33 | |
| *** trown is now known as trown|lunch | 16:33 | |
| *** ramishra has quit IRC | 16:35 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/reviewstats master: Adds tox docs job https://review.openstack.org/470642 | 16:38 |
| *** HeOS has joined #openstack-infra | 16:40 | |
| *** bobh has joined #openstack-infra | 16:41 | |
| *** rama_y has joined #openstack-infra | 16:41 | |
| *** rama_y_ has joined #openstack-infra | 16:42 | |
| *** rama_y has quit IRC | 16:42 | |
| clarkb | mgagne: I would check the project name matches in both cases | 16:43 |
| *** Guest66397 has quit IRC | 16:44 | |
| *** egonzalez has quit IRC | 16:45 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Cache branches for a project and use it on rate limit errors https://review.openstack.org/499223 | 16:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Try getting project branches authenticated https://review.openstack.org/499222 | 16:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Added more debug logging for github requests https://review.openstack.org/499207 | 16:48 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Keep a cache of branches for projects and update on events https://review.openstack.org/499224 | 16:48 |
| *** jamesmcarthur has quit IRC | 16:49 | |
| *** iyamahat has quit IRC | 16:49 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/tripleo-ci master: In-tree ovs_vxlan_bridge function from devstack-gate https://review.openstack.org/498985 | 16:50 |
| fungi | mgagne: interestingly, i can't reproduce that error on gerritbot master branch tip running `tox -e venv python setup.py sdist` | 16:57 |
| fungi | can you? | 16:58 |
| mgagne | fungi: same error | 17:00 |
| fungi | mgagne: try using tox -re instead of -e? | 17:00 |
| fungi | maybe you have something crufty in an old tox venv | 17:01 |
| mgagne | same with -re | 17:01 |
| mgagne | I also did git clean -fdx . | 17:01 |
| mgagne | pip freeze --all http://paste.openstack.org/show/619922/ | 17:01 |
| fungi | bizarre. judging from your file paths i guess it's mac osx/darwin? | 17:02 |
| *** ralonsoh has quit IRC | 17:02 | |
| mgagne | you know me =) | 17:02 |
| *** hashar is now known as hasharAway | 17:02 | |
| fungi | possible something is weird with setuptools or package resources in the base system there | 17:02 |
| mgagne | it works fine when exporting PBR_VERSION and adding passenv to tox.ini | 17:02 |
| *** aeng has joined #openstack-infra | 17:02 | |
| fungi | using relatively recent tox and virtualenv releases? | 17:03 |
| *** strigazi_AFK is now known as strigazi | 17:03 | |
| mgagne | tox 2.7.0 and virtualenv 15.1.0 | 17:03 |
| *** jamesmcarthur has joined #openstack-infra | 17:03 | |
| fungi | skimming the tox.ini, the only thing i see out of the ordinary is -r{toxinidir}/requirements.txt (pbr shuold already be putting those in install_requires anyway) | 17:04 |
| mgagne | I can try to track it down in pbr I guess | 17:04 |
| fungi | i guess `tox -e pep8` is also failing for you the same way | 17:04 |
| mgagne | I guess I followed bad example =) https://github.com/openstack-infra/gear/blob/master/tox.ini#L10-L11 | 17:04 |
| *** e0ne has quit IRC | 17:05 | |
| *** bramleya has joined #openstack-infra | 17:05 | |
| *** jamesmcarthur has quit IRC | 17:05 | |
| *** iyamahat has joined #openstack-infra | 17:05 | |
| mgagne | pep8 works just fine | 17:05 |
| *** jamesmcarthur has joined #openstack-infra | 17:05 | |
| *** rama_y_ has quit IRC | 17:05 | |
| *** iyamahat has quit IRC | 17:05 | |
| fungi | doubly weird | 17:06 |
| mgagne | yea... I think it has something to do with python ./setup.py being called which is not the case with pep8/flake8 | 17:07 |
| mgagne | I'll try to debug pbr and see where it goes wrong | 17:07 |
| *** markvoelker has quit IRC | 17:07 | |
| fungi | i think this is similar to what we saw for a little while with a version of pip that started filtering .git directories when copying the source tree to the build location | 17:08 |
| *** yamahata has quit IRC | 17:09 | |
| *** salv-orlando has joined #openstack-infra | 17:09 | |
| *** dprince has quit IRC | 17:13 | |
| *** Rockyg has quit IRC | 17:13 | |
| *** jpich has quit IRC | 17:13 | |
| *** krtaylor has quit IRC | 17:13 | |
| fungi | i keep virtualenv and tox installed as and linked in virtualenvs, so i just updated all packages in those and retried... still no error building an sdist of gerritbot from master :/ | 17:13 |
| *** strigazi has quit IRC | 17:14 | |
| *** strigazi has joined #openstack-infra | 17:14 | |
| fungi | at this point i have to assume it's an error condition cropping up on osx/darwin and not linux | 17:14 |
| *** dims has quit IRC | 17:14 | |
| mgagne | I'm getting similar errors with other projects so clearly not isolated to gerritbot, I'll trace the version computing code and see where it starts to fall apart | 17:14 |
| *** salv-orlando has quit IRC | 17:14 | |
| *** dprince has joined #openstack-infra | 17:15 | |
| *** rama_y has joined #openstack-infra | 17:15 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Added more debug logging for github requests https://review.openstack.org/499207 | 17:16 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Try getting project branches authenticated https://review.openstack.org/499222 | 17:16 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Cache branches for a project and use it on rate limit errors https://review.openstack.org/499223 | 17:16 |
| openstackgerrit | Merged openstack-infra/shade master: Switch to _is_client_version in list_services https://review.openstack.org/497171 | 17:17 |
| *** sshnaidm has joined #openstack-infra | 17:18 | |
| *** dims has joined #openstack-infra | 17:18 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Update config cache only after all cat jobs complete https://review.openstack.org/498872 | 17:18 |
| mgagne | fungi: hilarious... there is bad config in /usr/local/git/etc/gitconfig which I suspect is not read when running in a terminal because HOME is defined and ~/.gitconfig read instead | 17:25 |
| mgagne | so pbr silently ignores errors when running git rev-parse --git-dir | 17:25 |
| mgagne | exact same problem: https://stackoverflow.com/questions/36908041/git-could-not-expand-include-path-gitcinclude-fatal-bad-config-file-line | 17:26 |
| *** iyamahat has joined #openstack-infra | 17:27 | |
| fungi | hah, nuts | 17:27 |
| mgagne | if I remove that line, it now crashes with ~/.gitignore above | 17:28 |
| mgagne | so not passing HOME triggers a series of problems =) | 17:28 |
| fungi | and yeah, pbr sees git as one of several possible ways to get the version, so can't really treat it as an error condition | 17:28 |
| openstackgerrit | Terry Wilson proposed openstack-infra/project-config master: Add neutron tempest test to ovsdbapp gate https://review.openstack.org/499238 | 17:28 |
| mgagne | fungi: sure, I understand | 17:29 |
| *** rbrndt has quit IRC | 17:29 | |
| fungi | i guess it could _try_ to do something like raise a warning if the git utility and .git dir exist but git itself returns a nonzero exit code or something | 17:29 |
| mgagne | just sad that it's *very* difficult to pin point the root of the problem when stderr is ignored and silent | 17:29 |
| mgagne | the .git exists but git command itself is used to find it so you end up with a catch-22 | 17:30 |
| fungi | ahh, right | 17:30 |
| mgagne | ok, "fixing" (commenting out) the bad config made pbr and myself happy =) | 17:31 |
| *** efoley has quit IRC | 17:31 | |
| fungi | which probably only leaves us with trying to parse git error messages and exit values, which is fragile | 17:31 |
| mgagne | so yha, if you download git for mac from official website, pbr will be sad | 17:31 |
| fungi | not even exit codes i guess, because it appears git just punts and uses exit(1) for the vast majority of conditions | 17:32 |
| fungi | oh, though it does at least in some cases exit(128) if called somewhere that isn't in a git repo | 17:33 |
| fungi | but who knows whether they consider that a stable api | 17:34 |
| *** jamesmcarthur has quit IRC | 17:34 | |
| mgagne | yea... so I don't know how to properly fix it and/or communicate it as a known issue to an end user so they can fix it on their side | 17:35 |
| mgagne | because I've been banging my head for months before finding that one | 17:35 |
| fungi | and that's installed by default with darwin xcode or whatever it's called currently? | 17:39 |
| fungi | (the syntactically-incorrect config i mean) | 17:40 |
| mgagne | I had to download it from https://git-scm.com/downloads | 17:40 |
| *** sambetts is now known as sambetts|afk | 17:40 | |
| fungi | ahh, okay. i do also see references to it being bundled in the xcode dev suite, and also to users installing it via homebrew instead | 17:41 |
| *** bobh has quit IRC | 17:41 | |
| fungi | (git itself i mean) | 17:43 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Update config cache only after all cat jobs complete https://review.openstack.org/498872 | 17:43 |
| *** jpena is now known as jpena|away | 17:46 | |
| *** trown|lunch is now known as trown | 17:46 | |
| *** yamahata has joined #openstack-infra | 17:47 | |
| *** aeng has quit IRC | 17:47 | |
| *** AJaeger has quit IRC | 17:51 | |
| *** jamesmcarthur has joined #openstack-infra | 17:52 | |
| *** rcernin has joined #openstack-infra | 17:52 | |
| *** Swami has joined #openstack-infra | 17:53 | |
| mgagne | yea, I just don't bother with xcode whenever possible | 17:54 |
| *** krtaylor has joined #openstack-infra | 17:56 | |
| openstackgerrit | Matt Riedemann proposed openstack-infra/reviewstats master: Add the ability to get reviewer stats across all stable branches https://review.openstack.org/499219 | 17:58 |
| *** camunoz has quit IRC | 17:59 | |
| *** jamesmcarthur has quit IRC | 18:00 | |
| *** electrofelix has quit IRC | 18:01 | |
| *** eranrom has quit IRC | 18:06 | |
| *** eranrom has joined #openstack-infra | 18:07 | |
| *** markvoelker has joined #openstack-infra | 18:10 | |
| *** salv-orlando has joined #openstack-infra | 18:10 | |
| *** camunoz has joined #openstack-infra | 18:12 | |
| *** dprince has quit IRC | 18:14 | |
| *** jamesmcarthur has joined #openstack-infra | 18:14 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/puppet-zuul master: Add debug logging for cachecontrol library https://review.openstack.org/499249 | 18:15 |
| mordred | fungi, jeblair, pabelanger: ^^ | 18:15 |
| mordred | I think that will let us know if our use of cachecontrol is doing what we think it is or not | 18:15 |
| *** salv-orlando has quit IRC | 18:15 | |
| mordred | jlk: ^^ | 18:20 |
| *** rbrndt has joined #openstack-infra | 18:22 | |
| *** jamesmcarthur has quit IRC | 18:24 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Consume the variable with the same name it's set https://review.openstack.org/499251 | 18:25 |
| *** gouthamr has quit IRC | 18:28 | |
| *** e0ne has joined #openstack-infra | 18:30 | |
| *** jascott1 has quit IRC | 18:36 | |
| *** jamesmcarthur has joined #openstack-infra | 18:37 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Revert "Revert "Move fix_disk_layout to an Ansible role in setup_host"" https://review.openstack.org/499007 | 18:40 |
| dmsimard | clarkb, ianw ^ replaces the retry/sleep loop by udevadm settle | 18:41 |
| *** markvoelker has quit IRC | 18:43 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Revert "Revert "Move fix_disk_layout to an Ansible role in setup_host"" https://review.openstack.org/499007 | 18:44 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Revert "Revert "Move fix_disk_layout to an Ansible role in setup_host"" https://review.openstack.org/499007 | 18:44 |
| *** gouthamr has joined #openstack-infra | 18:45 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add cachecontrol logging to the default config https://review.openstack.org/499255 | 18:46 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Revert "Revert "Move fix_disk_layout to an Ansible role in setup_host"" https://review.openstack.org/499007 | 18:46 |
| dmsimard | sorry for the spam, catching typos left and right | 18:46 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Consume the variable with the same name it's set https://review.openstack.org/499251 | 18:48 |
| mordred | clarkb, dmsimard: looks good but I left a question/comment for possible followup | 18:49 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Log cachecontrol info by default https://review.openstack.org/499257 | 18:49 |
| dmsimard | mordred, clarkb: +1, it'll be taken care of by the future ansibilization of it | 18:50 |
| dmsimard | ansible persists the sysctl changes | 18:50 |
| *** camunoz has quit IRC | 18:50 | |
| dmsimard | http://docs.ansible.com/ansible/latest/sysctl_module.html | 18:50 |
| clarkb | dmsimard: might want to check if tripleo is using this function too | 18:51 |
| mordred | clarkb: ++ | 18:51 |
| mordred | pabelanger: ^^ ? | 18:51 |
| dmsimard | clarkb: ah, yes, thanks for reminding me -- I actually wanted to submit that non-voting job I spoke about earlier this morning | 18:51 |
| dmsimard | clarkb: I'll send a patch now | 18:51 |
| dmsimard | I don't necessarily anticipate tripleo using a lot of these functions but I'm more worried about misc changes that might impact them since they're using dsvm | 18:52 |
| pabelanger | reading | 18:52 |
| *** xyang1 has joined #openstack-infra | 18:52 | |
| dmsimard | as we move towards more ansibilization and zuul v3 | 18:52 |
| pabelanger | clarkb: which function, fix_disk_layout? | 18:53 |
| pabelanger | I don't think so | 18:53 |
| clarkb | oh they may just use the normal setup_host call from devstack-vm-gate-wrap.sh properly | 18:53 |
| pabelanger | ya | 18:53 |
| clarkb | cool, that is the proper way to consume it | 18:53 |
| dmsimard | clarkb: they were just hijacking the ovs function to create some other bridges | 18:53 |
| mordred | cool | 18:53 |
| dmsimard | which were not part of setup host | 18:54 |
| *** ykarel has quit IRC | 18:54 | |
| pabelanger | so, as long as we think the mkswap won't fail any more, I'm okay | 18:55 |
| mordred | dmsimard: once we've migrated and are on v3, it might be worth seeing if supporting them using the new role (or part of the new role) for that usecase | 18:55 |
| mordred | lke - I like the urge - don't reinvent the wheel, there is code that does a thing, use it | 18:55 |
| clarkb | they should be able to use the role now right? | 18:56 |
| pabelanger | packstack is only hit | 18:57 |
| pabelanger | but, I think they have their own script | 18:57 |
| pabelanger | ya, intree http://git.openstack.org/cgit/openstack/packstack/tree/tools/fix_disk_layout.sh | 18:58 |
| pabelanger | tripleo should be okay | 18:58 |
| pabelanger | otherwise, if it breaks, we can also in-tree | 18:58 |
| clarkb | ok, so once we confirm that that change hits a rax node and does what we expect I can approve it (or other reviewer can approve). We just want to make sure we see it work on rax first as rax is the only cloud that hits that code path | 18:59 |
| *** rkukura_ has joined #openstack-infra | 19:02 | |
| *** camunoz has joined #openstack-infra | 19:03 | |
| *** rkukura has quit IRC | 19:04 | |
| *** rkukura_ is now known as rkukura | 19:04 | |
| *** markvoelker has joined #openstack-infra | 19:06 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Add a non-voting and reliable tripleo job to devstack-gate check queue https://review.openstack.org/499261 | 19:08 |
| *** jascott1 has joined #openstack-infra | 19:08 | |
| dmsimard | clarkb, pabelanger, EmilienM, mwhahaha ^ | 19:08 |
| dmsimard | pabelanger: I don't remember why packstack uses that fix_disk_layout script | 19:09 |
| dmsimard | I know I'm the one who added it but /shrug | 19:09 |
| dmsimard | oh, I know. Packstack doesn't use DSVM/devstack-gate but ran into OOM issues due to lack of swap configuration | 19:09 |
| dmsimard | I vaguely remember talking to clarkb that fix_disk_layout ought to be taken out of devstack-gate and just applied to every VM | 19:10 |
| dmsimard | so that VM configuration handed to jobs are homogenous across projects | 19:10 |
| pabelanger | should be in a better position in zuulv3 for that | 19:11 |
| *** salv-orlando has joined #openstack-infra | 19:11 | |
| dmsimard | pabelanger: yeah, could be part of base after it's properly ansibilized and not flapping :) | 19:14 |
| *** priteau has quit IRC | 19:14 | |
| dmsimard | I'll hit recheck a few times on my latest patchset | 19:14 |
| *** mriedem is now known as mriedem_away | 19:16 | |
| *** annegentle has quit IRC | 19:16 | |
| openstackgerrit | Merged openstack-infra/storyboard master: Adds Migration Documentation https://review.openstack.org/496439 | 19:17 |
| *** salv-orlando has quit IRC | 19:17 | |
| *** yamamoto has quit IRC | 19:22 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Use app integration to get PR reviews https://review.openstack.org/499267 | 19:23 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add role for adding launchpadlib credentials https://review.openstack.org/498633 | 19:26 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add tag-release job https://review.openstack.org/498634 | 19:26 |
| *** dims has quit IRC | 19:28 | |
| *** yamamoto has joined #openstack-infra | 19:28 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Partially Revert "Add comment to top of zuul.yaml pointing to other files" https://review.openstack.org/499165 | 19:28 |
| mhayden | so i just discovered these docs about backports -> https://docs.openstack.org/contributor-guide/additional-git-workflow/backport.html -- does that do something automated? or is that just a reference for humans? | 19:29 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add role for adding launchpadlib credentials https://review.openstack.org/498633 | 19:31 |
| *** dims has joined #openstack-infra | 19:31 | |
| *** slaweq has joined #openstack-infra | 19:31 | |
| *** slaweq has quit IRC | 19:31 | |
| *** slaweq has joined #openstack-infra | 19:32 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Fail early if people attempt to add zuul vars or secrets https://review.openstack.org/484000 | 19:33 |
| fungi | mhayden: if you take a look at https://docs.openstack.org/contributor-guide/ you'll see everything in there is the reference for documentation team contributors | 19:34 |
| fungi | some of it may be generally applicable too, but a lot of it is probably docs specific | 19:34 |
| mhayden | ah got it -- i couldn't find any automation that would do notification about backports and such | 19:34 |
| fungi | so i think they're talking specifically about conventions for backports of documentation | 19:34 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Revert "Make a docs-on-readthedocs project-template" https://review.openstack.org/499272 | 19:34 |
| mhayden | fungi: yeah, i'm trying to find a solution for ensuring backports get done when things merge at odd hours :/ | 19:35 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Only iterate the list of zuul projects once when preparing repos https://review.openstack.org/499273 | 19:36 |
| dmsimard | mordred, jeblair: not super important but followed up on what I mentioned yesterday ^ | 19:36 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add roles for adding and removing launchpadlib credentials https://review.openstack.org/498633 | 19:36 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add tag-release job https://review.openstack.org/498634 | 19:36 |
| *** markvoelker has quit IRC | 19:37 | |
| fungi | mhayden: the way most teams do it is with some combination of bug tags (e.g. "ocata-backport-potential"), review comments ("hey, you should go ahead and backport this to ocata once it lands, it's broken there too"), and mostly elbow grease (watching master git logs and making a list of stuff which should get backported) | 19:37 |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Zuulv3: Add more jobs to zuul-jobs https://review.openstack.org/499277 | 19:37 |
| *** markvoelker has joined #openstack-infra | 19:38 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Remove project stanza https://review.openstack.org/499278 | 19:38 |
| fungi | unfortunately it's often hard to determine through automation whether a change _should_ be backported | 19:39 |
| mhayden | agreed | 19:39 |
| *** coolsvap has quit IRC | 19:39 | |
| fungi | and different teams have slightly different policies on how aggressively to backport fixes of which severities | 19:39 |
| openstackgerrit | James E. Blair proposed openstack-infra/openstack-zuul-jobs master: Add docs-on-readthedocs project template https://review.openstack.org/499279 | 19:40 |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Make a docs-on-readthedocs project-template https://review.openstack.org/499280 | 19:41 |
| fungi | mhayden: you may want to ask around in #openstack-stable and find out whether they have any good suggestions. they're a lot more seasoned with when it comes to backport conventions than i am anyway | 19:41 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Revert "Make a docs-on-readthedocs project-template" https://review.openstack.org/499272 | 19:46 |
| mhayden | good point | 19:46 |
| clarkb | dmsimard: pabelanger ya basically the ansiblification of d-g for zuulv3 became that | 19:47 |
| clarkb | so we didn't do any separate work to split things out | 19:47 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Minimise database queries when resolving cards https://review.openstack.org/444615 | 19:50 |
| openstackgerrit | Adam Coldrick proposed openstack-infra/storyboard master: Minimise database queries when populating automatic worklists https://review.openstack.org/444644 | 19:50 |
| *** deduped has quit IRC | 19:53 | |
| *** deduped has joined #openstack-infra | 19:53 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify User Update https://review.openstack.org/499284 | 19:55 |
| *** srobert_ has joined #openstack-infra | 19:55 | |
| *** markvoelker has quit IRC | 19:56 | |
| clarkb | dmsimard: I think http://logs.openstack.org/07/499007/5/check/gate-dg-hooks-dsvm/ae37aac/logs/devstack-gate-setup-host.txt confrims that udev is not settled and that ran on rax | 19:56 |
| clarkb | dmsimard: so you'll want to remove the --timeout=0 as that returns 1 when udev has items to process | 19:56 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify User Update https://review.openstack.org/499284 | 19:57 |
| *** jkilpatr has quit IRC | 19:58 | |
| openstackgerrit | Merged openstack-infra/puppet-zuul master: Add debug logging for cachecontrol library https://review.openstack.org/499249 | 19:58 |
| dmsimard | clarkb: hmm.. maybe add a || echo "Block device not ready yet, waiting 10 seconds..." | 19:58 |
| dmsimard | or something like that ? | 19:58 |
| *** weshay is now known as weshay_PTO | 19:58 | |
| clarkb | ya we could log it if we want to track it with logstash | 19:59 |
| *** srobert has quit IRC | 19:59 | |
| clarkb | || echo "Block device not ready yet. Waiting for up to 10 seconds for it to be ready" | 19:59 |
| dmsimard | ok, sending a new patch. | 20:00 |
| *** camunoz has quit IRC | 20:00 | |
| *** srobert_ has quit IRC | 20:00 | |
| *** felipemonteiro has joined #openstack-infra | 20:00 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Revert "Revert "Move fix_disk_layout to an Ansible role in setup_host"" https://review.openstack.org/499007 | 20:01 |
| *** benj_ has quit IRC | 20:08 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Zuulv3: fix reference to stat results in use-cached-repos https://review.openstack.org/499286 | 20:08 |
| *** yamamoto has quit IRC | 20:08 | |
| jeblair | mordred, clarkb: ^ blocker | 20:08 |
| *** benj_ has joined #openstack-infra | 20:09 | |
| mordred | jeblair: +A | 20:10 |
| *** salv-orlando has joined #openstack-infra | 20:13 | |
| *** jkilpatr has joined #openstack-infra | 20:14 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Only iterate the list of zuul projects once when preparing repos https://review.openstack.org/499273 | 20:14 |
| *** camunoz has joined #openstack-infra | 20:15 | |
| jeblair | dmsimard: what does a multiline command mean? | 20:16 |
| *** felipemonteiro has quit IRC | 20:17 | |
| dmsimard | jeblair: same thing as shell | 20:18 |
| jeblair | k | 20:18 |
| dmsimard | actually, let me make sure of that | 20:18 |
| dmsimard | you just made me doubt | 20:18 |
| *** salv-orlando has quit IRC | 20:18 | |
| dmsimard | jeblair: okay, they don't behave the same way -- I've been using shell when things like pipes were required but I guess there's more to it than that | 20:20 |
| dmsimard | jeblair: That particular multiline (as is) wouldn't work with command, there'd need to be a ";" or something to that effect | 20:20 |
| dmsimard | replacing the command module by shell instead works. | 20:20 |
| * dmsimard sends patch | 20:20 | |
| openstackgerrit | Eric Fried proposed openstack-infra/project-config master: Update patchbot with latest stable branches https://review.openstack.org/499181 | 20:20 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/project-config master: Only iterate the list of zuul projects once when preparing repos https://review.openstack.org/499273 | 20:21 |
| clarkb | dmsimard: http://paste.openstack.org/show/619936/ so that looks good | 20:22 |
| dmsimard | jeblair: the command and shell module parse lines differently, ex: http://paste.openstack.org/raw/619937/ | 20:22 |
| * clarkb looks into getting rid of those partition alignment warnings | 20:22 | |
| dmsimard | clarkb: sweet | 20:23 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Updated Summit get main page class https://review.openstack.org/499287 | 20:25 |
| efried | Am I the only one not a fan of the move to urldefense.proofpoint.com ? | 20:25 |
| dmsimard | efried: what's that ? | 20:25 |
| efried | Maybe it's my corp mail server doing it... but a week or two ago all the links in my emails from gerrit stopped being like https://bugs.launchpad.net/nova/+bug/1713502 and started being like https://urldefense.proofpoint.com/v2/url?u=https-3A__bugs.launchpad.net_bugs_1713502&d=DwIFaQ&c=jf_iaSHvJObTbx-siA1ZOg&r=NPROtJU9ysIgXWp6OPchk0_NlCcGnl2qzFZdLS6DEPg&m=UQJh5NlxOZz8N-cigc7c5snnCUPljurYgDvFrDpr_5U&s=6OPDtZiflZJdZAmlMbpV9h | 20:26 |
| openstack | Launchpad bug 1713502 in OpenStack Compute (nova) "PCI passthrough documentation needs updating since options moved to [pci] section" [Undecided,In progress] - Assigned to Eric Fried (efried) | 20:26 |
| efried | 42JQ93-epRS3ibVlmlByg&e= | 20:26 |
| openstackgerrit | Merged openstack-infra/project-config master: Zuulv3: fix reference to stat results in use-cached-repos https://review.openstack.org/499286 | 20:27 |
| efried | I kinda liked being able to glance at a URL like that and know, "hey, that's a link to launchpad bug number 1713502" | 20:27 |
| *** florianf has quit IRC | 20:28 | |
| dmsimard | efried: I don't get those, maybe that's from your email provider ? | 20:28 |
| efried | Sigh. Wonder why it's only happening to gerrit emails, then. Oh well. | 20:29 |
| efried | I'm sure it's... making me much safer. | 20:29 |
| fungi | does seem like some mangling going on in an intermediary mta on the receiving end, nothing under our control | 20:29 |
| pabelanger | somebody recently had that issue too, maybe jlk ? | 20:30 |
| efried | Yeah, now that you mention it, it happened for emails coming from launchpad and gerrit about the same time. Still doesn't explain why it's not doing it for any other senders, though. | 20:30 |
| *** bramleya has quit IRC | 20:30 | |
| efried | Wonder if there's, like, a setting on my lp ID I can flip. | 20:31 |
| pabelanger | efried: IBM employee? | 20:32 |
| *** nicolasbock has joined #openstack-infra | 20:32 | |
| efried | pabelanger Yuh. IBM thing? | 20:32 |
| pabelanger | ya, jlk has the same thing last week I think. He also IBM | 20:32 |
| efried | Now I'm trying to find an example of an email I received in my corp account that has an external link, other than lp/gerrit. Maybe they're just not scrubbing internal links, and I never get anything else from outside. | 20:34 |
| *** rama_y has quit IRC | 20:34 | |
| *** apetrich has quit IRC | 20:35 | |
| *** rama_y has joined #openstack-infra | 20:36 | |
| *** apetrich has joined #openstack-infra | 20:37 | |
| *** pcaruana has quit IRC | 20:40 | |
| *** trown is now known as trown|outtypewww | 20:41 | |
| jlvillal | fungi: Do you know if any progress happened on the stackalytics transition. I don't think the main maintainer works for Mirantis anymore. Not sure if they are still involved in OpenStack or not. | 20:44 |
| jlvillal | fungi: I was reading your email from May | 20:44 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Create aligned partitions in disk fixing https://review.openstack.org/499314 | 20:44 |
| pabelanger | http://stackalytics.openstack.org/ is still running | 20:45 |
| clarkb | dmsimard: ^ I think that will do it, but let us see | 20:45 |
| pabelanger | guess we should finally flip the switch | 20:45 |
| *** hasharAway has quit IRC | 20:45 | |
| jlvillal | pabelanger: Yes, but no new data :( | 20:45 |
| jlvillal | pabelanger: Oh | 20:45 |
| jlvillal | stackalytics.openstack.org Ah! | 20:45 |
| * jlvillal looks | 20:45 | |
| pabelanger | ya, that has been online for a while, 2 years now? | 20:45 |
| pabelanger | but, we've never kicked it live | 20:46 |
| jlvillal | pabelanger: First I heard of it :) | 20:46 |
| clarkb | someone from red hat was offering to help with stackalytics in boston, but I didn't know who it was | 20:46 |
| pabelanger | Ya, we manage that instance | 20:46 |
| pabelanger | but, it needs help | 20:46 |
| jlvillal | stackalytics.COM doesn't have any new data since about 23-Aug-2017 | 20:47 |
| jlvillal | At least for Ironic: http://stackalytics.com/?module=ironic&release=all | 20:47 |
| pabelanger | http://paste.openstack.org/show/619938/ | 20:47 |
| pabelanger | seems to be the latest exception in processor | 20:47 |
| pabelanger | so, breaking on nova blueprints | 20:47 |
| jlvillal | pabelanger: maybe that explains the throbber rotating and not stopping | 20:48 |
| pabelanger | Right, we haven't imported all the data | 20:48 |
| pabelanger | so, we'd need somebody to see why that is | 20:48 |
| *** Goneri has quit IRC | 20:48 | |
| pabelanger | http://paste.openstack.org/show/619939/ more data | 20:48 |
| pabelanger | shouldn't be too hard to reproduce | 20:49 |
| jlvillal | pabelanger: Okay. Thanks for the info. I don't have time at the moment, but maybe later. | 20:49 |
| jlvillal | pabelanger: My manager liked those stats, so maybe they will give me time to work on it :) | 20:49 |
| *** ijw has quit IRC | 20:50 | |
| *** slaweq has quit IRC | 20:50 | |
| fungi | jlvillal: also, our puppet-stackalytics module makes it reasonably trivial to deploy one yourself to tinker with | 20:51 |
| jlvillal | fungi: Cool. I might try it out. Thanks. | 20:51 |
| fungi | jlvillal: and to answer your earlier question, no i've heard nothing recently about any progress on stackalytics dev work | 20:51 |
| jlvillal | fungi: Thanks. I was looking at: https://etherpad.openstack.org/p/BOS-forum-should-we-kill-stackalytics | 20:52 |
| *** slaweq has joined #openstack-infra | 20:52 | |
| clarkb | jlvillal: ya thats the session where someone from red hat volunteered | 20:52 |
| clarkb | basically we said lets kill it and a bunch of people said no no don't do it we'll fix it and then not much has happened since I don't think | 20:52 |
| jlvillal | clarkb: I wonder who that was? | 20:52 |
| fungi | the foundation directory api does include things like contributor affiliation now, so someone interested could probably hack on dropping a lot of the static data in the stackalytics repo | 20:52 |
| fungi | and just have it query instead | 20:53 |
| clarkb | and mrmartin had memcache replacement in the works so that it was faster to restart the service? | 20:53 |
| clarkb | heh passing -a optimal to parted does not result in optimally partitioned partitions | 20:53 |
| clarkb | thanks parted | 20:53 |
| fungi | right, he proposed an infra spec but one thing we haven't quite managed yet is to get permission to take over the codebase from its (former? idle?) maintainers | 20:53 |
| *** gouthamr has quit IRC | 20:54 | |
| fungi | as stackalytics is not an official openstack deliverable, the tc can't just reassign the repo to anyone | 20:54 |
| jlvillal | fungi: Well if the owner is absent, hopefully there is some process to have new cores | 20:54 |
| fungi | i suppose we could fork it though if we can't get ahold of anyone | 20:54 |
| jlvillal | fungi: Or fork it? | 20:54 |
| fungi | infra doesn't really have a policy for determining whether/when a repo is "abandoned" and how/who can take it over without assent of its former maintainers | 20:56 |
| mrmartin | jlvillal the code quality / documentation level of stackalytics is not the best in the world. | 20:56 |
| dmsimard | clarkb: there's mathematics involved to create aligned partitions, maybe -a optimal is supposed to do that automatically or something | 20:56 |
| fungi | so if we make a call on that, it has the potential to set a precedent | 20:56 |
| jlvillal | mrmartin: What is though? ;) | 20:56 |
| clarkb | dmsimard: ya its supposed to align on a sector boundary | 20:56 |
| jlvillal | mrmartin: But yeah, I've looked at it before. A bit complicated to figure things out. | 20:57 |
| clarkb | er no the multiple of the alginment that is a sector boundary | 20:57 |
| clarkb | dmsimard: but -a optimal isn't working, still get the warning. Also doing the maths by hand for the disk in question I think our 1 megabyte start is correct so now I'm extra confused | 20:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: WIP Split add-sshkey into two roles https://review.openstack.org/499338 | 20:58 |
| fungi | so anyway, i'm not entirely against handing that repo over to interested maintainers if we exhaust available means of getting feedback from the previous maintainers, but someone needs to try that first | 20:58 |
| fungi | also, i defer to the infra ptl in these matters ;) | 20:58 |
| *** ihrachys has quit IRC | 20:59 | |
| * fungi enjoys being able to say that again | 20:59 | |
| jlvillal | fungi: Okay. Thanks. | 20:59 |
| *** bramleya has joined #openstack-infra | 20:59 | |
| clarkb | ++ to getting interested individuals working on $project. This was easier with the nose html output plugin because we are/were the maintainers. I'd reach out to the existing cores and see if any of them respond and are willing to open up membership | 20:59 |
| *** annegentle has joined #openstack-infra | 21:00 | |
| clarkb | jlvillal: feel free to CC me on those emails if you like | 21:00 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: WIP Split secret and non-secret data for proposals https://review.openstack.org/499339 | 21:00 |
| *** jamesmcarthur has quit IRC | 21:00 | |
| jlvillal | fungi: clarkb: I do see that Ilya Shakhat did a review two days ago: https://review.openstack.org/#/c/497590/ | 21:00 |
| *** kgiusti has left #openstack-infra | 21:00 | |
| jlvillal | So looks like he might still be around | 21:01 |
| clarkb | would be a good one to contact probably | 21:01 |
| openstackgerrit | Marton Kiss proposed openstack-infra/groups master: Fix flag module unsupported operand types issue https://review.openstack.org/499340 | 21:01 |
| jlvillal | clarkb: He is the person behind it I believe | 21:01 |
| jlvillal | clarkb: Ah, he works for Huawei now :) http://stackalytics.com/?release=all&user_id=shakhat | 21:03 |
| *** bobh has joined #openstack-infra | 21:03 | |
| *** jpena|away is now known as jpena | 21:04 | |
| clarkb | dmsimard: I wonder if I need to use the optimal flag when making the label too? | 21:04 |
| *** mat128 has quit IRC | 21:04 | |
| *** e0ne has quit IRC | 21:06 | |
| openstackgerrit | Ade Lee proposed openstack-infra/project-config master: Modify novajoin-tempes-plugin to just run pep8 https://review.openstack.org/499341 | 21:08 |
| openstackgerrit | Ade Lee proposed openstack-infra/project-config master: Modify novajoin-tempest-plugin to just run pep8 https://review.openstack.org/499341 | 21:09 |
| *** gouthamr has joined #openstack-infra | 21:10 | |
| pabelanger | mnaser: in vexxhost, between the 2 projects we'd be using for nodepool. Is there networking limits in place? | 21:10 |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Add docs-on-readthedocs project template https://review.openstack.org/499279 | 21:11 |
| ianw | dmsimard: should we merge 499007? | 21:11 |
| *** bramleya has quit IRC | 21:11 | |
| pabelanger | mnaser: specifically, I trying to see if we are seeing some slowness from downloading things from the mirror in the other project then nodepool node | 21:11 |
| dmsimard | ianw: no, want to recheck it a few times to be confident | 21:11 |
| ianw | dmsimard: i wouldn't mind working on ansibal-ising it as time permits too, seems like a good one to get my head around more of ansible with | 21:12 |
| *** thorst_afk has quit IRC | 21:12 | |
| dmsimard | ianw: I started taking a stab at it before deciding against it because it would've been harder to review | 21:13 |
| *** jpena is now known as jpena|away | 21:13 | |
| dmsimard | ianw: what I had so far is here https://gist.github.com/dmsimard/d3d818462292faf92dded7e2caf67bab | 21:13 |
| *** jcoufal has quit IRC | 21:13 | |
| dmsimard | clarkb: I'm wondering if gpt vs msdos makes a difference | 21:14 |
| openstackgerrit | Merged openstack-infra/project-config master: Zuulv3: Add more jobs to zuul-jobs https://review.openstack.org/499277 | 21:14 |
| *** salv-orlando has joined #openstack-infra | 21:14 | |
| *** ldnunes has quit IRC | 21:16 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Use app integration to get PR reviews https://review.openstack.org/499267 | 21:17 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add tag-release job https://review.openstack.org/498634 | 21:18 |
| dmsimard | clarkb: this post mentions that we shouldn't necessarily start at 0/0% but instead at a sector defined by MATHEMATICS | 21:18 |
| dmsimard | http://rainbow.chard.org/2013/01/30/how-to-align-partitions-for-best-performance-using-parted/ | 21:18 |
| dmsimard | clarkb: but maybe ansible can magically align things http://docs.ansible.com/ansible/latest/parted_module.html | 21:18 |
| clarkb | ya but that sector is what we already use according to that maths, its 1MB or sector 20148 | 21:18 |
| clarkb | er 2048 | 21:19 |
| clarkb | I guess I can just force in 2048 and see what happens | 21:19 |
| openstackgerrit | Merged openstack-infra/project-config master: Add afsdocs_secret secret for publishing https://review.openstack.org/498267 | 21:19 |
| *** salv-orlando has quit IRC | 21:19 | |
| clarkb | dmsimard: the optimal_io_size on these devices is 0 which means we use a 1MB alginment | 21:19 |
| *** camunoz has quit IRC | 21:19 | |
| clarkb | dmsimard: which should mean that any MB value (whcih is default) will be aligned? | 21:19 |
| clarkb | I'm clearly missing something here | 21:20 |
| *** krtaylor has quit IRC | 21:20 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add publish-openstack-python-docs jobs https://review.openstack.org/498621 | 21:21 |
| openstackgerrit | Merged openstack-infra/project-config master: Add a non-voting and reliable tripleo job to devstack-gate check queue https://review.openstack.org/499261 | 21:21 |
| dmsimard | clarkb: ah, nope, ansible would not be our saviour -- it just passes the align argument to the parted command | 21:21 |
| clarkb | dmsimard: ok so same as what I pushed | 21:21 |
| dmsimard | yeah: https://github.com/ansible/ansible/blob/11346284b113611dd12bc384596b4043bb11de35/lib/ansible/modules/system/parted.py#L482 | 21:22 |
| *** baoli has quit IRC | 21:23 | |
| dmsimard | clark: you positive about the math ? is it 2048 or 1024 ? | 21:24 |
| dmsimard | er, clarkb ^ | 21:24 |
| clarkb | dmsimard: its optimal_io_size = 0 so use 1048576 / physical_block_size = 512 | 21:25 |
| clarkb | which is 2048sectors which is 1MB | 21:25 |
| dmsimard | clarkb: do we need to specify the units ? like, could it be using 1MiB instead of 1MB or some kind of junk like that ? | 21:27 |
| clarkb | maybe? that seems like an odd choice for a tool like parted but could be possible | 21:28 |
| dmsimard | passing "2048s" sounds like a fair attempt that'd make sure we're using the right value | 21:28 |
| dmsimard | s for sectors | 21:28 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Add User to Group https://review.openstack.org/499345 | 21:28 |
| clarkb | dmsimard: ya can try that | 21:29 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Create aligned partitions in disk fixing https://review.openstack.org/499314 | 21:30 |
| dmsimard | didn't do much d-g/zuulv3 stuff today, RDO still isn't out and usually we're done within a few hours of release :/ | 21:32 |
| openstackgerrit | Monty Taylor proposed openstack-infra/nodepool feature/zuulv3: Remove the default argument to secure in nodepoolcmd https://review.openstack.org/480310 | 21:33 |
| *** armax has quit IRC | 21:35 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Prevent execution of locally overridden core modules https://review.openstack.org/490216 | 21:36 |
| *** vhosakot has quit IRC | 21:37 | |
| ianw | dmsimard: i've been generally unconvinced on editing bash inside yaml. do you have editor tricks that make it work? | 21:39 |
| dmsimard | ianw: for syntax highlighting you mean ? | 21:40 |
| ianw | yeah, mostly | 21:41 |
| ianw | it's similar when i'm writing release notes and trying to write rst inside yaml i guess | 21:41 |
| jlk | write it outside, copy/pasta it in :( | 21:42 |
| *** sai-mtg is now known as sai | 21:43 | |
| dmsimard | ianw: I don't really have something that I'm entirely satisfied with either | 21:43 |
| *** eharney has quit IRC | 21:43 | |
| ianw | jlk: that's mostly my approach, just wondering if anyone had solved it in a better way :) | 21:43 |
| clarkb | dmsimard: 2048s worked for the first partition. Second one still failed. So maybe I need to do maths in bash | 21:43 |
| dmsimard | clarkb: maybe 8192 isn't a good number | 21:44 |
| dmsimard | like maybe 8191 | 21:44 |
| dmsimard | because of the sector offset from the first partition | 21:44 |
| *** ijw has joined #openstack-infra | 21:44 | |
| dmsimard | but you'd think --align optimal would take care of that huh | 21:45 |
| *** esberglu has quit IRC | 21:45 | |
| *** askb has joined #openstack-infra | 21:47 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Check User in Group https://review.openstack.org/499357 | 21:47 |
| *** mriedem_away is now known as mriedem | 21:47 | |
| clarkb | ya exactly | 21:48 |
| openstackgerrit | Jesse Keating proposed openstack-infra/zuul feature/zuulv3: Remove comments questioning API capabilities https://review.openstack.org/499358 | 21:48 |
| openstackgerrit | Kendall Nelson proposed openstack-infra/storyboard master: Handle Branches from Launchpad in Migration https://review.openstack.org/437469 | 21:49 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Preparing TripleO CI to test upgrades to Queens https://review.openstack.org/499359 | 21:50 |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify Remove User from Group https://review.openstack.org/499360 | 21:50 |
| dmsimard | clarkb: I'd try 8191 :D | 21:51 |
| dmsimard | or 8191*512s | 21:52 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Add support for sidebars https://review.openstack.org/499361 | 21:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Add more content to zuul v3 migration doc https://review.openstack.org/499362 | 21:53 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Minor cleanup to zuulv3 example https://review.openstack.org/499363 | 21:53 |
| jeblair | mordred, Shrews: ^ | 21:54 |
| openstackgerrit | Merged openstack-infra/shade master: Fix handling timeouts in volume functional tests cleanup https://review.openstack.org/498918 | 21:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Add publish-to-pypi-quietly project-template https://review.openstack.org/499364 | 21:55 |
| *** thegreenhundred has quit IRC | 21:56 | |
| dmsimard | btw on my PTG todo I'll want to chat with -infra folks about how you deal with nodepool cloud provider issues -- like for example for VMs that stay stuck in deletion or any other errors a tenant is not able to resolve himself | 21:56 |
| dmsimard | there's another one that seems racy about floating ips being re-allocated to another VM before the original VM was deleting or something like that | 21:57 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Allow description fields in projects and project templates https://review.openstack.org/499365 | 21:57 |
| dmsimard | basically, how you're keeping your nodepool healthy while maintaining your sanity :) | 21:57 |
| dmsimard | I suppose at your scale it's either a larger problem (more occurrences of these kind of issues) or a smaller problem (because you have larger quotas) | 21:59 |
| jeblair | dmsimard: good beer talk. :) but yeah, a lot of nodepool/shade is about working around that when we can, then otherwise, we report errors to cloud providers. ideally, we'd like to help get openstack bugs fixed. often, i fear our reports just end up with the providers running their local "fix_the_cloud.py" script. | 22:00 |
| dmsimard | oh, can definitely keep it for the beer/dinner :) | 22:00 |
| mordred | jeblair: 2nd doc patch I left a review on wording choice | 22:02 |
| pabelanger | clarkb: mnaser: so looking at http://status.openstack.org/elastic-recheck/#1686542 I think we are getting a larger failure rate from vexxhost currently :( logstash is showing ~110 hits over 10 days, compared to a total of ~320 hits | 22:02 |
| pabelanger | clarkb: mnaser: I think some of the slow down is networking to mirror, and noisy neighbours on IO | 22:03 |
| mgagne | usually people complain non-officially on #openstack-infra or other channels "isn't there a network issue at inap atm?" and maybe someone will check =) | 22:03 |
| mordred | dmsimard: yah - definitely good beer talk - fwiw, there are two forms of floating-ip assignment and we try to use the one that doesn't have the race condition problems as much | 22:03 |
| mgagne | now I just caught the attention of a coworker | 22:03 |
| pabelanger | mnaser: clarkb: for example, tripleo job that is about to fail hitting upwards of 3 hours, when it usually completes in 1hr30mins | 22:04 |
| openstackgerrit | Eric Fried proposed openstack-infra/gerritbot master: Support regexes in channel config yaml https://review.openstack.org/499367 | 22:04 |
| efried | clarkb mriedem ^^ ! | 22:04 |
| mgagne | efried: ok, you beat me to it | 22:05 |
| efried | mgagne Whew! | 22:05 |
| mgagne | but I found the issue with pbr on my laptop at the same time so =) | 22:05 |
| efried | mgagne Counting on you for an excellent review, then :) | 22:05 |
| *** krtaylor has joined #openstack-infra | 22:05 | |
| pabelanger | mgagne: :) | 22:05 |
| mriedem | efried: heh | 22:05 |
| mriedem | good thing i mentioned that so you could spend your whole day on it | 22:06 |
| * efried nerdsniped by mriedem | 22:06 | |
| *** wolverineav has quit IRC | 22:06 | |
| openstackgerrit | Sean McGinnis proposed openstack/ptgbot master: Sort room names https://review.openstack.org/499369 | 22:08 |
| mgagne | efried: hmm I was thinking about supporting very basic regex (like *) instead so you don't have to enable regex support per section/channel. It's a matter of opinion at this point, just sharing =) | 22:10 |
| efried | mgagne I started off thinking that way, but really didn't want to have to write and maintain my own regex syntax. | 22:10 |
| mgagne | hehe, true. I'm sure I would have ended up in an in-house regex madness and changed my mind anyway :P | 22:11 |
| dmsimard | efried: omg that patch is awesome | 22:11 |
| * efried blushes | 22:11 | |
| dmsimard | well, I haven't looked at the *actual* code yet, but the intended objective is cool :) | 22:12 |
| *** xyang1 has quit IRC | 22:12 | |
| *** dave-mccowan has quit IRC | 22:12 | |
| mgagne | efried: or can you always assume regex ^<value>$ and requires user to add .* at beginning and end if they want an other behaviour? | 22:12 |
| efried | mgagne Hm, you know, you're right, I probably should have assumed anchors. | 22:13 |
| mgagne | I find it a bit awkward that you need to use use-regex-for-sections ^^' | 22:14 |
| efried | mgagne Okay, so there again I considered just opening it up to regexes for everything. BUT there's some existing regexy metachars in the file | 22:14 |
| efried | Actually the only ones I could find were periods in e.g. stable/16.0 or whatever. | 22:14 |
| mgagne | there is? | 22:14 |
| efried | ^ | 22:14 |
| mgagne | *sad panda* | 22:15 |
| *** salv-orlando has joined #openstack-infra | 22:15 | |
| mgagne | well, does . match . ? /troll | 22:15 |
| efried | mgagne It does. But it also matches any other character. Which is *probably* just fine. | 22:16 |
| efried | Because I kinda doubt there's separate branches stable/16.0, stable/16x0, stable/16_0, etc. in the same project. | 22:17 |
| efried | So - if there's a consensus there, I would consider ripping out use-regex-for-sections. | 22:18 |
| *** thegreenhundred has joined #openstack-infra | 22:18 | |
| mgagne | I'm only a single voice ;) | 22:19 |
| efried | I was also being careful about preserving backward compat. (Why? Pretty much out of habit; and because I'm totally new to this project and don't know how tightly that's regulated.) | 22:19 |
| efried | As written, the existing channels.yaml in project-config is completely compatible - behaves exactly as before. | 22:19 |
| efried | I guess we should keep in mind that there may be other consumers of gerritbot. | 22:20 |
| *** salv-orlando has quit IRC | 22:20 | |
| efried | It's kinda written to support that. | 22:20 |
| mgagne | yes, 100% agree, I'm nitpicking at this point =) | 22:20 |
| mgagne | I do consume gerritbot internally too | 22:20 |
| *** marst has quit IRC | 22:20 | |
| mgagne | and found it sad that I had to update the config each time I create a branch | 22:20 |
| mgagne | other suggestion: add support for branches-regex: [] instead | 22:21 |
| efried | mgagne and projects-regex ? | 22:21 |
| mgagne | I'm gonna try your code tomorrow and see where it goes | 22:21 |
| mgagne | yea | 22:21 |
| efried | and events-regex (though the only thing that really makes sense here is .*) | 22:22 |
| efried | Yes, that would be another approach. Probably sixes, tbh. | 22:22 |
| mgagne | true, at this point, can one assume .* if no event is provided? | 22:22 |
| efried | mgagne With the code as written, probably so; but I want to add the assumed ^anchors$ as you suggested. | 22:22 |
| efried | mgagne Actually, not. Because there would need to be an actual value there. | 22:23 |
| efried | I don't know if you can just have a line with the hyphen and no value and have it come across as ''. | 22:23 |
| efried | but that would be weird. | 22:23 |
| mgagne | there need to be a value? | 22:24 |
| efried | If you just had an events: section with nothing in it, there would be no events configured (and you'd never get any posts for that channel) | 22:24 |
| mgagne | yea, better leave it for a future change (if it ever happens) | 22:25 |
| mgagne | anyway, gonna give it a try tomorrow, I need to leave soon | 22:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Minor cleanup to zuulv3 example https://review.openstack.org/499363 | 22:26 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Add more content to zuul v3 migration doc https://review.openstack.org/499362 | 22:26 |
| mgagne | thanks for the change =) | 22:26 |
| efried | mgagne Merci en avance. Moi je dois aussi quitter. A demain! | 22:27 |
| mgagne | a+ | 22:27 |
| *** efried is now known as efried_off | 22:28 | |
| *** rcernin has quit IRC | 22:28 | |
| *** slaweq has quit IRC | 22:30 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Move name from block to tasks in the block https://review.openstack.org/499375 | 22:30 |
| *** rbrndt has quit IRC | 22:34 | |
| *** rbrndt has joined #openstack-infra | 22:34 | |
| *** rbrndt has quit IRC | 22:34 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul feature/zuulv3: Add publish-openstack-python-docs to post pipeline https://review.openstack.org/498840 | 22:38 |
| *** thegreenhundred has quit IRC | 22:39 | |
| *** armax has joined #openstack-infra | 22:39 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/gerritbot master: Add unit test framework and one unit test https://review.openstack.org/499377 | 22:41 |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Make variant behavior more clear https://review.openstack.org/499378 | 22:41 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Create aligned partitions in disk fixing https://review.openstack.org/499314 | 22:41 |
| clarkb | I think I got that maths right | 22:42 |
| jeblair | mordred: a further attempted clarification: https://review.openstack.org/499378 | 22:42 |
| openstackgerrit | Clark Boylan proposed openstack-infra/devstack-gate master: Create aligned partitions in disk fixing https://review.openstack.org/499314 | 22:45 |
| mordred | jeblair: ++ | 22:45 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/gerritbot master: Add unit test framework and one unit test https://review.openstack.org/499377 | 22:46 |
| *** jamesmcarthur has joined #openstack-infra | 22:48 | |
| openstackgerrit | Merged openstack-infra/shade master: Add handling timeout in servers cleanup function https://review.openstack.org/498925 | 22:49 |
| clarkb | dmsimard: http://paste.openstack.org/show/619952/ yup I got the maths right. http://paste.openstack.org/show/619953/ show lsblk output | 22:52 |
| *** seanhandley has quit IRC | 22:52 | |
| *** jamesmcarthur has quit IRC | 22:53 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Fix error in mirror-workspace-git-repos https://review.openstack.org/499382 | 22:53 |
| clarkb | pabelanger: dmsimard do we need to do anymore checking of https://review.openstack.org/#/c/499007/6 or are we happy with it as is? I think both it and https://review.openstack.org/499314 are ready for review and could go in now myself | 22:53 |
| clarkb | jeblair: re ^ what is src_root intended to be used for then if not the sources? | 22:54 |
| dmsimard | clarkb: jenkins hasn't chimed in yet | 22:56 |
| dmsimard | clarkb: I would at least run *one* recheck | 22:56 |
| clarkb | dmsimard: oh right I cheated and checked by hand | 22:56 |
| pabelanger | clarkb: dmsimard: how long could we wait until merging? Not that I want to block it, but if we all thing swap is fixed, then I'm sure gate will be happy | 22:56 |
| jeblair | clarkb: perhaps we should change the project src_dir so that we drop src/ from the start of it. however -- | 22:56 |
| dmsimard | pabelanger: before we ansibilized it, e-r mentioned something on the scale of 3 occurence in 10 days | 22:57 |
| clarkb | pabelanger: well its part of ansiblifying d-g so sooner the better | 22:57 |
| dmsimard | is it that bad ? | 22:57 |
| dmsimard | 2 fails in 24 hrs / 5 fails in 10 days | 22:57 |
| jeblair | clarkb: i think it was written that way because, if you use src_dir on a remote node, it can be used as-is as a relative path (so ./src/...) | 22:58 |
| pabelanger | clarkb: agree, if we're confident in the fix, I think we can merge. | 22:58 |
| clarkb | jeblair: but you changed it to work_root on the remote node as well | 22:59 |
| clarkb | jeblair: implying that ./src/ isn't ever a thing? | 22:59 |
| jeblair | clarkb: derp | 22:59 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Move name from block to tasks in the block https://review.openstack.org/499375 | 23:00 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Fix checkout in mirror-workspace-git-repos https://review.openstack.org/499384 | 23:00 |
| jeblair | clarkb: ^ | 23:00 |
| jeblair | clarkb: these are sample values: https://etherpad.openstack.org/p/nupYy2s5yv | 23:01 |
| clarkb | gotcha its the item.src_dir that makes the src happen against work root | 23:02 |
| clarkb | would it make mroe sense to drop the src/ prefix and use src_root instead? or maybe get rid of src_root? in any case +2 on the second change | 23:02 |
| jeblair | clarkb: yah. theoretically in 499384 i could drop the ansible_user_dir since that should be relative to ~... | 23:03 |
| jeblair | clarkb: src_root predaces project.src_dir, so yeah, perhaps we wouldn't have added it. | 23:04 |
| clarkb | dmsimard: I think the important thing here is what while infrequently failing before your change we can see from the logs that your change is doing what is expected of it and waiting for the device to show up. I don't know how much more data rechecking will give us | 23:06 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix error in mirror-workspace-git-repos https://review.openstack.org/499382 | 23:09 |
| *** bobh has quit IRC | 23:09 | |
| *** hongbin has quit IRC | 23:10 | |
| *** scottda has quit IRC | 23:12 | |
| dmsimard | clarkb: you're not wrong, but we're also, for some reasons, triggering the race condition with almost 100% reproducibility through ansible for some reason | 23:13 |
| clarkb | dmsimard: I think its likely more related to moving the script than running it under ansible | 23:13 |
| dmsimard | it's that part that worries me more than the fix being reliable at first glance | 23:13 |
| dmsimard | it'll cost us what, another two hours of checks ? not expensive | 23:14 |
| dmsimard | remember that we merged the initial ansible patch and we somehow didn't run into any errors of that kind | 23:15 |
| dmsimard | and then everything exploded in our face | 23:15 |
| dmsimard | so I'd rather be safe than sorry on that one, don't want to be responsible for another gate breakage especially around the time of release :) | 23:15 |
| *** salv-orlando has joined #openstack-infra | 23:16 | |
| * dmsimard felt really awful about that last night | 23:16 | |
| clarkb | dmsimard: that is beacuse it only affects rax | 23:16 |
| clarkb | so it is fairly easy to merge something that won't work | 23:17 |
| clarkb | *won't work on rax in this particular set of code | 23:17 |
| clarkb | but also release is over, now is the time to be less cautious >_> | 23:17 |
| dmsimard | clarkb: cycle-trailing are dead in the middle of release | 23:17 |
| dmsimard | i.e, puppet, OSA, tripleo, etc. | 23:18 |
| clarkb | ya | 23:18 |
| clarkb | I know, its just hard avoiding everything for so long | 23:18 |
| dmsimard | clarkb: grant me one recheck ? just one :D | 23:18 |
| dmsimard | I'll give you an extra ara sticker at the PTG | 23:18 |
| clarkb | ha, ya rechecking is fine | 23:19 |
| dmsimard | it's not that I don't want to merge it, just want to get a better data sample than one round | 23:19 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix checkout in mirror-workspace-git-repos https://review.openstack.org/499384 | 23:20 |
| *** salv-orlando has quit IRC | 23:21 | |
| *** tosky has quit IRC | 23:23 | |
| *** annegentle has quit IRC | 23:26 | |
| mordred | jeblair, clarkb: yes - in 499384 you can drop the ansible_user_dir - I put in in a few places related to the copy command - because pushing files to the remote host with copy: treats relative paths as if you want them to be relative to the LOCAL working dir | 23:27 |
| mordred | things that aren't command will operate out of ~ and relative paths will be relative to it | 23:28 |
| mordred | (just following up to say "yup that's right") | 23:28 |
| *** jpena|away is now known as jpena|off | 23:29 | |
| clarkb | what does command do? | 23:30 |
| jeblair | clarkb: runs a command without a shell | 23:31 |
| *** Apoorva has quit IRC | 23:31 | |
| *** Apoorva has joined #openstack-infra | 23:32 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add publish-openstack-python-docs to post pipeline https://review.openstack.org/498840 | 23:32 |
| pabelanger | yay | 23:32 |
| *** Apoorva_ has joined #openstack-infra | 23:35 | |
| mordred | clarkb: yah command and shell are the same thing - subprocess.Popen - command uses shell=False, shell uses shell=True - they're otherwise identical | 23:35 |
| mordred | pabelanger: woot! | 23:36 |
| mordred | pabelanger: so now we just need to land a docs patch | 23:36 |
| mordred | pabelanger: oh- wait a sec - do we need to remove the docs jobs from zuul from v2? | 23:37 |
| pabelanger | Oh, yes. | 23:37 |
| pabelanger | but, zuulv3 job is failing atm. so not a issue ATM | 23:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove doc publication jobs from zuul for v2 https://review.openstack.org/499392 | 23:38 |
| mordred | pabelanger: ^^ | 23:38 |
| pabelanger | +2 | 23:38 |
| mordred | clarkb: ^^ we should go ahead and land that so that once the v3 version works they don't step on each other | 23:38 |
| *** Apoorva has quit IRC | 23:39 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Fix typo for playbooks/python-docs/post https://review.openstack.org/499393 | 23:39 |
| pabelanger | typo^ | 23:39 |
| mordred | pabelanger: I agree with yo | 23:40 |
| pabelanger | really, need to write that linter job and validate playbooks exists | 23:40 |
| pabelanger | PTG task :) | 23:40 |
| mordred | pabelanger: yah | 23:41 |
| dmsimard | clarkb: that might be good enough of a sample come to think of it, see my comment in https://review.openstack.org/#/c/499007/ | 23:42 |
| mordred | pabelanger: also - for the roles that are in one repo but without playbooks (like most of zuul-jobs) having a directory of test playbooks that use them so that ansible-lint will get run on them would also be nice - and pretty cheap | 23:42 |
| dmsimard | 10 jobs, 15 nodes, spanning centos ubuntu and even opensuse | 23:42 |
| dmsimard | Definite hits and success in resolving the issue http://logstash.openstack.org/#/dashboard/file/logstash.json?query=message:%5C%22Block%20device%20not%20ready%20yet.%20Waiting%20for%20up%20to%2010%20seconds%20for%20it%20to%20be%20ready%5C%22%20AND%20build_change:%5C%22499314%5C%22 | 23:42 |
| *** rhallisey has quit IRC | 23:42 | |
| dmsimard | clarkb: typically you'll use the command module unless you need things like pipes or what would require a shell | 23:43 |
| dmsimard | clarkb: relevant https://github.com/willthames/ansible-lint/blob/a619b0b9bb63c79deb3a7f87fbe1a74117ce7fe6/lib/ansiblelint/rules/UseCommandInsteadOfShellRule.py | 23:44 |
| clarkb | mordred: no I mean re homedir stuff "things that arent command will operate out of ~" | 23:44 |
| mordred | clarkb: oh - sorry - things that aren't **copy** | 23:45 |
| mordred | clarkb: copy is weird with relative paths | 23:45 |
| *** markvoelker_ has joined #openstack-infra | 23:45 | |
| mordred | everything operates out of ~ on the build nodes, including but not limited to command | 23:45 |
| dmsimard | https://review.openstack.org/#/c/499007/ is good to merge whenever you want (swap partition fix) | 23:45 |
| mordred | clarkb: copy, if you give it a relative path for the dest parameter, does not put the file you're copying relative to ~ on the remote node | 23:46 |
| dmsimard | btw, with zuul v3, can a job reliably tell where it's logs are going to be uploaded ? | 23:47 |
| mordred | clarkb: instead it uses your $PWD on the executing node, constructs a path based on that + your relative path, then uses that as a remote absolute path | 23:47 |
| mordred | it's the weirdest choice I've ever seen | 23:47 |
| mordred | like- I can think of no instances where that behavior is what I would expect | 23:47 |
| mordred | but oh well | 23:47 |
| *** stakeda has joined #openstack-infra | 23:48 | |
| mordred | dmsimard: yes indeed it can | 23:48 |
| mordred | dmsimard: in fact, it's the job that does the log uploading and the job tells zuul what to report back to theuser :) | 23:48 |
| dmsimard | I was thinking, with ARA, it'd probably be possible to do something like (pseudocode) for result in $(ara task list --all |grep failed)... echo $failed_result_url | 23:48 |
| dmsimard | so that you could send users straight to the one task/result that failed | 23:48 |
| dmsimard | permalink'd | 23:48 |
| mordred | dmsimard: yah - there's a whole bunch of neat stuff along those lines we've discussed that I'm looking forward to chatting about at the PTG | 23:49 |
| *** bobh has joined #openstack-infra | 23:50 | |
| dmsimard | hell, you could even put it in the job return message | 23:50 |
| dmsimard | if a job can dynamically set it | 23:50 |
| dmsimard | so you don't need to click "logs" and then "console.html" and then "page downnnnnnnnnnnnnNN" | 23:50 |
| mordred | dmsimard: there's also "snoop the incoming subunit stream to be able to mark a test job as failing even before it's finished" | 23:50 |
| mordred | dmsimard: we will be in good position to add many many features/enhancements in this area - it'll be an exciting year | 23:51 |
| * dmsimard nods | 23:51 | |
| *** bobh has quit IRC | 23:51 | |
| mordred | clarkb: I'm happy with dmsimard's rework of fix_disk_layout but I did not +A because EOD | 23:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Add roles for adding and removing launchpadlib credentials https://review.openstack.org/498633 | 23:53 |
| *** rlandy has quit IRC | 23:53 | |
| *** ijw has quit IRC | 23:54 | |
| openstackgerrit | Merged openstack-infra/project-config master: Fix typo for playbooks/python-docs/post https://review.openstack.org/499393 | 23:56 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!