| clarkb | here we go | 00:00 |
|---|---|---|
| clarkb | mordred: do all the projects doing tox installs with constraints need to be updated like shade before we can remove the zuul cloner shim from base? | 00:00 |
| *** sdague has quit IRC | 00:01 | |
| fungi | i thought the majority of tox pip wrapper scripts we have only run zuul-cloner if it happens to be present, and can still be told directly where to find a prepared constraints file regardless | 00:01 |
| *** yamamoto has joined #openstack-infra | 00:02 | |
| *** david-lyle has quit IRC | 00:03 | |
| *** dklyle has joined #openstack-infra | 00:03 | |
| jeblair | clarkb: can you review https://review.openstack.org/521976 ? it should be simple and if we get it in the next zuul restart (soon!) it will unblock some folks | 00:03 |
| jeblair | clarkb: and its child | 00:03 |
| mordred | clarkb: yes | 00:04 |
| jeblair | jhesketh: can you take a quick look at https://review.openstack.org/523929 which fixes some points you raised? | 00:04 |
| mordred | clarkb: I made an etherpad ... | 00:04 |
| *** slaweq has joined #openstack-infra | 00:04 | |
| mordred | clarkb: https://etherpad.openstack.org/p/zuulv3-remove-zuul-cloner | 00:04 |
| clarkb | jeblair: looking | 00:04 |
| *** yuanying_ has joined #openstack-infra | 00:04 | |
| mordred | clarkb, fungi, jeblair: the majority of the projects can *totally* be migrated easily now (most of them need what shade just got) - but we need to prepare and then land that patch bomb ... which I can work on tomorrow | 00:05 |
| mordred | neutron and horizon things still need a bit more work though | 00:05 |
| *** yuanying has quit IRC | 00:05 | |
| mordred | before we can get them migrated off | 00:05 |
| *** thorst has joined #openstack-infra | 00:07 | |
| *** david-lyle has joined #openstack-infra | 00:07 | |
| *** dklyle has quit IRC | 00:08 | |
| *** hongbin has quit IRC | 00:08 | |
| *** Sukhdev has joined #openstack-infra | 00:09 | |
| *** slaweq has quit IRC | 00:09 | |
| *** Sukhdev has quit IRC | 00:10 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Honor constraints files in tox-siblings https://review.openstack.org/523949 | 00:11 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Combine tox-siblings and tox roles https://review.openstack.org/523950 | 00:11 |
| *** tosky has quit IRC | 00:11 | |
| *** thorst has quit IRC | 00:11 | |
| mordred | clarkb: basically, for neutron/horizon tox-siblings will handle it ... but we need to be able to have them specify the project in their requirements.txt in the first place so that siblings can update it from required-projects | 00:13 |
| mordred | so we're getting *much* closer - but still have a little work to do | 00:13 |
| mordred | also - making the tox_install.sh patch bomb is gonna suck - there's a bunch of minor meaningless variation :( | 00:14 |
| mordred | maybe it should be a mailing list bomb "hey, everybody, please make a patch for your project that does this" | 00:15 |
| *** edmondsw has quit IRC | 00:15 | |
| *** Sukhdev has joined #openstack-infra | 00:17 | |
| clarkb | jeblair: I +2'd both but the second doesn't ahve a second review and it looks like we want both of them to go in together | 00:17 |
| clarkb | jeblair: I'll let you decide if the bug in the first is minor enough to approve as is without approval on the second | 00:18 |
| clarkb | mordred: fungi can I get a second review on https://review.openstack.org/#/c/524016/ the way things are tested today I need that to merge before other changes will unstick | 00:18 |
| clarkb | (due to them not being entirely self testing :/ but I have other patches to help with that too) | 00:19 |
| *** ijw has quit IRC | 00:20 | |
| *** Goneri has quit IRC | 00:21 | |
| *** threestrands has quit IRC | 00:21 | |
| clarkb | mordred: gotcha so the hroizon and neutron case needs us to publish to pypi and list them as requirements basically properly solve that giant ball of problems we've ignored for years | 00:22 |
| clarkb | yay for being forced to fix problems we've known about | 00:22 |
| mordred | clarkb: done | 00:22 |
| *** ijw has joined #openstack-infra | 00:22 | |
| mordred | clarkb: and yes, exactly :) | 00:23 |
| mordred | and now - I afk | 00:23 |
| clarkb | ty | 00:23 |
| *** salv-orlando has joined #openstack-infra | 00:23 | |
| *** thorst has joined #openstack-infra | 00:25 | |
| jeblair | i think the first can go in on its own | 00:25 |
| jeblair | i +wd id | 00:25 |
| *** salv-orlando has quit IRC | 00:27 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Install fedora-gpg-keys for F27 https://review.openstack.org/521414 | 00:29 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Pre-install curl https://review.openstack.org/521415 | 00:29 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update Fedora defaults to 27 https://review.openstack.org/521684 | 00:29 |
| *** dklyle has joined #openstack-infra | 00:29 | |
| *** david-lyle has quit IRC | 00:30 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add inventory variables for checkouts https://review.openstack.org/521976 | 00:36 |
| *** trown is now known as trown|outtypewww | 00:37 | |
| jeblair | i'm going to restart zuul now to pick up recent changes | 00:38 |
| *** Sukhdev has quit IRC | 00:41 | |
| openstackgerrit | Tristan Cacqueray proposed openstack-infra/zuul feature/zuulv3: executor: add log_stream_port and log_stream_file settings https://review.openstack.org/523697 | 00:42 |
| *** yamamoto has quit IRC | 00:45 | |
| jeblair | scheduler is up and running, re-enqueue is proceeding. executors are still stopping. | 00:47 |
| jeblair | (i think the reason they are slow to stop is all of the jobdirs being deleted) | 00:48 |
| clarkb | before I forget we still need to stop the nodepoold on nodepool.o.o right? Then maybe make a new zk server? I'll probably start poking around that tomorrow | 00:52 |
| jeblair | clarkb: yep. still using zk on that server tho | 00:52 |
| clarkb | ya | 00:52 |
| *** Sukhdev has joined #openstack-infra | 00:52 | |
| clarkb | thinking if we stop zk on nodepool.o.o and copy the journal and data files over to new server and start zk there that should migrate the data. Then if we point everything at the new server it should just work (tm) | 00:53 |
| jeblair | ze3 and ze5 had a bunch of orphaned jobdirs. i'm guessing it's because of previous unclean shutdowns. i'm cleaning them up now. | 00:53 |
| clarkb | another cleanup item is to move status under status.openstack.org/zuul and update graphite graphs (as necessary) | 00:54 |
| jeblair | ze5 is particularly slow at deleting. | 00:54 |
| *** david-lyle has joined #openstack-infra | 00:55 | |
| jeblair | clarkb: i'd prefer to just continue hosting zuul's status page from the zuul server. it's about to get an entire web interface anyway. | 00:55 |
| *** dklyle has quit IRC | 00:55 | |
| clarkb | jeblair: I think thats fine but do miss the grpahs (needing to go to grafana for them is less than ideal) | 00:56 |
| clarkb | probably the cleanup there then is to rename the host to zuul.openstack.org? or cname it or similar then get ssl (back?) in place | 00:56 |
| jeblair | clarkb: yeah, we should rename or move that | 00:57 |
| jeblair | okay, executors all cleaned up, restarting them now | 00:57 |
| jeblair | clarkb: otoh, the graphite page for zuul is kind of awesome. maybe we should think about making it easier to get to. | 00:58 |
| *** ijw has quit IRC | 00:59 | |
| jeblair | jobs are running | 01:00 |
| jeblair | EmilienM, pabelanger: the fix for the branch template problem is in production | 01:01 |
| *** david-lyle has quit IRC | 01:01 | |
| clarkb | jeblair: ya maybe the dashboard can have a configurable list of links to system stats pages indepedent of the self hosted dashboard | 01:02 |
| clarkb | then we can point at cacti and grafana and so on | 01:02 |
| clarkb | (and other hosted zuuls can do whatever is appropriate for their hosting) | 01:02 |
| * clarkb does a grocery run and hopes that the last of the holiday crazyness is over. Last night was tree lighting thing at shopping center thing | 01:03 | |
| jeblair | andreaf: https://review.openstack.org/521976 should be in production now | 01:03 |
| *** thorst has quit IRC | 01:05 | |
| *** rpittau_ has joined #openstack-infra | 01:05 | |
| *** ihrachys has quit IRC | 01:06 | |
| *** rpittau has quit IRC | 01:08 | |
| *** links has joined #openstack-infra | 01:09 | |
| *** rhallisey has quit IRC | 01:14 | |
| *** smatzek has joined #openstack-infra | 01:19 | |
| *** rfolco|off has quit IRC | 01:20 | |
| *** liujiong has joined #openstack-infra | 01:20 | |
| *** mriedem has quit IRC | 01:21 | |
| *** nicolasbock has quit IRC | 01:22 | |
| *** mriedem has joined #openstack-infra | 01:23 | |
| *** smatzek has quit IRC | 01:24 | |
| *** salv-orlando has joined #openstack-infra | 01:24 | |
| *** yamamoto has joined #openstack-infra | 01:24 | |
| *** edmondsw has joined #openstack-infra | 01:24 | |
| *** rpittau__ has joined #openstack-infra | 01:25 | |
| *** armax has quit IRC | 01:26 | |
| openstackgerrit | Merged openstack-infra/system-config master: Set origin on /etc/project-config in rsepc tests https://review.openstack.org/524016 | 01:27 |
| *** yuanying_ has quit IRC | 01:29 | |
| *** salv-orlando has quit IRC | 01:29 | |
| *** rpittau_ has quit IRC | 01:29 | |
| *** edmondsw has quit IRC | 01:29 | |
| *** yuanying has joined #openstack-infra | 01:29 | |
| *** priteau has joined #openstack-infra | 01:32 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Install fedora-gpg-keys for F27 https://review.openstack.org/521414 | 01:33 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Pre-install curl https://review.openstack.org/521415 | 01:33 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update Fedora defaults to 27 https://review.openstack.org/521684 | 01:33 |
| *** yuanying_ has joined #openstack-infra | 01:33 | |
| openstackgerrit | Merged openstack-infra/shade master: de-client-ify baremetal get_machine https://review.openstack.org/499774 | 01:33 |
| *** thorst has joined #openstack-infra | 01:34 | |
| *** daidv has joined #openstack-infra | 01:34 | |
| *** thorst has quit IRC | 01:34 | |
| *** priteau has quit IRC | 01:37 | |
| *** yuanying has quit IRC | 01:37 | |
| *** sree has joined #openstack-infra | 01:40 | |
| *** sree has quit IRC | 01:46 | |
| *** kiennt26 has joined #openstack-infra | 01:47 | |
| openstackgerrit | Merged openstack-infra/shade master: Catch attrbute error for other APIs https://review.openstack.org/499775 | 01:48 |
| openstackgerrit | Merged openstack/diskimage-builder master: Make python changes more reliable https://review.openstack.org/516819 | 01:49 |
| *** Apoorva has quit IRC | 01:51 | |
| *** Apoorva has joined #openstack-infra | 01:52 | |
| *** stakeda has joined #openstack-infra | 01:52 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Clear /etc/machine-id to avoid duplicate machine-ids https://review.openstack.org/489013 | 01:56 |
| *** annp has joined #openstack-infra | 01:56 | |
| *** Apoorva has quit IRC | 01:57 | |
| *** claudiub|2 has quit IRC | 02:00 | |
| *** spzala has joined #openstack-infra | 02:01 | |
| *** spzala has quit IRC | 02:01 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Rename base and multinode integration jobs https://review.openstack.org/524039 | 02:05 |
| dmsimard | jeblair: hah, my change caught someone who used the wrong job: https://review.openstack.org/#/c/524039/ | 02:06 |
| openstackgerrit | Merged openstack/diskimage-builder master: Enable gentoo in pip-and-virtualenv element https://review.openstack.org/518999 | 02:10 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/openstack-zuul-jobs master: Rename base and multinode integration jobs https://review.openstack.org/524039 | 02:10 |
| *** namnh has joined #openstack-infra | 02:11 | |
| *** mriedem has quit IRC | 02:11 | |
| dmsimard | jeblair: oh, but you already knew that because of https://review.openstack.org/#/c/523613/ | 02:13 |
| * dmsimard goes to sleep early | 02:14 | |
| *** Apoorva has joined #openstack-infra | 02:14 | |
| *** dave-mccowan has quit IRC | 02:18 | |
| *** yamamoto has quit IRC | 02:22 | |
| *** yamamoto has joined #openstack-infra | 02:24 | |
| *** salv-orlando has joined #openstack-infra | 02:24 | |
| EmilienM | jeblair: ok, let me try again | 02:27 |
| EmilienM | is it me or https://review.openstack.org/ is down? | 02:29 |
| *** salv-orlando has quit IRC | 02:29 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 02:30 | |
| clarkb | up for me | 02:30 |
| EmilienM | infra-root^ | 02:30 |
| EmilienM | ok | 02:30 |
| EmilienM | maybe they blocked it on the Vancouver Island | 02:30 |
| EmilienM | I can ping review.openstack.org | 02:31 |
| EmilienM | but I can't reach the website | 02:31 |
| *** hongbin has joined #openstack-infra | 02:32 | |
| *** ramishra has joined #openstack-infra | 02:33 | |
| EmilienM | I can't reach http://cacti.openstack.org/cacti either | 02:33 |
| clarkb | Im on ipv4 not ipv6 here | 02:35 |
| clarkb | maybe ipv6 problem? or could just be local isp route issue | 02:35 |
| EmilienM | I tried again after clearing routes & dhcp and it works | 02:36 |
| EmilienM | probably on my side | 02:36 |
| *** Wei_Liu has joined #openstack-infra | 02:37 | |
| *** jamesmcarthur has joined #openstack-infra | 02:37 | |
| *** ramishra has quit IRC | 02:38 | |
| *** yamamoto has quit IRC | 02:40 | |
| *** gcb has joined #openstack-infra | 02:40 | |
| *** ramishra has joined #openstack-infra | 02:40 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Install fedora-gpg-keys for F27 https://review.openstack.org/521414 | 02:41 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Pre-install curl https://review.openstack.org/521415 | 02:41 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update Fedora defaults to 27 https://review.openstack.org/521684 | 02:41 |
| ianw | great firewall of Vancouver? | 02:42 |
| *** Apoorva_ has joined #openstack-infra | 02:44 | |
| *** dave-mccowan has joined #openstack-infra | 02:46 | |
| *** zhurong has joined #openstack-infra | 02:46 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Make preinstall.d more deterministic https://review.openstack.org/516821 | 02:46 |
| *** Apoorva has quit IRC | 02:47 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Make preinstall.d more deterministic https://review.openstack.org/516821 | 02:48 |
| EmilienM | ianw: lol | 02:48 |
| EmilienM | ianw: the Island's firewall :P | 02:48 |
| EmilienM | it's famous | 02:48 |
| EmilienM | jeblair: it worked !!!! | 02:49 |
| EmilienM | jeblair: thanks very much for the fix | 02:49 |
| ianw | 17-11-30 02:11:49.399535 | primary | build/temp.linux-x86_64-2.7/_openssl.c:483:30: fatal error: openssl/opensslv.h: No such file or directory | 02:50 |
| ianw | now that's a new one | 02:50 |
| ianw | http://logs.openstack.org/49/520649/1/gate/legacy-dsvm-nodepool-ubuntu-src/24ee224/job-output.txt.gz#_2017-11-30_02_11_49_399535 | 02:51 |
| ianw | i wonder if it's wheel acquisition errors, and then we don't have the deps... | 02:52 |
| *** yamahata has quit IRC | 02:54 | |
| *** iyamahat has quit IRC | 02:54 | |
| *** yamamoto has joined #openstack-infra | 02:54 | |
| *** threestrands has joined #openstack-infra | 02:55 | |
| ianw | cryptography-2.1.3-cp27-cp27mu-manylinux1_x86_64.whl (2.2MB) v cryptography-2.1.4.tar.gz | 02:56 |
| ianw | did it just release? | 02:56 |
| ianw | releases page ... "an hour ago" ... so yes is the answer | 02:57 |
| *** dhinesh_ has quit IRC | 02:57 | |
| *** thorst has joined #openstack-infra | 02:59 | |
| *** Apoorva_ has quit IRC | 03:01 | |
| ianw | i guess must have just got unlucky when there wasn't a wheel in pypi | 03:01 |
| *** Apoorva has joined #openstack-infra | 03:01 | |
| *** masber has joined #openstack-infra | 03:03 | |
| *** yamamoto has quit IRC | 03:05 | |
| *** Apoorva has quit IRC | 03:06 | |
| *** Sukhdev has quit IRC | 03:07 | |
| *** masuberu has quit IRC | 03:07 | |
| *** jamesmcarthur has quit IRC | 03:07 | |
| *** aeng has quit IRC | 03:12 | |
| *** edmondsw has joined #openstack-infra | 03:13 | |
| *** rlandy|ruck has quit IRC | 03:14 | |
| *** aeng has joined #openstack-infra | 03:15 | |
| *** raissa_ has joined #openstack-infra | 03:15 | |
| *** raissa has quit IRC | 03:16 | |
| *** edmondsw has quit IRC | 03:17 | |
| *** dougwig has quit IRC | 03:18 | |
| *** Wei_Liu has quit IRC | 03:20 | |
| *** Wei_Liu has joined #openstack-infra | 03:20 | |
| *** dhill_ has quit IRC | 03:23 | |
| *** bobh has quit IRC | 03:23 | |
| *** dhill_ has joined #openstack-infra | 03:25 | |
| *** gcb has quit IRC | 03:25 | |
| *** salv-orlando has joined #openstack-infra | 03:25 | |
| *** gcb has joined #openstack-infra | 03:26 | |
| *** e0ne has joined #openstack-infra | 03:28 | |
| *** salv-orlando has quit IRC | 03:30 | |
| *** masber has quit IRC | 03:30 | |
| *** bobh has joined #openstack-infra | 03:31 | |
| *** e0ne has quit IRC | 03:32 | |
| *** priteau has joined #openstack-infra | 03:33 | |
| *** masber has joined #openstack-infra | 03:34 | |
| *** jamesmcarthur has joined #openstack-infra | 03:38 | |
| *** priteau has quit IRC | 03:38 | |
| *** jamesmcarthur has quit IRC | 03:43 | |
| *** thorst has quit IRC | 03:46 | |
| *** zhurong has quit IRC | 03:46 | |
| *** greghaynes has joined #openstack-infra | 03:49 | |
| *** d0ugal_ has joined #openstack-infra | 03:50 | |
| *** d0ugal has quit IRC | 03:52 | |
| *** e0ne has joined #openstack-infra | 03:55 | |
| *** greghaynes has quit IRC | 03:57 | |
| *** greghaynes has joined #openstack-infra | 03:58 | |
| *** bobh has quit IRC | 03:58 | |
| *** stakeda has quit IRC | 03:59 | |
| openstackgerrit | Andreas Florath proposed openstack/diskimage-builder master: Docker matrix build https://review.openstack.org/414347 | 04:00 |
| *** e0ne has quit IRC | 04:00 | |
| *** cuongnv has joined #openstack-infra | 04:02 | |
| *** Wei_Liu has quit IRC | 04:06 | |
| *** dave-mccowan has quit IRC | 04:07 | |
| *** Wei_Liu has joined #openstack-infra | 04:07 | |
| *** gcb has quit IRC | 04:09 | |
| *** iyamahat has joined #openstack-infra | 04:10 | |
| *** e0ne has joined #openstack-infra | 04:11 | |
| *** sree has joined #openstack-infra | 04:11 | |
| *** e0ne has quit IRC | 04:16 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Install fedora-gpg-keys for F27 https://review.openstack.org/521414 | 04:16 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Pre-install curl https://review.openstack.org/521415 | 04:16 |
| *** Apoorva has joined #openstack-infra | 04:16 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Update Fedora defaults to 27 https://review.openstack.org/521684 | 04:16 |
| *** thorst has joined #openstack-infra | 04:16 | |
| *** coolsvap has joined #openstack-infra | 04:19 | |
| *** hongbin has quit IRC | 04:20 | |
| *** psachin has joined #openstack-infra | 04:20 | |
| *** udesale has joined #openstack-infra | 04:21 | |
| *** thorst has quit IRC | 04:22 | |
| *** e0ne has joined #openstack-infra | 04:23 | |
| *** dbecker has quit IRC | 04:24 | |
| *** thorst has joined #openstack-infra | 04:25 | |
| *** yamahata has joined #openstack-infra | 04:26 | |
| *** salv-orlando has joined #openstack-infra | 04:26 | |
| *** e0ne has quit IRC | 04:28 | |
| *** thorst has quit IRC | 04:29 | |
| *** salv-orlando has quit IRC | 04:30 | |
| openstackgerrit | Merged openstack/diskimage-builder master: elements: zypper-minimal: Refresh repositories where necessary https://review.openstack.org/520649 | 04:36 |
| *** priteau has joined #openstack-infra | 04:37 | |
| *** dbecker has joined #openstack-infra | 04:39 | |
| *** jamesmcarthur has joined #openstack-infra | 04:39 | |
| *** e0ne has joined #openstack-infra | 04:39 | |
| *** Jeffrey4l has quit IRC | 04:42 | |
| *** priteau has quit IRC | 04:43 | |
| *** rosmaita has quit IRC | 04:43 | |
| *** e0ne has quit IRC | 04:44 | |
| *** jamesmcarthur has quit IRC | 04:46 | |
| *** ykarel has joined #openstack-infra | 04:47 | |
| StevenK | tonyb: https://bugs.launchpad.net/manila/+bug/1730529 has been solved now, what do you think about a backport? | 04:48 |
| openstack | Launchpad bug 1730529 in Manila "Running Pike manila-api directly with SSL does not speak SSL" [Undecided,Fix released] - Assigned to junboli (junboli) | 04:48 |
| *** e0ne has joined #openstack-infra | 04:50 | |
| tonyb | StevenK: I need to look at that more carefully, as the patch doesn't make sense. (unless the ssl_ca options were already deprecated) | 04:53 |
| tonyb | StevenK: I assume there isn't a way to know to use_ssl with a config option chnage? | 04:53 |
| *** stakeda has joined #openstack-infra | 04:54 | |
| *** thorst has joined #openstack-infra | 04:55 | |
| StevenK | tonyb: I don't think they were -- do you think a follow-up patch to master to actually add them back and say oh hey, these aren't used, do <x>? | 04:56 |
| *** Sukhdev has joined #openstack-infra | 04:57 | |
| *** thorst has quit IRC | 04:57 | |
| tonyb | StevenK: let me dig | 04:58 |
| tonyb | Oh it looks like they got droped in If8a1b1f7e961d35fca368f8c73ef8bcbd0718742 | 05:00 |
| *** xinliang has quit IRC | 05:00 | |
| *** xinliang has joined #openstack-infra | 05:01 | |
| StevenK | Their use, or the docs that mentioned their use? | 05:01 |
| tonyb | StevenK: use? check the commit message of 77a8b6cc546bf7a05174935f01c8db8b7de87151 | 05:02 |
| *** e0ne has quit IRC | 05:03 | |
| *** Jeffrey4l has joined #openstack-infra | 05:04 | |
| StevenK | If it's the commit I'm thinking of that adds WSGI support, yeah, that's when they were dropped | 05:05 |
| tonyb | StevenK: Gah now I'm reading oslo.service ;P | 05:07 |
| *** e0ne has joined #openstack-infra | 05:07 | |
| *** armaan has quit IRC | 05:08 | |
| *** armaan has joined #openstack-infra | 05:09 | |
| StevenK | tonyb: I'm sorry | 05:09 |
| tonyb | StevenK: ;P | 05:10 |
| tonyb | StevenK: Looks fine to backport to me. | 05:12 |
| *** e0ne has quit IRC | 05:12 | |
| tonyb | StevenK: it would be *much* better if it guessed about SSL based on the state of ca_file/cert_file/key_file but that isn't what happend | 05:12 |
| tonyb | and it's better to have a fix on pike than cranky operators | 05:13 |
| StevenK | oslo.service, manila, or both? | 05:13 |
| tonyb | StevenK: https://review.openstack.org/#/c/519206 | 05:13 |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Enable support for Gentoo overlays https://review.openstack.org/516823 | 05:14 |
| *** pgadiya has joined #openstack-infra | 05:14 | |
| tonyb | that relies on stuff that's already on pike (for manila) which implies that the oslo.service chnage is also there | 05:14 |
| tonyb | oslo.service does the rigth thing with deprecating the old SSL options so +1 all good | 05:14 |
| StevenK | Oh right, yes. Continue using the same options and use an or guard in the code | 05:14 |
| StevenK | tonyb: The only thing that I think is missing is a release note | 05:15 |
| tonyb | StevenK: Yup, add a rlease note on master and then backport both changes, if you're super keen ;P | 05:15 |
| *** e0ne has joined #openstack-infra | 05:17 | |
| *** janki has joined #openstack-infra | 05:21 | |
| *** e0ne has quit IRC | 05:22 | |
| StevenK | tonyb: Hmmm, never actually used reno befoe | 05:23 |
| StevenK | *before | 05:23 |
| *** pgadiya has quit IRC | 05:23 | |
| tonyb | StevenK: hehe I did it once it wasn't terrible "reno slug" or similar IIRC | 05:24 |
| StevenK | tonyb: I've got an idea of the prose in my head, and that I need to use upgrade: but I'm unsure where the sha1 on the end of the filename comes from | 05:25 |
| *** Sukhdev has quit IRC | 05:25 | |
| *** salv-orlando has joined #openstack-infra | 05:27 | |
| *** hrubi has quit IRC | 05:29 | |
| *** bhavik1 has joined #openstack-infra | 05:29 | |
| *** e0ne has joined #openstack-infra | 05:30 | |
| tonyb | StevenK: /me has no idea | 05:30 |
| *** hrubi has joined #openstack-infra | 05:30 | |
| * StevenK has found some docs | 05:30 | |
| *** thorst has joined #openstack-infra | 05:31 | |
| *** armax has joined #openstack-infra | 05:31 | |
| *** salv-orlando has quit IRC | 05:32 | |
| StevenK | And I found a bug in reno | 05:33 |
| StevenK | Well, I would consider it one :-P | 05:33 |
| *** e0ne has quit IRC | 05:35 | |
| *** thorst has quit IRC | 05:35 | |
| *** e0ne has joined #openstack-infra | 05:38 | |
| *** yamamoto has joined #openstack-infra | 05:39 | |
| *** kiennt26 has quit IRC | 05:40 | |
| *** yamamoto has quit IRC | 05:43 | |
| *** e0ne has quit IRC | 05:43 | |
| *** e0ne has joined #openstack-infra | 05:45 | |
| *** mikal has quit IRC | 05:47 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Make preinstall.d more deterministic https://review.openstack.org/516821 | 05:50 |
| *** e0ne has quit IRC | 05:51 | |
| *** yamamoto has joined #openstack-infra | 05:53 | |
| *** mikal has joined #openstack-infra | 05:55 | |
| *** armaan has quit IRC | 05:56 | |
| *** armaan has joined #openstack-infra | 05:57 | |
| *** yamamoto has quit IRC | 05:57 | |
| *** e0ne has joined #openstack-infra | 05:57 | |
| *** udesale__ has joined #openstack-infra | 06:01 | |
| *** ykarel_ has joined #openstack-infra | 06:02 | |
| *** e0ne has quit IRC | 06:02 | |
| *** cshastri has joined #openstack-infra | 06:03 | |
| *** armaan has quit IRC | 06:03 | |
| *** e0ne has joined #openstack-infra | 06:04 | |
| *** udesale has quit IRC | 06:04 | |
| *** ykarel has quit IRC | 06:04 | |
| *** pcaruana has joined #openstack-infra | 06:05 | |
| *** mikal_ has joined #openstack-infra | 06:06 | |
| *** armax has quit IRC | 06:07 | |
| *** thorst has joined #openstack-infra | 06:07 | |
| *** e0ne has quit IRC | 06:09 | |
| *** mikal has quit IRC | 06:10 | |
| *** armax has joined #openstack-infra | 06:10 | |
| *** kiennt26 has joined #openstack-infra | 06:12 | |
| *** thorst has quit IRC | 06:12 | |
| *** salv-orlando has joined #openstack-infra | 06:12 | |
| *** Apoorva has quit IRC | 06:14 | |
| *** Guest72929 has joined #openstack-infra | 06:15 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/project-config master: Shift shade IRC activity to openstack-sdks https://review.openstack.org/523556 | 06:15 |
| *** e0ne has joined #openstack-infra | 06:15 | |
| *** jbadiapa has quit IRC | 06:15 | |
| *** pcaruana has quit IRC | 06:16 | |
| *** e0ne has quit IRC | 06:20 | |
| *** aeng has quit IRC | 06:21 | |
| *** e0ne has joined #openstack-infra | 06:24 | |
| *** e0ne has quit IRC | 06:29 | |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Do pep8 housekeeping according to zuul rules https://review.openstack.org/522945 | 06:29 |
| openstackgerrit | Tobias Henkel proposed openstack-infra/nodepool feature/zuulv3: Use same flake8 config as in zuul https://review.openstack.org/509715 | 06:29 |
| *** yamamoto has joined #openstack-infra | 06:31 | |
| Wei_Liu | hi | 06:32 |
| Wei_Liu | hello | 06:33 |
| *** rwsu has joined #openstack-infra | 06:33 | |
| chandankumar | AJaeger: hello | 06:34 |
| chandankumar | AJaeger: please have a look at these two reviews https://review.openstack.org/#/c/514273/ and https://review.openstack.org/#/c/514271/ | 06:35 |
| Wei_Liu | I got a problem when I try to start zuul-executor as zuul user, if I start it in no daemon mode with "-d", there is no error, every thing worked fine. But if I start it in daemon mode, I got error message like: Cmd('git') failed due to: exit code(-13). any idea? | 06:36 |
| *** armax has quit IRC | 06:40 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Enable support for Gentoo overlays https://review.openstack.org/516823 | 06:40 |
| *** xinliang has quit IRC | 06:41 | |
| *** masuberu has joined #openstack-infra | 06:42 | |
| *** jamesmcarthur has joined #openstack-infra | 06:42 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/project-config master: Fix handling of locked channels in access check https://review.openstack.org/524075 | 06:43 |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/project-config master: DNM: Dummy patch to trigger irc check https://review.openstack.org/524076 | 06:43 |
| *** yamamoto has quit IRC | 06:43 | |
| *** mikal_ has quit IRC | 06:45 | |
| *** masber has quit IRC | 06:46 | |
| Wei_Liu | AJaeger: hello | 06:46 |
| *** thorst has joined #openstack-infra | 06:46 | |
| Wei_Liu | I got a problem when I try to start zuul-executor as zuul user, if I start it in no daemon mode with "-d", there is no error, every thing worked fine. But if I start it in daemon mode, I got error message like: Cmd('git') failed due to: exit code(-13). any idea? | 06:46 |
| *** mikal has joined #openstack-infra | 06:47 | |
| Wei_Liu | AJaeger: I got a problem when I try to start zuul-executor as zuul user, if I start it in no daemon mode with "-d", there is no error, every thing worked fine. But if I start it in daemon mode, I got error message like: Cmd('git') failed due to: exit code(-13). any idea? | 06:47 |
| *** jamesmcarthur has quit IRC | 06:48 | |
| *** armax has joined #openstack-infra | 06:48 | |
| *** andreas_s has joined #openstack-infra | 06:49 | |
| *** edmondsw has joined #openstack-infra | 06:49 | |
| *** threestrands has quit IRC | 06:50 | |
| *** thorst has quit IRC | 06:51 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Drop legacy-horizon-dsvm-tempest-plugin https://review.openstack.org/524079 | 06:54 |
| *** xinliang has joined #openstack-infra | 06:54 | |
| *** edmondsw has quit IRC | 06:54 | |
| *** Guest72929 has quit IRC | 06:56 | |
| *** Guest72929 has joined #openstack-infra | 06:56 | |
| openstackgerrit | Jens Harbott (frickler) proposed openstack-infra/project-config master: Fix handling of locked channels in access check https://review.openstack.org/524075 | 06:57 |
| frickler | config-core: ^^ fixes an issue discovered in https://review.openstack.org/523556 | 06:58 |
| *** yamamoto has joined #openstack-infra | 06:59 | |
| *** Guest72929 has left #openstack-infra | 07:01 | |
| *** yamamoto has quit IRC | 07:06 | |
| *** armax has quit IRC | 07:11 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Revert "Fix #1627402: fix grub2 element for ubuntu xenial" https://review.openstack.org/524019 | 07:11 |
| *** andreas_s has quit IRC | 07:12 | |
| *** andreas_s has joined #openstack-infra | 07:13 | |
| *** andreas_s has quit IRC | 07:14 | |
| *** andreas_s has joined #openstack-infra | 07:14 | |
| openstackgerrit | Ian Wienand proposed openstack/diskimage-builder master: Add the groundwork for musl profile support https://review.openstack.org/516844 | 07:17 |
| *** david-lyle has joined #openstack-infra | 07:19 | |
| *** dhajare has joined #openstack-infra | 07:19 | |
| *** rcernin has quit IRC | 07:20 | |
| *** thorst has joined #openstack-infra | 07:20 | |
| *** gouthamr has quit IRC | 07:20 | |
| *** rwsu has quit IRC | 07:22 | |
| *** ramishra has quit IRC | 07:22 | |
| frickler | mordred: the redirect for the shade channel doesn't work, instead I'm getting "Cannot join to channel #openstack-shade (You must be invited)" | 07:24 |
| *** thorst has quit IRC | 07:25 | |
| frickler | might be the last step in the renaming instructions "set PRIVATE ON" is actually wrong | 07:25 |
| *** ramishra has joined #openstack-infra | 07:26 | |
| *** jtomasek has joined #openstack-infra | 07:28 | |
| *** jtomasek has joined #openstack-infra | 07:28 | |
| *** ijw has joined #openstack-infra | 07:28 | |
| *** rwsu has joined #openstack-infra | 07:35 | |
| *** florianf|afk is now known as florianf | 07:35 | |
| *** andreas_s has quit IRC | 07:36 | |
| *** andreas_s has joined #openstack-infra | 07:37 | |
| *** sboyron has joined #openstack-infra | 07:37 | |
| *** markvoelker has quit IRC | 07:37 | |
| *** udesale has joined #openstack-infra | 07:38 | |
| *** andreas_s has quit IRC | 07:38 | |
| *** yamahata has quit IRC | 07:38 | |
| *** andreas_s has joined #openstack-infra | 07:39 | |
| *** jbadiapa has joined #openstack-infra | 07:39 | |
| *** udesale__ has quit IRC | 07:39 | |
| *** ykarel__ has joined #openstack-infra | 07:42 | |
| *** ykarel__ is now known as ykarellunch | 07:42 | |
| *** ykarel_ has quit IRC | 07:45 | |
| *** armaan has joined #openstack-infra | 07:48 | |
| *** yamamoto has joined #openstack-infra | 07:49 | |
| *** yamamoto has quit IRC | 07:51 | |
| *** thorst has joined #openstack-infra | 07:52 | |
| *** sboyron has quit IRC | 07:52 | |
| *** martinkopec has joined #openstack-infra | 07:53 | |
| *** ralonsoh has joined #openstack-infra | 07:53 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Install fedora-gpg-keys for F27 https://review.openstack.org/521414 | 07:54 |
| *** pcaruana has joined #openstack-infra | 07:55 | |
| *** thorst has quit IRC | 07:57 | |
| *** yamamoto has joined #openstack-infra | 07:57 | |
| *** ijw has quit IRC | 08:04 | |
| *** ijw has joined #openstack-infra | 08:05 | |
| *** slaweq has joined #openstack-infra | 08:06 | |
| *** rcernin has joined #openstack-infra | 08:07 | |
| openstackgerrit | Rico Lin proposed openstack-infra/nodepool master: Fix getProviderManager in alien_list https://review.openstack.org/524092 | 08:08 |
| *** ijw has quit IRC | 08:09 | |
| *** jaosorior has quit IRC | 08:13 | |
| *** LindaWang1 has joined #openstack-infra | 08:15 | |
| Jeffrey4l | infra-core, is it possible that re-use another projects role in zuulv3? just like use roles: zuul:xxx | 08:16 |
| openstackgerrit | Merged openstack/diskimage-builder master: Pre-install curl https://review.openstack.org/521415 | 08:16 |
| *** makowals has quit IRC | 08:16 | |
| *** alexchadin has joined #openstack-infra | 08:17 | |
| *** e0ne has joined #openstack-infra | 08:18 | |
| *** kiennt26 has quit IRC | 08:21 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: [WIP] Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 08:21 |
| *** claudiub has joined #openstack-infra | 08:22 | |
| *** kiennt26 has joined #openstack-infra | 08:25 | |
| *** sree_ has joined #openstack-infra | 08:26 | |
| *** sree_ is now known as Guest88184 | 08:26 | |
| AJaeger | Jeffrey4l: yes, exactly | 08:27 |
| Jeffrey4l | cool. i will try this. thanks. | 08:27 |
| *** thorst has joined #openstack-infra | 08:27 | |
| Wei_Liu | infra-core, I got a problem when I try to start zuul-executor as zuul user, if I start it in no daemon mode with "-d", there is no error, every thing worked fine. But if I start it in daemon mode, I got error message like: Cmd('git') failed due to: exit code(-13). any idea? | 08:27 |
| *** slaweq has quit IRC | 08:27 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: [WIP] Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 08:28 |
| AJaeger | Jeffrey4l: check how project-config does it in zuul.d/jobs.yaml | 08:28 |
| *** sree has quit IRC | 08:28 | |
| AJaeger | Wei_Liu: Looks like nobody is around to help you currently, the team normally reads backscroll and will answer. You might need help from the US based team... | 08:29 |
| Wei_Liu | AJaeger: ok, I will post my question later. Thanks | 08:29 |
| *** slaweq has joined #openstack-infra | 08:31 | |
| *** thorst has quit IRC | 08:32 | |
| *** yamamoto has quit IRC | 08:33 | |
| *** jaosorior has joined #openstack-infra | 08:34 | |
| *** makowals has joined #openstack-infra | 08:36 | |
| *** alexchadin has quit IRC | 08:36 | |
| *** edmondsw has joined #openstack-infra | 08:38 | |
| *** armaan has quit IRC | 08:38 | |
| *** markvoelker has joined #openstack-infra | 08:38 | |
| frickler | infra-root: #openstack-meeting has a stuck meeting topic, can someone fix that please? | 08:38 |
| *** armaan has joined #openstack-infra | 08:39 | |
| *** priteau has joined #openstack-infra | 08:40 | |
| *** yamamoto has joined #openstack-infra | 08:40 | |
| *** gmann is now known as gmann_afk | 08:41 | |
| *** slaweq has quit IRC | 08:41 | |
| *** edmondsw has quit IRC | 08:42 | |
| *** slaweq has joined #openstack-infra | 08:44 | |
| *** jpena|off is now known as jpena | 08:44 | |
| *** yamamoto has quit IRC | 08:44 | |
| *** ykarellunch is now known as ykarel | 08:45 | |
| *** priteau has quit IRC | 08:45 | |
| *** alexchadin has joined #openstack-infra | 08:49 | |
| *** amoralej|off is now known as amoralej | 08:50 | |
| *** iyamahat has quit IRC | 08:52 | |
| *** ccamacho has joined #openstack-infra | 08:52 | |
| openstackgerrit | Juan Antonio Osorio Robles proposed openstack-infra/project-config master: Add tripleo-ipsec to zuul.d/projects.yaml https://review.openstack.org/523125 | 08:55 |
| *** jpich has joined #openstack-infra | 08:55 | |
| *** Hal has joined #openstack-infra | 08:57 | |
| *** bhavik1 has quit IRC | 08:57 | |
| *** armaan has quit IRC | 08:58 | |
| *** thorst has joined #openstack-infra | 09:00 | |
| *** ccamacho has quit IRC | 09:02 | |
| *** Hal has quit IRC | 09:03 | |
| *** yamamoto has joined #openstack-infra | 09:04 | |
| *** ccamacho has joined #openstack-infra | 09:05 | |
| *** thorst has quit IRC | 09:05 | |
| *** ccamacho has quit IRC | 09:06 | |
| *** ccamacho has joined #openstack-infra | 09:06 | |
| *** Hal has joined #openstack-infra | 09:07 | |
| *** adisky_ has joined #openstack-infra | 09:08 | |
| *** jascott1 has quit IRC | 09:11 | |
| *** jascott1 has joined #openstack-infra | 09:12 | |
| *** sboyron has joined #openstack-infra | 09:13 | |
| *** jascott1 has quit IRC | 09:16 | |
| *** rossella_s has joined #openstack-infra | 09:16 | |
| *** d0ugal_ has quit IRC | 09:17 | |
| *** d0ugal has joined #openstack-infra | 09:18 | |
| *** d0ugal has quit IRC | 09:18 | |
| *** d0ugal has joined #openstack-infra | 09:18 | |
| *** yamamoto has quit IRC | 09:19 | |
| *** namnh has quit IRC | 09:21 | |
| *** sree has joined #openstack-infra | 09:28 | |
| *** andreas_s has quit IRC | 09:29 | |
| *** andreas_s has joined #openstack-infra | 09:29 | |
| *** Guest88184 has quit IRC | 09:30 | |
| *** udesale has quit IRC | 09:31 | |
| openstackgerrit | Merged openstack/diskimage-builder master: Add the groundwork for musl profile support https://review.openstack.org/516844 | 09:31 |
| *** udesale has joined #openstack-infra | 09:31 | |
| *** thorst has joined #openstack-infra | 09:32 | |
| *** liujiong has quit IRC | 09:33 | |
| *** liujiong has joined #openstack-infra | 09:34 | |
| *** andreas_s has quit IRC | 09:34 | |
| *** andreas_s has joined #openstack-infra | 09:35 | |
| *** alexchad_ has joined #openstack-infra | 09:36 | |
| *** thorst has quit IRC | 09:37 | |
| *** asettle_ has joined #openstack-infra | 09:38 | |
| *** EmilienM_ has joined #openstack-infra | 09:39 | |
| *** asettle has quit IRC | 09:39 | |
| *** alexchadin has quit IRC | 09:39 | |
| *** EmilienM has quit IRC | 09:39 | |
| *** andymccr has quit IRC | 09:39 | |
| *** pcaruana has quit IRC | 09:39 | |
| *** AJaeger has quit IRC | 09:39 | |
| *** anthonyper has quit IRC | 09:39 | |
| *** anthonyper_ has joined #openstack-infra | 09:39 | |
| *** andreas_s has quit IRC | 09:39 | |
| *** AJaeger has joined #openstack-infra | 09:39 | |
| *** anthonyper_ is now known as anthonyper | 09:40 | |
| *** lucas-afk is now known as lucasagomes | 09:40 | |
| *** pcaruana has joined #openstack-infra | 09:40 | |
| *** EmilienM_ is now known as EmilienM | 09:40 | |
| *** andymccr has joined #openstack-infra | 09:40 | |
| *** e0ne has quit IRC | 09:40 | |
| *** EmilienM has quit IRC | 09:41 | |
| *** EmilienM has joined #openstack-infra | 09:41 | |
| *** liujiong has quit IRC | 09:42 | |
| *** armaan has joined #openstack-infra | 09:43 | |
| *** hughhalf has quit IRC | 09:43 | |
| *** liujiong has joined #openstack-infra | 09:43 | |
| *** liujiong has quit IRC | 09:43 | |
| *** cshastri has quit IRC | 09:43 | |
| *** hughhalf has joined #openstack-infra | 09:44 | |
| *** armaan_ has joined #openstack-infra | 09:45 | |
| *** chason has quit IRC | 09:45 | |
| *** chason has joined #openstack-infra | 09:45 | |
| *** tosky has joined #openstack-infra | 09:45 | |
| *** david-lyle has quit IRC | 09:46 | |
| *** hashar has joined #openstack-infra | 09:47 | |
| *** armaan has quit IRC | 09:48 | |
| *** coolsvap has quit IRC | 09:59 | |
| *** LindaWang1 has quit IRC | 09:59 | |
| *** electrofelix has joined #openstack-infra | 10:00 | |
| *** armaan has joined #openstack-infra | 10:01 | |
| *** e0ne has joined #openstack-infra | 10:01 | |
| *** lathiat_ has joined #openstack-infra | 10:02 | |
| *** gaelL_ has joined #openstack-infra | 10:03 | |
| *** danpawlik_ has joined #openstack-infra | 10:03 | |
| *** abelur_ has quit IRC | 10:04 | |
| *** migi_ has joined #openstack-infra | 10:04 | |
| *** abelur_ has joined #openstack-infra | 10:04 | |
| *** armaan_ has quit IRC | 10:05 | |
| *** lewo`` has joined #openstack-infra | 10:06 | |
| *** anthonyper has quit IRC | 10:08 | |
| *** MasterofJOKers has quit IRC | 10:09 | |
| *** MasterofJOKers has joined #openstack-infra | 10:09 | |
| *** danpawlik has quit IRC | 10:09 | |
| *** Kevin_Zheng has quit IRC | 10:09 | |
| *** fmccrthy has quit IRC | 10:09 | |
| *** xgerman_ has quit IRC | 10:09 | |
| *** kklimonda has quit IRC | 10:09 | |
| *** kong has quit IRC | 10:09 | |
| *** berendt has quit IRC | 10:09 | |
| *** zhenguo has quit IRC | 10:09 | |
| *** dgonzalez has quit IRC | 10:09 | |
| *** khappone has quit IRC | 10:09 | |
| *** peterlisak has quit IRC | 10:09 | |
| *** dtantsur|afk has quit IRC | 10:09 | |
| *** tommylikehu has quit IRC | 10:09 | |
| *** lewo` has quit IRC | 10:09 | |
| *** gaelL has quit IRC | 10:09 | |
| *** migi has quit IRC | 10:09 | |
| *** lathiat has quit IRC | 10:09 | |
| *** arxcruz has quit IRC | 10:10 | |
| *** sree has quit IRC | 10:10 | |
| *** peterlisak has joined #openstack-infra | 10:10 | |
| *** anthonyper has joined #openstack-infra | 10:11 | |
| *** sree has joined #openstack-infra | 10:12 | |
| *** dtantsur has joined #openstack-infra | 10:15 | |
| *** Kevin_Zheng has joined #openstack-infra | 10:15 | |
| *** fmccrthy has joined #openstack-infra | 10:15 | |
| *** xgerman_ has joined #openstack-infra | 10:15 | |
| *** kklimonda has joined #openstack-infra | 10:15 | |
| *** kong has joined #openstack-infra | 10:15 | |
| *** berendt has joined #openstack-infra | 10:15 | |
| *** zhenguo has joined #openstack-infra | 10:15 | |
| *** dgonzalez has joined #openstack-infra | 10:15 | |
| *** khappone has joined #openstack-infra | 10:15 | |
| *** tommylikehu has joined #openstack-infra | 10:15 | |
| *** tommylikehu has quit IRC | 10:15 | |
| *** dtantsur has quit IRC | 10:15 | |
| *** dtantsur has joined #openstack-infra | 10:15 | |
| *** tommylikehu has joined #openstack-infra | 10:15 | |
| *** cuongnv has quit IRC | 10:15 | |
| *** armaan has quit IRC | 10:15 | |
| *** udesale has quit IRC | 10:16 | |
| *** sree has quit IRC | 10:16 | |
| *** arxcruz has joined #openstack-infra | 10:17 | |
| *** jesusaur has quit IRC | 10:17 | |
| *** MasterofJOKers has quit IRC | 10:17 | |
| *** ganso has joined #openstack-infra | 10:18 | |
| *** calbers has quit IRC | 10:18 | |
| *** stakeda has quit IRC | 10:19 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 10:20 |
| *** MasterofJOKers has joined #openstack-infra | 10:20 | |
| *** Wei_Liu has quit IRC | 10:20 | |
| *** Wei_Liu has joined #openstack-infra | 10:20 | |
| *** kiennt26 has quit IRC | 10:21 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 10:22 |
| *** calbers has joined #openstack-infra | 10:22 | |
| *** jesusaur has joined #openstack-infra | 10:22 | |
| *** annp has quit IRC | 10:23 | |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/project-config master: Drop legacy-horizon-dsvm-tempest-plugin https://review.openstack.org/524079 | 10:29 |
| openstackgerrit | Akihiro Motoki proposed openstack-infra/openstack-zuul-jobs master: Drop legacy-horizon-dsvm-tempest-plugin https://review.openstack.org/524124 | 10:30 |
| *** ramishra has quit IRC | 10:30 | |
| *** ramishra has joined #openstack-infra | 10:33 | |
| *** cshastri has joined #openstack-infra | 10:35 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config master: Add ansible-role-k8s-glance https://review.openstack.org/524129 | 10:35 |
| *** daidv has quit IRC | 10:35 | |
| *** salv-orlando has quit IRC | 10:36 | |
| *** sboyron has quit IRC | 10:37 | |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config master: Add ansible-role-k8s-glance to zuul.d https://review.openstack.org/524131 | 10:38 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config master: Add ansible-role-k8s-glance https://review.openstack.org/524129 | 10:41 |
| openstackgerrit | Flavio Percoco proposed openstack-infra/project-config master: Add ansible-role-k8s-glance to zuul.d https://review.openstack.org/524131 | 10:41 |
| *** wolverineav has joined #openstack-infra | 10:44 | |
| *** ldnunes has joined #openstack-infra | 10:44 | |
| *** derekh has joined #openstack-infra | 10:45 | |
| AJaeger | chandankumar: please rebase https://review.openstack.org/#/c/514273/ | 10:45 |
| *** thorst has joined #openstack-infra | 10:45 | |
| *** salv-orlando has joined #openstack-infra | 10:48 | |
| *** sshnaidm|off is now known as sshnaidm|rover | 10:48 | |
| *** masuberu has quit IRC | 10:49 | |
| *** thorst has quit IRC | 10:50 | |
| *** andreas_s has joined #openstack-infra | 10:52 | |
| *** pblaho has joined #openstack-infra | 10:54 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 10:55 | |
| *** rfolco|off has joined #openstack-infra | 11:01 | |
| *** sdague has joined #openstack-infra | 11:02 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/gear master: Implement ECHO_REQ based keepalive for connections https://review.openstack.org/521867 | 11:02 |
| *** jamesmcarthur has joined #openstack-infra | 11:03 | |
| *** ilpianista_ has quit IRC | 11:06 | |
| *** jamesmcarthur has quit IRC | 11:08 | |
| *** efried has quit IRC | 11:10 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy designateclient jobs https://review.openstack.org/523882 | 11:11 |
| *** jlk has quit IRC | 11:12 | |
| *** jlk has joined #openstack-infra | 11:12 | |
| *** jlk has quit IRC | 11:13 | |
| *** jlk has joined #openstack-infra | 11:13 | |
| *** aspiers[m] has quit IRC | 11:13 | |
| *** masayukig[m] has quit IRC | 11:14 | |
| *** efried has joined #openstack-infra | 11:14 | |
| andreaf | jeblair: cool thanks | 11:15 |
| *** salv-orlando has quit IRC | 11:18 | |
| *** priteau has joined #openstack-infra | 11:23 | |
| *** thorst has joined #openstack-infra | 11:24 | |
| *** gongysh has joined #openstack-infra | 11:24 | |
| *** katkapilatova has joined #openstack-infra | 11:28 | |
| *** thorst has quit IRC | 11:28 | |
| *** katkapilatova has left #openstack-infra | 11:28 | |
| *** katkapilatova has joined #openstack-infra | 11:29 | |
| *** jesusaur has quit IRC | 11:30 | |
| *** jesusaur has joined #openstack-infra | 11:32 | |
| *** salv-orlando has joined #openstack-infra | 11:32 | |
| *** jkilpatr has quit IRC | 11:37 | |
| *** sboyron has joined #openstack-infra | 11:42 | |
| *** sree has joined #openstack-infra | 11:45 | |
| *** alexchad_ has quit IRC | 11:47 | |
| *** udesale has joined #openstack-infra | 11:47 | |
| *** alexchadin has joined #openstack-infra | 11:47 | |
| *** ramishra has quit IRC | 11:48 | |
| *** ramishra has joined #openstack-infra | 11:49 | |
| *** mat128 has joined #openstack-infra | 11:49 | |
| *** sree has quit IRC | 11:50 | |
| *** rcernin has quit IRC | 11:52 | |
| *** stevebaker has quit IRC | 11:52 | |
| *** rossella_s has quit IRC | 11:54 | |
| *** rossella_s has joined #openstack-infra | 11:55 | |
| *** stevebaker has joined #openstack-infra | 11:55 | |
| *** nicolasbock has joined #openstack-infra | 11:55 | |
| *** thorst has joined #openstack-infra | 11:55 | |
| openstackgerrit | Athlan-Guyot sofer proposed openstack-infra/tripleo-ci master: Make sure we collect var/lib/heat-config directory. https://review.openstack.org/523388 | 11:56 |
| *** jkilpatr has joined #openstack-infra | 11:56 | |
| *** amoralej is now known as amoralej|lunch | 11:57 | |
| *** sboyron has quit IRC | 11:58 | |
| *** jpena is now known as jpena|lunch | 11:59 | |
| *** thorst has quit IRC | 12:01 | |
| *** alexchadin has quit IRC | 12:01 | |
| openstackgerrit | Chandan Kumar proposed openstack-infra/project-config master: Remove legacy tempest-tox-plugin-sanity-check jobs https://review.openstack.org/514273 | 12:03 |
| *** rfolco|off is now known as rfolco | 12:04 | |
| *** jamesmcarthur has joined #openstack-infra | 12:04 | |
| *** dave-mccowan has joined #openstack-infra | 12:07 | |
| *** jamesmcarthur has quit IRC | 12:08 | |
| *** andreas_s has quit IRC | 12:09 | |
| *** andreas_s has joined #openstack-infra | 12:09 | |
| *** coolsvap has joined #openstack-infra | 12:10 | |
| *** andreas_s has quit IRC | 12:13 | |
| *** edmondsw has joined #openstack-infra | 12:14 | |
| *** jkilpatr has quit IRC | 12:14 | |
| *** jkilpatr has joined #openstack-infra | 12:17 | |
| *** alexchadin has joined #openstack-infra | 12:19 | |
| *** eharney has joined #openstack-infra | 12:19 | |
| *** andreas_s has joined #openstack-infra | 12:20 | |
| *** edmondsw has quit IRC | 12:20 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove legacy tempest-tox-plugin-sanity-check jobs https://review.openstack.org/514273 | 12:22 |
| *** andreas_s has quit IRC | 12:25 | |
| *** masayukig[m] has joined #openstack-infra | 12:25 | |
| *** jchhatbar has joined #openstack-infra | 12:26 | |
| *** jchhatbar has quit IRC | 12:26 | |
| *** bobh has joined #openstack-infra | 12:26 | |
| *** janki has quit IRC | 12:26 | |
| *** jchhatbar has joined #openstack-infra | 12:26 | |
| *** andreas_s has joined #openstack-infra | 12:26 | |
| *** Wei_Liu has quit IRC | 12:27 | |
| *** bobh has quit IRC | 12:30 | |
| *** lucasagomes is now known as lucas-hungry | 12:30 | |
| openstackgerrit | Krzysztof Klimonda proposed openstack-infra/zuul feature/zuulv3: Support autoholding nodes for specific changes/refs https://review.openstack.org/515169 | 12:34 |
| *** alexchadin has quit IRC | 12:37 | |
| *** yamamoto has joined #openstack-infra | 12:37 | |
| *** alexchadin has joined #openstack-infra | 12:38 | |
| *** sree has joined #openstack-infra | 12:38 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy tempest-tox-plugin-sanity-check jobs https://review.openstack.org/514271 | 12:39 |
| *** andreas_s has quit IRC | 12:41 | |
| *** niska has quit IRC | 12:44 | |
| *** andreas_s has joined #openstack-infra | 12:46 | |
| *** sboyron has joined #openstack-infra | 12:46 | |
| *** armaan has joined #openstack-infra | 12:46 | |
| *** andreas_s has quit IRC | 12:49 | |
| *** andreas_s has joined #openstack-infra | 12:49 | |
| *** aspiers[m] has joined #openstack-infra | 12:53 | |
| *** ilpianista_ has joined #openstack-infra | 12:53 | |
| *** niska has joined #openstack-infra | 12:54 | |
| *** ramishra has quit IRC | 12:55 | |
| frickler | how can I subscribe to a board in storyboard? I have the feeling that we need a "storyboard for launchpad users" guide before we can start the global migration | 12:55 |
| *** smatzek has joined #openstack-infra | 12:56 | |
| *** jpena|lunch is now known as jpena | 12:56 | |
| *** dprince has joined #openstack-infra | 12:59 | |
| *** rhallisey has joined #openstack-infra | 13:00 | |
| *** yamamoto has quit IRC | 13:04 | |
| *** jamesmcarthur has joined #openstack-infra | 13:05 | |
| *** yamamoto has joined #openstack-infra | 13:05 | |
| *** thorst has joined #openstack-infra | 13:05 | |
| *** LindaWang1 has joined #openstack-infra | 13:06 | |
| *** pblaho has quit IRC | 13:07 | |
| *** jamesmcarthur has quit IRC | 13:09 | |
| *** trown|outtypewww is now known as trown | 13:11 | |
| *** sboyron has quit IRC | 13:11 | |
| *** pblaho has joined #openstack-infra | 13:11 | |
| *** caphrim007_ has quit IRC | 13:12 | |
| *** caphrim007 has joined #openstack-infra | 13:13 | |
| *** dtantsur is now known as dtantsur|brb | 13:13 | |
| chandankumar | AJaeger: what is wrong here http://logs.openstack.org/10/523610/2/check/tempest-tox-plugin-sanity-check/3314dd6/job-output.txt.gz#_2017-11-29_00_41_38_837716 in this script https://github.com/openstack/tempest/blob/master/tools/tempest-plugin-sanity.sh#L99 | 13:13 |
| chandankumar | giving binary operator expected | 13:13 |
| frickler | chandankumar: the * matches two files | 13:16 |
| chandankumar | frickler: yup | 13:16 |
| frickler | and "-e" only expects one argument | 13:16 |
| chandankumar | frickler: i need to use -z then | 13:16 |
| *** rlandy has joined #openstack-infra | 13:17 | |
| *** rlandy is now known as rlandy|ruck | 13:17 | |
| efried | Hey folks, now that pabelanger has fixed the publish job (https://review.openstack.org/#/c/524001/) what needs to be done to retrigger it? Should I push a trivial patch to project-team-guide? | 13:17 |
| frickler | chandankumar: why do you use the * at all, wouldn't test-requirements.txt be enough? or iterate over test-requirements.txt and requirements.txt | 13:18 |
| *** edmondsw has joined #openstack-infra | 13:18 | |
| chandankumar | frickler: actually i need to check both the files then remove both the files | 13:19 |
| *** boden has joined #openstack-infra | 13:19 | |
| chandankumar | frickler: https://github.com/openstack/tempest/blob/master/tools/tempest-plugin-sanity.sh#L97 it just removes the files of a project | 13:19 |
| *** jchhatbar has quit IRC | 13:20 | |
| chandankumar | frickler: but the packages from requirements and test-requirements.txt are installed, which i need to remove so i am checking both the files then removing | 13:20 |
| frickler | chandankumar: then maybe expand like this http://paste.openstack.org/show/627850/ | 13:20 |
| chandankumar | frickler: sure | 13:21 |
| boden | hi a quick question I’m hoping someone can help me with… I recently added periodic jobs for vmware-nsx (https://review.openstack.org/#/c/521538/)… where can I find the logs for these so I can check if they are working properly? I don’t see anything under http://logs.openstack.org/periodic/git.openstack.org/openstack/ | 13:23 |
| *** markvoelker has quit IRC | 13:23 | |
| *** markvoelker has joined #openstack-infra | 13:24 | |
| chandankumar | frickler: thanks :-) | 13:25 |
| *** sambetts|afk is now known as sambetts | 13:29 | |
| *** martinkopec has quit IRC | 13:31 | |
| *** amoralej|lunch is now known as amoralej | 13:31 | |
| AJaeger | efried: yes, just publish something trivial. | 13:38 |
| efried | AJaeger Roger that, thanks. | 13:38 |
| *** lucas-hungry is now known as lucasagomes | 13:39 | |
| AJaeger | boden: your jobs are in periodic queue? Or in periodic-stable? If in periodic-stable, then update the url s/periodic/periodic-stable/ | 13:39 |
| *** alexchadin has quit IRC | 13:41 | |
| *** alexchadin has joined #openstack-infra | 13:41 | |
| frickler | AJaeger: boden: http://logs.openstack.org/periodic-stable/git.openstack.org/openstack/vmware-nsx/stable/pike/ does have results from today it seems | 13:42 |
| efried | AJaeger pabelanger FYI https://review.openstack.org/524180 | 13:43 |
| *** rlandy|ruck is now known as rlandy|ruck|mtg | 13:43 | |
| *** LindaWang1 has quit IRC | 13:46 | |
| *** alexchadin has quit IRC | 13:47 | |
| *** mriedem has joined #openstack-infra | 13:47 | |
| *** alexchadin has joined #openstack-infra | 13:48 | |
| *** kgiusti has joined #openstack-infra | 13:50 | |
| flaper87 | clarkb: fungi I don't need the instance anymore. Figured it out :) | 13:51 |
| flaper87 | thanks a bunch | 13:51 |
| openstackgerrit | Alex Kavanagh proposed openstack-infra/project-config master: Change the gate/checks to py3 only for python3 only charms https://review.openstack.org/524182 | 13:51 |
| flaper87 | clarkb: fyi, our hunch was correct, it was iptables | 13:51 |
| *** sree has quit IRC | 13:52 | |
| *** sree has joined #openstack-infra | 13:53 | |
| *** links has quit IRC | 13:54 | |
| *** janki has joined #openstack-infra | 13:55 | |
| *** annp has joined #openstack-infra | 13:55 | |
| *** armaan has quit IRC | 13:56 | |
| *** sree has quit IRC | 13:57 | |
| *** jbadiapa has quit IRC | 13:58 | |
| *** ihrachys has joined #openstack-infra | 13:58 | |
| *** bh526r has joined #openstack-infra | 13:59 | |
| *** gmann_afk is now known as gmann | 14:00 | |
| boden | AJaeger: thank you.. also (sorry), is there a way to test grafana dashboards (project-conf/grafana/<mydash>.yaml) before submitting them for review? | 14:00 |
| *** gongysh has quit IRC | 14:02 | |
| *** andreas_s has quit IRC | 14:02 | |
| *** andreas_s has joined #openstack-infra | 14:02 | |
| *** rosmaita has joined #openstack-infra | 14:03 | |
| *** d0ugal has quit IRC | 14:03 | |
| *** andreas_s has quit IRC | 14:03 | |
| *** andreas_s has joined #openstack-infra | 14:04 | |
| *** jbadiapa has joined #openstack-infra | 14:05 | |
| *** jamesmcarthur has joined #openstack-infra | 14:06 | |
| *** LindaWang1 has joined #openstack-infra | 14:06 | |
| *** Goneri has joined #openstack-infra | 14:06 | |
| *** mat128 has quit IRC | 14:08 | |
| *** andreas_s has quit IRC | 14:08 | |
| *** kiennt26 has joined #openstack-infra | 14:09 | |
| openstackgerrit | boden proposed openstack-infra/project-config master: fix broken vmware-nsx periodic jobs https://review.openstack.org/524186 | 14:10 |
| *** jamesmcarthur has quit IRC | 14:11 | |
| *** andreas_s has joined #openstack-infra | 14:15 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added new tag endpoint https://review.openstack.org/524189 | 14:15 |
| *** rlandy|ruck|mtg is now known as rlandy|mtg | 14:16 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Move to dictionary list of projects zuul._projects (take 2) https://review.openstack.org/518815 | 14:17 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added new tag endpoint https://review.openstack.org/524189 | 14:17 |
| *** ramishra has joined #openstack-infra | 14:17 | |
| *** d0ugal has joined #openstack-infra | 14:17 | |
| *** andreas_s has quit IRC | 14:18 | |
| *** Wei_Liu has joined #openstack-infra | 14:19 | |
| *** coolsvap has quit IRC | 14:19 | |
| *** jaypipes has joined #openstack-infra | 14:19 | |
| *** jbadiapa has quit IRC | 14:21 | |
| *** janki has quit IRC | 14:21 | |
| *** janki has joined #openstack-infra | 14:22 | |
| Wei_Liu | pabelanger: I got a problem when I try to start zuul-executor as zuul user, if I start it in no daemon mode with "-d", there is no error, every thing worked fine. But if I start it in daemon mode, I got error message like: Cmd('git') failed due to: exit code(-13). any idea? | 14:22 |
| *** janki has quit IRC | 14:22 | |
| *** janki has joined #openstack-infra | 14:22 | |
| fungi | frickler: thanks for the heads up. if nobody's fixed the default channel topic there yet i can do so once we get a gap between meetings | 14:23 |
| pabelanger | Wei_Liu: what is the permission on your SSH key? | 14:23 |
| *** andreas_s has joined #openstack-infra | 14:24 | |
| *** alexchadin has quit IRC | 14:24 | |
| fungi | flaper87: awesome, i've marked the held node for deletion in that case | 14:24 |
| *** ramishra has quit IRC | 14:25 | |
| *** ramishra has joined #openstack-infra | 14:26 | |
| flaper87 | fungi: ack, thanks again | 14:27 |
| fungi | any time | 14:30 |
| Wei_Liu | pabelanger: you mean gerrit ssh key? /home/zuul/.ssh/id_rsa permission is 600 | 14:31 |
| pabelanger | Wei_Liu: yah, how owns it? | 14:33 |
| fungi | ssh can also be picky about the permissions on the /home/zuul/.ssh directory if they allow write by anyone besides the user | 14:33 |
| *** esberglu has joined #openstack-infra | 14:33 | |
| Wei_Liu | pabelanger: rw------- 1 zuul zuul 1679 Nov 22 21:10 id_rsa | 14:34 |
| pabelanger | Wei_Liu: and you are using zuul user when you do zuul-executor -d? | 14:35 |
| Wei_Liu | yes | 14:35 |
| Wei_Liu | pabelanger: yes | 14:35 |
| fungi | one other odd quirk of openssh client we discovered... having a /home/zuul/.ssh/id_rsa.pub file isn't required, but if you have one there it _must_ be generated from the corresponding private key (if there's a mismatch, openssh gets weird on you and refuses to use the private key) | 14:35 |
| rcarrillocruz | yah, i hit ^ | 14:36 |
| fungi | a surprising and maddening behavior since it won't tell you _why_ it didn't use the key | 14:37 |
| rcarrillocruz | yeah, that one made me waste like half of a day | 14:37 |
| *** e0ne has quit IRC | 14:39 | |
| *** e0ne has joined #openstack-infra | 14:40 | |
| *** gmann is now known as gmann_afk | 14:40 | |
| *** dtantsur|brb is now known as dtantsur | 14:42 | |
| *** Swami has joined #openstack-infra | 14:42 | |
| sc` | i must have done something extra special to result in a change not even getting the Zuul reviewer. it's not even a huge change, mostly code style and sundry tooling deprecations | 14:44 |
| pabelanger | are we running reviewstats anyplace and producing txt files for projects? cc russellb | 14:44 |
| pabelanger | all I can see if stackalytics.com now | 14:44 |
| Wei_Liu | pabelanger: yes, I using zuul user do zuul-executor -d, it worked fine. Then I using zuul user do zuul-executor, I got that error, I found that parent process id of "zuul-executor -d" is the current shell of zuul user, but the parent process id of zuul-executor is "1", it's systemd | 14:44 |
| *** cshastri has quit IRC | 14:45 | |
| pabelanger | Wei_Liu: Oh, you need to start zuul-executor as root (no -d) and it will drop permissions to zuul user. So it can bind to port TCP/79 | 14:45 |
| frickler | sc`: which review? might have gotten lost in a zuul restart, did you try a recheck? | 14:45 |
| sc` | frickler: recheck, abandon/resubmit, same difference. it's the one i just proposed in #openstack-chef https://review.openstack.org/524193 | 14:46 |
| sc` | it smells like a me-problem, but i don't have the visibility | 14:47 |
| sc` | as far as i know, that should check through the existing gate, before and after bumping the chefdk | 14:49 |
| frickler | sc`: looks like we missed that repo in the zuulv3 migration, let me fix that | 14:50 |
| sc` | woop. it's not my code (yet) | 14:50 |
| *** armax has joined #openstack-infra | 14:50 | |
| *** ykarel is now known as ykarel|away | 14:51 | |
| russellb | pabelanger: i don't run it anymore | 14:51 |
| *** bobh has joined #openstack-infra | 14:52 | |
| pabelanger | russellb: ack | 14:56 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Changes for Ansible 2.4 https://review.openstack.org/505354 | 14:56 |
| *** cliffparsons has quit IRC | 14:57 | |
| *** hongbin has joined #openstack-infra | 14:59 | |
| *** iyamahat has joined #openstack-infra | 15:00 | |
| Wei_Liu | pabelanger: but I changed the port/79 to port/10079, it should worked as zuul user | 15:00 |
| *** yamahata has joined #openstack-infra | 15:01 | |
| fungi | frickler: i caught the channel at a lull and updated the topic. should be all better now | 15:02 |
| fungi | thanks again for the heads up on that | 15:02 |
| frickler | fungi: thanks for fixing it | 15:02 |
| frickler | fungi: did you see my note to mordred earlier about the shade channel? could we do a test by shortly removing the private flag from it again? | 15:03 |
| andreaf | jeblair: override_checkout is in there :) http://logs.openstack.org/88/521888/5/check/tempest-full-pike/ac658ff/zuul-info/inventory.yaml | 15:04 |
| *** ykarel|away has quit IRC | 15:04 | |
| *** florianf is now known as florianf|afk | 15:05 | |
| fungi | frickler: mordred: ahh, yeah, i think the instructions that process got adapted from probably recommended a delay of weeks/months before setting private on | 15:06 |
| *** efoley has joined #openstack-infra | 15:06 | |
| *** ldnunes has quit IRC | 15:06 | |
| *** jamesmcarthur has joined #openstack-infra | 15:07 | |
| fungi | hrm, nope: https://wiki.ubuntu.com/IRC/MovingChannels | 15:07 |
| Wei_Liu | pabelanger: http://paste.openstack.org/show/627874/, this is the permission of /var/lib/zuul directory and sub dir. | 15:07 |
| *** jrist has quit IRC | 15:08 | |
| *** mat128 has joined #openstack-infra | 15:09 | |
| *** jrist has joined #openstack-infra | 15:09 | |
| frickler | has mirror-workspace-git-repos got broken somehow? http://logs.openstack.org/02/524202/1/check/openstack-chef-repo-integration/12b5885/job-output.txt.gz#_2017-11-30_15_00_48_961873 | 15:09 |
| pabelanger | Wei_Liu: if you delete everything in /var/lib/zuul, and start again, what happens? | 15:10 |
| *** jamesmcarthur has quit IRC | 15:11 | |
| frickler | fungi: might be those instructions are broken as well? or maybe freenode behaviour has changed in the meantime? | 15:11 |
| *** annp has quit IRC | 15:12 | |
| *** rbrndt has joined #openstack-infra | 15:12 | |
| fungi | frickler: yeah, not sure... maybe it used to be the case that if you were in-channel when private got set then you were considered perpetually invited so rejoining later allowed you to follow the forward? were you in #openstack-shade when the private flag got turned on, or only attempted to /join later? | 15:13 |
| *** udesale has quit IRC | 15:13 | |
| snapiri | Hi Infra, could someone push this forward please? (os-loganalyze) https://review.openstack.org/#/c/520320/ | 15:14 |
| *** udesale has joined #openstack-infra | 15:14 | |
| frickler | fungi: I was in the channel until I got kicked, not sure due to which action | 15:14 |
| *** udesale has quit IRC | 15:14 | |
| frickler | fungi: but I'm more concerned about people that join only occasionally, they will never have seen the movement announcement | 15:14 |
| fungi | frickler: but yeah, another possibility on behavior change is that maybe forwards got followed before private was checked in the past, and now it's the other way around or something | 15:15 |
| frickler | fungi: and when trying to reconnect are getting the private message now | 15:15 |
| fungi | yup. i'm not opposed to updating that documented process as long as someone figures out what the process should be now | 15:16 |
| *** caphrim007 has quit IRC | 15:16 | |
| frickler | fungi: so if after removing the private people got connected to the new channel anyway instead of the old one, we could do without that | 15:16 |
| Wei_Liu | pabelanger: I deleted all sub dir, and then I started zuul-scheduler, zuul-executor -d, zuul-merger ass zuul user, the permission of sub dir is what I pasted | 15:16 |
| fungi | frickler: i agree, that's probably a fine approach | 15:17 |
| pabelanger | Wei_Liu: what port are you using for finger? in executor | 15:17 |
| *** marst has joined #openstack-infra | 15:17 | |
| Wei_Liu | pabelanger: finger_port=10079 | 15:18 |
| *** LindaWang1 has quit IRC | 15:18 | |
| pabelanger | Wei_Liu: okay, then start with zuul, should be fine. Did you get the error? | 15:18 |
| *** camunoz has joined #openstack-infra | 15:18 | |
| *** ldnunes has joined #openstack-infra | 15:19 | |
| pabelanger | Wei_Liu: what shell are you using for the zuul user | 15:19 |
| jeblair | andreaf: \o/ | 15:20 |
| *** rosmaita has quit IRC | 15:21 | |
| *** martinkopec has joined #openstack-infra | 15:21 | |
| *** LindaWang1 has joined #openstack-infra | 15:22 | |
| mwhahaha | hey folks, so it appears the tripleo gate is in a bad way for about 14 hours | 15:24 |
| mwhahaha | it seems we've got a bunch of jobs stuck in queued | 15:24 |
| jeblair | infra-root: i'd like to draw your attention to this spec: https://review.openstack.org/524024 it's written generally for new projects that we might start hosting, but i'd also like to pilot it with zuul. i'd particularly like to get these things in place before we relase zuul 3.0 | 15:24 |
| EmilienM | pabelanger: any idea about tripleo gate please? ^ | 15:24 |
| jeblair | mwhahaha: that's about how long since i restarted zuul. could be related. i'll take a look | 15:25 |
| EmilienM | thanks | 15:25 |
| dmsimard | jeblair: I skimmed it last night, it's about hosting projects that aren't related to OpenStack or the governance ? | 15:25 |
| frickler | infra-root: this seems broken globally right now http://logs.openstack.org/06/524206/1/check/openstack-tox-pep8/981eaff/job-output.txt.gz#_2017-11-30_15_22_38_533629 | 15:25 |
| dmsimard | frickler: seems related to https://review.openstack.org/#/c/518815/ | 15:26 |
| frickler | "ERROR: with_dict expects a dict" in "mirror-workspace-git-repos : Update remote repository state correctly" | 15:26 |
| dmsimard | frickler: which just merged | 15:26 |
| Wei_Liu | pabelanger: got the same error after I changed the port. I use bash for zuul user | 15:26 |
| *** gouthamr has joined #openstack-infra | 15:26 | |
| sc` | time for dat :partyparrot: - if only this slack instance had the functionality | 15:26 |
| frickler | dmsimard: so, revert for now? | 15:27 |
| dmsimard | frickler: give me a minute to try and understand what's going on | 15:27 |
| pabelanger | Wei_Liu: I think at this time, you'll need to start adding print statements to zuul and see what is getting permission denied. We likey can improve that debug message to give more info | 15:27 |
| frickler | dmsimard: leading "-" in L50 here? https://review.openstack.org/#/c/518815/4/roles/mirror-workspace-git-repos/tasks/main.yaml | 15:28 |
| sc` | looks like syntax perhaps. totally not an ansible guy, though | 15:28 |
| dmsimard | frickler: I know what's the problem but it might require a force merge anyway | 15:28 |
| dmsimard | frickler: sending a patch | 15:28 |
| jeblair | yes, we likely need to force-merge regardless. i'm up for one attempt to roll forward before we roll back :) | 15:29 |
| jeblair | oh, i see the error too :) | 15:29 |
| pabelanger | line 50 in 518815 ? | 15:30 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul-jobs master: mirror-workspace-git-repos: Pass a dict, not a list containing a dict https://review.openstack.org/524211 | 15:30 |
| mordred | frickler: looking | 15:30 |
| dmsimard | ^ fix | 15:30 |
| dmsimard | infra-root ^ | 15:30 |
| jeblair | dmsimard: i'll merge it | 15:30 |
| Wei_Liu | pabelanger: I see, I will try it tomorrow. thank you. and I am running my executor with "-d". it worked for me. | 15:31 |
| mordred | jeblair: ++ | 15:31 |
| mordred | dmsimard: thank you | 15:31 |
| frickler | worth a status note? | 15:31 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: mirror-workspace-git-repos: Pass a dict, not a list containing a dict https://review.openstack.org/524211 | 15:31 |
| * dmsimard really wants integration tests on base things :( | 15:31 | |
| *** myoung|ruck has joined #openstack-infra | 15:31 | |
| sc` | inspec :D | 15:31 |
| sc` | (stop it...) | 15:31 |
| dmsimard | sc`: we have integration tests but there are things that Zuul won't test speculatively for security purposes | 15:32 |
| dmsimard | sc`: this is one of them | 15:32 |
| dmsimard | sc`: We'll find a way :) | 15:32 |
| sc` | life... will find a way | 15:33 |
| dmsimard | ok, I'll do a recheck on a small patch to see if it's fixed | 15:33 |
| sc` | i see frickler is already ahead of me | 15:33 |
| *** wolverineav has quit IRC | 15:33 | |
| *** wolverineav has joined #openstack-infra | 15:34 | |
| sc` | it's already looking less angry in the face | 15:34 |
| jeblair | status notice if you receieved a result of "RETRY_LIMIT" after 14:15 UTC, it was likely due to an error since corrected. please "recheck" | 15:34 |
| jeblair | how's that look -- once we get confirmation? | 15:35 |
| fungi | lgtm | 15:35 |
| fungi | thanks for fixing quickly! | 15:35 |
| dmsimard | watching http://zuulv3.openstack.org/static/stream.html?uuid=1b9c1d2670984408b377ad65558f5a7d&logfile=console.log | 15:35 |
| dmsimard | it passed | 15:35 |
| dmsimard | fixed \o/ | 15:35 |
| sc` | thanks dmsimard :D | 15:36 |
| jeblair | #status notice if you receieved a result of "RETRY_LIMIT" after 14:15 UTC, it was likely due to an error since corrected. please "recheck" | 15:36 |
| openstackstatus | jeblair: sending notice | 15:36 |
| sc` | chef stuff looks happy again | 15:37 |
| -openstackstatus- NOTICE: if you receieved a result of "RETRY_LIMIT" after 14:15 UTC, it was likely due to an error since corrected. please "recheck" | 15:37 | |
| dmsimard | sc`: thanks for letting us know | 15:38 |
| openstackstatus | jeblair: finished sending notice | 15:39 |
| *** kiennt26 has quit IRC | 15:39 | |
| * smcginnis observes previously skipped jobs are now being run against driverfixes/* branches. | 15:39 | |
| *** Wei_Liu has quit IRC | 15:39 | |
| jeblair | smcginnis: this a good thing? | 15:40 |
| *** dhajare has quit IRC | 15:40 | |
| fungi | smcginnis: have a link to an affected change? | 15:41 |
| fungi | i'm guessing it's a bad (or at least unanticipated) thing | 15:41 |
| pabelanger | jeblair: +2 on spec | 15:41 |
| *** nikhil has joined #openstack-infra | 15:42 | |
| *** ramishra has quit IRC | 15:43 | |
| *** rossella_s has quit IRC | 15:43 | |
| efried | AJaeger pabelanger dhellmann smcginnis Docs have published. Thanks for your help! | 15:44 |
| jeblair | EmilienM, dmsimard, pabelanger: the stuck tripleo changes may be due to a zuul bug; i'm going to work on it in #zuul | 15:44 |
| smcginnis | jeblair, fungi: We had that filtered down to just pep8 and py27 tests. https://review.openstack.org/#/c/518311/ | 15:44 |
| smcginnis | Now grenade, docs, and py35 are running as well. | 15:45 |
| smcginnis | Haven't had any time to look into it, but wanted to note it. | 15:45 |
| fungi | smcginnis: do you recall how recently that behavior may have changed? | 15:45 |
| *** rossella_s has joined #openstack-infra | 15:46 | |
| jeblair | smcginnis, fungi: i can pitch in when i finish the current bug i'm working on. but the major thing that changed since yesterday is related to how project-templates on branches are applied | 15:46 |
| smcginnis | fungi: Honestly not sure. There's not a ton of activity on those branches. | 15:46 |
| smcginnis | jeblair: That at least sounds very suspicious. :) | 15:47 |
| *** jbadiapa has joined #openstack-infra | 15:48 | |
| fungi | i don't see any zuul configuration in http://git.openstack.org/cgit/openstack/cinder/tree/?h=driverfixes/newton so maybe we regressed on how master branch configurations implement branch exclusions | 15:48 |
| smcginnis | fungi: We could add a .zuul.conf there, but it's additive right? | 15:49 |
| *** yamamoto has quit IRC | 15:49 | |
| fungi | though http://git.openstack.org/cgit/openstack/cinder/tree/.zuul.yaml isn't defining the exclusions either so we must have it somewhere more central? | 15:49 |
| *** janki has quit IRC | 15:49 | |
| EmilienM | jeblair: ok | 15:50 |
| *** yamamoto has joined #openstack-infra | 15:50 | |
| *** slaweq has quit IRC | 15:52 | |
| fungi | ahh, yep lots of "branches: ^(?!driverfixes/).*$ | 15:52 |
| fungi | " in http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/projects.yaml | 15:52 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/zuul feature/zuulv3: Print a message when we start the Zuul console https://review.openstack.org/524225 | 15:53 |
| *** dprince has quit IRC | 15:54 | |
| *** rossella_s has quit IRC | 16:00 | |
| fungi | smcginnis: looking in project-config zuul.d/projects.yaml at least the jobs cinder has excluded from running against driverfixes/* seem to be getting skipped there | 16:01 |
| *** rossella_s has joined #openstack-infra | 16:01 | |
| martinkopec | Hi guys, I'm struggling for few days with creating a playbook for openstack/python-tempestconf project, It looks like an environment issue | 16:02 |
| martinkopec | it's described more here: http://lists.openstack.org/pipermail/openstack-dev/2017-November/124906.html | 16:02 |
| *** snapiri has quit IRC | 16:02 | |
| fungi | smcginnis: so wondering if we just missed some branch exclusions when translating the jobs over and they've been like this since v3 rollout? | 16:02 |
| martinkopec | can someone please have a look ? | 16:02 |
| smcginnis | fungi: Quite possibly. | 16:03 |
| smcginnis | fungi: I'll try to take a look a little later and see if anything needs to be cleaned up. | 16:03 |
| fungi | smcginnis: i suppose the low frequency of changes on those branches could have made it so we just didn't notice until now | 16:03 |
| fungi | especially since they seem to be passing | 16:04 |
| *** mat128 has quit IRC | 16:04 | |
| *** mat128 has joined #openstack-infra | 16:04 | |
| smcginnis | fungi: Yeah, and we've had a few more important issues to distract us since then. :) | 16:05 |
| *** mat128 has quit IRC | 16:05 | |
| *** mat128 has joined #openstack-infra | 16:08 | |
| *** LindaWang1 has quit IRC | 16:08 | |
| *** dprince has joined #openstack-infra | 16:08 | |
| fungi | martinkopec: i think andreaf did a lot of work on native v3 devstack jobs, so maybe he has some idea what's wrong there (if he's around) | 16:09 |
| *** gongysh has joined #openstack-infra | 16:11 | |
| martinkopec | fungi, thanks for a response, .. ok, I'll try to ask andreaf then | 16:11 |
| *** gongysh has quit IRC | 16:12 | |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Remove legacy jobs from Keystone https://review.openstack.org/524232 | 16:12 |
| *** mat128 has quit IRC | 16:12 | |
| *** rossella_s has quit IRC | 16:13 | |
| martinkopec | fungi, but , is it possible that post requests would be somehow blocked? | 16:13 |
| openstackgerrit | Merged openstack-infra/system-config master: Create publish space for SIGs under governance.o.o https://review.openstack.org/522545 | 16:13 |
| *** jamesmcarthur has joined #openstack-infra | 16:15 | |
| *** joadavis has quit IRC | 16:16 | |
| fungi | martinkopec: sorry, my depth of understanding of openstack, devstack and tempest is very shallow so i really don't know | 16:17 |
| fungi | i can tell you that our test platform doesn't block network connections to the loopback address by default, but beyond that it's up to the job payload to configure | 16:18 |
| martinkopec | fungi, thanks | 16:19 |
| AJaeger | mordred, frickler , see my comments on https://review.openstack.org/#/c/524186/ - I think we should not add further required-repos to docs jobs... | 16:21 |
| smcginnis | fungi: For the driverfixes exclusions, do I just set that under cinder, or would that need to be defined with the template? | 16:22 |
| openstackgerrit | Gage Hugo proposed openstack-infra/openstack-zuul-jobs master: Remove legacy jobs in Keystone https://review.openstack.org/524237 | 16:22 |
| smcginnis | fungi: Under here: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/projects.yaml#n3593 | 16:22 |
| smcginnis | Or within the source of here: http://git.openstack.org/cgit/openstack-infra/project-config/tree/zuul.d/projects.yaml#n3581 | 16:22 |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Remove legacy jobs from Keystone https://review.openstack.org/524232 | 16:23 |
| fungi | smcginnis: if you set it under cinder as a variant then i think it just applies to cinder, whereas if you set it in the job definition then it's global for all projects using that job | 16:23 |
| dmsimard | jeblair: added some comments on https://review.openstack.org/#/c/524024/ | 16:23 |
| *** andreas_s has quit IRC | 16:24 | |
| fungi | smcginnis: oh, though i forgot branch exclusions in variants really don't work since you can't use a variant to deselect a selected job, only select deselected jobs | 16:24 |
| fungi | smcginnis: so i think you have to either set it in the existing job definition or define a new job | 16:24 |
| smcginnis | fungi: OK, I think Manila is the only other one using the driverfixes pattern so far, and AFAIK they have the same policy as Cinder, so I'll put it with the job. | 16:25 |
| smcginnis | fungi: Thanks! | 16:25 |
| *** rossella_s has joined #openstack-infra | 16:26 | |
| *** snapiri has joined #openstack-infra | 16:26 | |
| tbarron | smcginnis: +1 on same policy for driverfixes in manila, pls. add me to that review | 16:27 |
| tbarron | smcginnis: for my edification | 16:28 |
| andreaf | fungi, martinkopec: let me have a look | 16:28 |
| smcginnis | tbarron: Awesome, thanks. Will do. | 16:28 |
| andreaf | jeblair: when override_checkout is not used, shouldn't it be undefined instead of null? http://logs.openstack.org/88/521888/5/check/tempest-full/4e8fec0/zuul-info/inventory.yaml | 16:29 |
| mordred | AJaeger: ah - I agree with you today, we need the docs changing work - but we also need to finish the base job rework which will let us use build-openstack-sphinx-docs with additional required-projects and then publish the results ... BUT - I don't think in most cases we'll wind up needing required-projects on docs jobs like taht | 16:29 |
| mordred | AJaeger: VERY long winded way of saying I agree :) | 16:29 |
| andreaf | martinkopec: ah I think we discussed that in IRC last week or so? | 16:30 |
| martinkopec | andreaf, yes, since then I've create a packstack job too | 16:31 |
| martinkopec | and it's failing with the same issue | 16:31 |
| AJaeger | boden: see my question above and mordred's answer - let's do py35 only, please | 16:31 |
| *** joadavis has joined #openstack-infra | 16:32 | |
| *** rosmaita has joined #openstack-infra | 16:35 | |
| andreaf | martinkopec: your requests reach keystone - see http://logs.openstack.org/30/513330/54/check/python-tempestconf-tempest-devstack/c9fbb41/controller/logs/screen-keystone.txt | 16:37 |
| andreaf | martinkopec: so I don't think there is any issue with POST itself | 16:38 |
| andreaf | martinkopec: either the credentials are not valid or not passed along | 16:38 |
| *** andreas_s has joined #openstack-infra | 16:38 | |
| AJaeger | tristanC: before the governance change merges, the project-config change needs fixing - and PTL +1 as well. | 16:38 |
| AJaeger | mordred: do you have any changes for me to review? | 16:39 |
| andreaf | martinkopec: even if you enable debug the rest_client will hide the request body in case a password is in there, but you could temporarily change that so see what's actually being sent to keystone | 16:39 |
| *** caphrim007 has joined #openstack-infra | 16:40 | |
| clarkb | amotoki: martinkopec is tox involved? if so you need to whitelist the env vars in tox otherwise it filters them out | 16:41 |
| clarkb | er andreaf ^ | 16:41 |
| clarkb | amotoki: sorry | 16:41 |
| mordred | AJaeger: https://review.openstack.org/#/q/topic:constraints-in-siblings+(status:open+OR+status:merged) is ready - although some of it is going to be hounding folks in those projects (although I'm tempted to abuse powers and merge a few of those for people) | 16:41 |
| *** thorst has quit IRC | 16:42 | |
| mordred | AJaeger: then I'm going to swing back through the sphinx jobs - so I don't think I have new things for you yet | 16:42 |
| AJaeger | mordred: let me ping a few... | 16:42 |
| AJaeger | mordred: ok. | 16:42 |
| *** thorst has joined #openstack-infra | 16:42 | |
| clarkb | everyone should know that if http://zuulv3.openstack.org/static/stream.html?uuid=5eb8995080f0400996f4281553a7bb75&logfile=console.log passes I declar victory over the moles! | 16:42 |
| mordred | AJaeger: heh. two of them are me :) | 16:42 |
| martinkopec | clarkb, tox no, but pip is | 16:42 |
| * AJaeger ping mordred ;) | 16:43 | |
| *** mat128 has joined #openstack-infra | 16:43 | |
| *** e0ne has quit IRC | 16:43 | |
| *** thorst has quit IRC | 16:44 | |
| martinkopec | andreaf, I think it's not env variables, because auth url is also env variable and if those variables didn't work, it wouldn't sent the request to keystone .. therefor I assume that the password was also passed to tempestconf correctly | 16:46 |
| *** andreas_s has quit IRC | 16:47 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/openstack-zuul-jobs master: Skip jobs for driverfixes branches https://review.openstack.org/524247 | 16:48 |
| *** katkapilatova has left #openstack-infra | 16:49 | |
| *** Apoorva has joined #openstack-infra | 16:51 | |
| *** Apoorva has quit IRC | 16:53 | |
| *** Apoorva has joined #openstack-infra | 16:55 | |
| *** d0ugal has quit IRC | 16:55 | |
| ttx | someone should really fix @openstackinfra twitter bot so that it realizes it can do 280 characters now :) | 16:55 |
| *** Apoorva has quit IRC | 16:55 | |
| * ttx senses another unshaven yak | 16:56 | |
| clarkb | ttx: I wonder if our twitter library does that for us? | 16:56 |
| clarkb | maybe just need to update that | 16:56 |
| ttx | hooopefully | 16:57 |
| ttx | I have a... meeting coming up so I'll do that in parallel | 16:57 |
| ttx | just need to find where that lives | 16:58 |
| clarkb | ttx: its part of statusbot I think | 16:58 |
| fungi | yes, it is | 16:58 |
| ttx | alright, let me grab those yah hair scissors | 16:59 |
| ttx | yak | 16:59 |
| *** david-lyle has joined #openstack-infra | 16:59 | |
| fungi | yeah, the twitter support on the puppet-statusbot side was just adding a section to the statusbot.config file: https://review.openstack.org/368238 | 17:00 |
| fungi | twitter support in statusbot itself happened via https://review.openstack.org/92677 and added an unversioned python-twitter package to requirements.txt | 17:02 |
| *** joadavis has left #openstack-infra | 17:02 | |
| clarkb | http://logs.openstack.org/40/516740/6/check/legacy-puppet-beaker-rspec-infra/5eb8995/ IT WORKED. I win moles! | 17:02 |
| clarkb | jeblair: dmsimard fungi the update ara change is now ready for review after fixing the puppet testing gremlins https://review.openstack.org/#/c/516740/6 | 17:03 |
| *** dtantsur is now known as dtantsur|afk | 17:03 | |
| fungi | clarkb: i still have avogadro's constant memorized to 10 digits precision, if it helps | 17:04 |
| *** dhinesh has joined #openstack-infra | 17:05 | |
| clarkb | what happens when you play whack a mole with the number of moles in a mole? | 17:05 |
| clarkb | I didn't get close but it sure feels like it | 17:05 |
| AJaeger | mordred: all the topic:constraints-in-siblings changes that can merge are approved ... | 17:05 |
| *** iyamahat has quit IRC | 17:07 | |
| fungi | ttx: clarkb: https://github.com/bear/python-twitter/commit/d4f3dcd so i guess we need to wait for 3.3.1 judging by recent master branch history | 17:08 |
| *** pcaruana has quit IRC | 17:08 | |
| *** yamahata has quit IRC | 17:08 | |
| *** d0ugal has joined #openstack-infra | 17:08 | |
| openstackgerrit | Thierry Carrez proposed openstack-infra/statusbot master: Update tweet length from 120 to 260 chars https://review.openstack.org/524255 | 17:10 |
| ttx | ahhm | 17:10 |
| ttx | argh | 17:10 |
| *** dhinesh has quit IRC | 17:10 | |
| ttx | I'll Workflow it | 17:10 |
| openstackgerrit | boden proposed openstack-infra/project-config master: fix broken vmware-nsx periodic jobs https://review.openstack.org/524186 | 17:10 |
| fungi | ttx: but that's a good wip change for sure! | 17:10 |
| *** kmalloc has quit IRC | 17:11 | |
| openstackgerrit | Sean McGinnis proposed openstack-infra/openstack-zuul-jobs master: Skip jobs for driverfixes branches https://review.openstack.org/524247 | 17:11 |
| *** dhinesh has joined #openstack-infra | 17:12 | |
| *** Swami has quit IRC | 17:12 | |
| ttx | fungi: I suspect passing verify_status_length=False would just work :) | 17:13 |
| clarkb | nodepool.o.o is no longer running a nodepoold so I guess that did get done. Thnking about the zookeeper situation you can apparently just copy the data dir from one server to another if you can stop the zk on the old server | 17:14 |
| fungi | ttx: likely so | 17:14 |
| *** wolverineav has quit IRC | 17:14 | |
| fungi | clarkb: though there was a suggestion that when we relocate zk off nodepool.o.o we should replace it with a 3-way cluster | 17:14 |
| *** rpittau__ has quit IRC | 17:14 | |
| ttx | but let's wait for proper lib support | 17:15 |
| *** Hal has quit IRC | 17:15 | |
| clarkb | what we may want to consider doing then is to bring up a zk01.openstack.org on xenial, stop zk on nodepool.o.o, copy the data dir, start zk on new server, point zuul/nodepool at it. I expect this to make nodepool and zuul unhappy so we should do this over quiet time/downtime. Then if we want to make a three node cluster we add zk02 and zk03 and join them to zk01 | 17:15 |
| *** wolverineav has joined #openstack-infra | 17:15 | |
| openstackgerrit | Saad Zaher proposed openstack-infra/project-config master: Remove legacy jobs for freezer https://review.openstack.org/524256 | 17:15 |
| clarkb | another way to do it which maybe is less downtimey is add zk02 and zk03 to nodepool zk | 17:15 |
| clarkb | then delete nodepool zk and add zk01? | 17:15 |
| pabelanger | yah, we talked about that before | 17:15 |
| clarkb | actually now that I type out ^ I think that may be much better | 17:16 |
| fungi | clarkb: would it make sense to make zl01 and zl02 into zk cluster members? | 17:16 |
| pabelanger | and thought that is how we were going to do it | 17:16 |
| fungi | pabelanger: ^? | 17:16 |
| fungi | er, nl01 and nl02 i mean | 17:16 |
| clarkb | pabelanger: that being the make cluster or replace server? | 17:16 |
| pabelanger | clarkb: cluster, then delete nodepool.o.o, then add back | 17:16 |
| pabelanger | just need to figure out add to sync the data when a new member joins | 17:17 |
| clarkb | nl01 at least has ~6GB free memory which is plenty to run our current zk instance | 17:17 |
| fungi | wondering if having local zk cluster members on the launchers provides any real performance gains | 17:17 |
| *** martinkopec has quit IRC | 17:17 | |
| clarkb | pabelanger: I think joining the cluster automatically implies data replication | 17:17 |
| pabelanger | cool | 17:17 |
| clarkb | (its something that you/I/we can test pretty easily using 3 zk processes) | 17:17 |
| ttx | fungi: oh actually we should merge that instead, and it will just work when python-twitter will be updated | 17:17 |
| ttx | https://review.openstack.org/#/c/504980/ | 17:18 |
| *** psachin has quit IRC | 17:18 | |
| *** wolverineav has quit IRC | 17:19 | |
| pabelanger | clarkb: I'd we okay with zk01, zk02, zk03 moving forward. But also think we hyper-converge (is that the hipser work?) with nodepool-launchers too | 17:19 |
| pabelanger | word* | 17:19 |
| clarkb | pabelanger: meaning you'd like to colocate the services? | 17:19 |
| dmsimard | clarkb: wow that was a bit rabbit-holey with those two additional reviews. Thanks for working on it, I'll have a look after lunch | 17:19 |
| clarkb | looking at nodepool.o.o we may even be able to get away with 2GB instances for zk under current resource use. definitely 4GB should be fine | 17:20 |
| clarkb | dmsimard: it turned out the test wasn't happy and the code wouldn't merge without working tests :) | 17:20 |
| pabelanger | clarkb: yah, we talked about co-locating zookeeper some place before | 17:20 |
| pabelanger | but 3x4GB servers wfm | 17:20 |
| *** wolverineav has joined #openstack-infra | 17:21 | |
| clarkb | the advantage to not colocating would be being able to replace servers as necessary without taking into account other services | 17:21 |
| clarkb | the advantages to colocating would be possible performance/reliability improvements due to locality and using total fewer aggregate resources | 17:21 |
| clarkb | six one way half dozen the other I Think | 17:21 |
| *** lucasagomes is now known as lucas-afk | 17:21 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Skip jobs for driverfixes branches https://review.openstack.org/524247 | 17:22 |
| pabelanger | yah, I have a slight preference to not co-locating, to make it easy to replace servers when needed | 17:22 |
| pabelanger | and, we seems to be doing okay running zk remote to zuul / nodepool today | 17:23 |
| openstackgerrit | Merged openstack-infra/shade master: Avoid tox_install.sh for constraints support https://review.openstack.org/508061 | 17:23 |
| *** eharney has quit IRC | 17:24 | |
| pabelanger | clarkb: so, that said, I think we should totally stand up zk01.o.o as xenial, open firewalls, and try to join it to zk | 17:24 |
| *** d0ugal has quit IRC | 17:24 | |
| clarkb | pabelanger: we should be prepared to join 2 at roughly the same time so that it can form a quorum (probably also worth double checking docs that there isn't a specific method to doing that the first time) | 17:25 |
| *** jlvacation is now known as jlvillal | 17:25 | |
| clarkb | *2 new servers | 17:25 |
| *** eroux has joined #openstack-infra | 17:25 | |
| pabelanger | yah | 17:26 |
| pabelanger | but, zk will still work without quarm right? | 17:26 |
| pabelanger | quorum* | 17:26 |
| clarkb | not sure what its failure mode without quorum is | 17:26 |
| *** rossella_s has quit IRC | 17:27 | |
| pabelanger | okay, I can propose a patch to system-config to break out zk. Don't believe it is much work | 17:27 |
| clarkb | ya either way step 0 is having the servers up and running and ready to join the existing "cluster" | 17:29 |
| clarkb | firewall and/or config will prevent new servers from talking to old until we are ready | 17:29 |
| pabelanger | ++ | 17:30 |
| *** iyamahat has joined #openstack-infra | 17:33 | |
| jeblair | EmilienM, dmsimard: i may be able to get the tripleo queue moving if i promote something to the top. any suggestions? | 17:34 |
| dmsimard | mwhahaha ^ | 17:35 |
| *** d0ugal has joined #openstack-infra | 17:35 | |
| mwhahaha | jeblair: maybe just the 2nd one on the list to keep it simple | 17:35 |
| mwhahaha | 515796,5 | 17:35 |
| *** trown is now known as trown|lunch | 17:36 | |
| jeblair | andreaf: we can probably cause it to be omitted instead of null if that makes more sense | 17:36 |
| jeblair | mwhahaha: ack | 17:36 |
| jeblair | mwhahaha, EmilienM: that looks to have things moving again. i'm making good progress on tracking down the underlying bug too. sorry about that. | 17:38 |
| jeblair | mwhahaha, EmilienM: the good news is that the bug was triggered due to an unusually high success rate in the tripleo queue. :) | 17:38 |
| *** bh526r has quit IRC | 17:38 | |
| mwhahaha | i know right? it was working so well :( | 17:39 |
| *** mnencia has quit IRC | 17:39 | |
| fungi | hoisted on your own petard | 17:39 |
| EmilienM | jeblair, fungi: is tripleo deserve the award of testing zuul at scale and in weird edge cases? | 17:41 |
| openstackgerrit | Sean McGinnis proposed openstack-infra/openstack-zuul-jobs master: Skip releasenotes on driverfixes branches https://review.openstack.org/524262 | 17:41 |
| fungi | EmilienM: if we had an award for that, then sure. instead you just get to bang your head against the wall a bunch | 17:41 |
| jeblair | EmilienM: absolutely. and the combo of tripleo+puppet should get some kind of lifetime achievement award. :) | 17:42 |
| EmilienM | lol | 17:42 |
| *** rossella_s has joined #openstack-infra | 17:42 | |
| mmedvede | hi jeblair, the patch for puppet-openstackci is up https://review.openstack.org/#/c/523951/. It should prevent some of breakage from v3 feature branch merge into master | 17:43 |
| jeblair | there are now as many mentions of 'puppet' in zuul's regression tests as there are 'nova'. | 17:43 |
| dmsimard | EmilienM: thanks for making zuul v3 even more awesome | 17:43 |
| jeblair | mmedvede: thanks! | 17:43 |
| EmilienM | dmsimard: I didn't do anything :P | 17:44 |
| *** jpich has quit IRC | 17:44 | |
| EmilienM | but I like to see the weird cases & scalability issues quickly fixed, so zuul can get better quickly after being in production | 17:44 |
| dmsimard | Oh, we definitely will be able to say that Zuul v3 is production ready and battle proven after a while :D | 17:45 |
| jeblair | fungi, smcginnis: i'm at a spot where i can pause before implementing the fix for the bug i was working on -- do you need me to look into anything or did you sort it out? | 17:46 |
| clarkb | mmedvede: fyi I'm fiddling with storyboard boards to track the current work in progress and help wanted for infra https://storyboard.openstack.org/#!/story/2001367 is story for that work and is under the in progress lane of the board at https://storyboard.openstack.org/#!/board/54 | 17:47 |
| fungi | jeblair: i believe we tracked it down to a regression during or soon after the v3 migration. just needed to add some additional branch exclusions for a few job definitions | 17:48 |
| mmedvede | clarkb: awesome, thanks! | 17:48 |
| fungi | jeblair: but thanks for checking back in! | 17:49 |
| openstackgerrit | boden proposed openstack-infra/project-config master: vmware-nsx grafana dashboard https://review.openstack.org/524265 | 17:49 |
| *** derekh has quit IRC | 17:49 | |
| *** Apoorva has joined #openstack-infra | 17:50 | |
| *** yamahata has joined #openstack-infra | 17:51 | |
| *** nikhil has quit IRC | 17:51 | |
| *** cshastri has joined #openstack-infra | 17:52 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add zk01-03 servers to cluster zookeeper https://review.openstack.org/524267 | 17:53 |
| pabelanger | clarkb: lets see if puppet passed^ | 17:53 |
| *** SumitNaiksatam has joined #openstack-infra | 17:53 | |
| clarkb | pabelanger: if you don't object I'll add your name to the Xenial upgrade story as a contact for people to reach out to if interseted in that work | 17:54 |
| clarkb | (I've already added fungi to the wiki one as he seemed cool with it yesterday) | 17:54 |
| pabelanger | clarkb: sure, I also sent an email to infra ML about virtual sprint | 17:55 |
| clarkb | thanks, I'll link to that in the story as well (Haven't quite caught up on email yet) | 17:55 |
| *** mnencia has joined #openstack-infra | 18:00 | |
| *** sshnaidm|rover is now known as sshnaidm|off | 18:02 | |
| fungi | clarkb: yep, i meant to explicitly suggest yuo add me, but can't remember if i actually said so. cool with me | 18:03 |
| clarkb | I've got a card on that board for converting infra jobs to native zuulv3 jobs. Anyone interested in being point contact for that? | 18:03 |
| clarkb | mordred: dmsimard pabelanger maybe? Probably want someone with strong ansible and zuul background to point people in the right direction | 18:04 |
| pabelanger | I can help with that | 18:04 |
| *** Apoorva_ has joined #openstack-infra | 18:04 | |
| dmsimard | I can help too. | 18:04 |
| pabelanger | but also a great learning experience for somebody | 18:04 |
| clarkb | thanks | 18:04 |
| pabelanger | look at us doing agility things! | 18:05 |
| clarkb | heh, I doubt we'll do the whole standup and dance routine | 18:05 |
| *** mnencia has quit IRC | 18:05 | |
| clarkb | but figured we could really use a "this is where we need help" list since TC says "help infra" now | 18:06 |
| pabelanger | ++ | 18:06 |
| *** hashar is now known as hasharDinner | 18:06 | |
| *** Apoorva has quit IRC | 18:07 | |
| pabelanger | clarkb: mind a +3 on https://review.openstack.org/515181 that removes zuul-launcher from system-config | 18:08 |
| pabelanger | servers have been deleted already | 18:08 |
| *** thorst has joined #openstack-infra | 18:08 | |
| * clarkb looks | 18:08 | |
| *** Apoorva_ has quit IRC | 18:09 | |
| clarkb | pabelanger: https://review.openstack.org/#/c/515181/2/doc/source/zuul.rst probably deserves an update ya? | 18:09 |
| clarkb | not in this change, just in general catch it up to the zuul v3 state of the world | 18:09 |
| *** Apoorva has joined #openstack-infra | 18:09 | |
| *** cshastri has quit IRC | 18:10 | |
| pabelanger | clarkb: yah, we have a zuulv3.rst file too. I think the plan is to merge them at some point | 18:10 |
| *** dhajare has joined #openstack-infra | 18:11 | |
| pabelanger | https://docs.openstack.org/infra/system-config/zuulv3.html | 18:11 |
| clarkb | pabelanger: looking at https://review.openstack.org/#/c/515181/2/manifests/site.pp zuulv3 has an empty gearman_workers variable. Any idea where we set the firewall rules for zuul executors to connect to gearman? | 18:11 |
| *** mnencia has joined #openstack-infra | 18:12 | |
| *** armaan has joined #openstack-infra | 18:13 | |
| pabelanger | clarkb: they now connect to zuulv3.o.o | 18:13 |
| clarkb | oh I was looking at the empty list for zuulv3-dev | 18:14 |
| clarkb | derp | 18:14 |
| pabelanger | http://git.openstack.org/cgit/openstack-infra/system-config/tree/manifests/site.pp#n1284 | 18:14 |
| pabelanger | yah | 18:14 |
| pabelanger | zuulv3-dev is the next one we can remove | 18:14 |
| *** dhajare has quit IRC | 18:15 | |
| smcginnis | jeblair: Yep, think we've got it all sorted now. Thanks | 18:15 |
| clarkb | pabelanger: I left one comment on the change for a followup cleanup. Approved though | 18:15 |
| *** mnencia has quit IRC | 18:16 | |
| *** dhajare has joined #openstack-infra | 18:17 | |
| clarkb | https://review.openstack.org/523937 is an easy doc update | 18:17 |
| clarkb | pabelanger: you may be interested in https://review.openstack.org/523955 as you've been reviewing the logstash stuff | 18:17 |
| *** ralonsoh has quit IRC | 18:18 | |
| *** mnencia has joined #openstack-infra | 18:18 | |
| pabelanger | +2 | 18:18 |
| pabelanger | and I'll get up a follow up | 18:18 |
| pabelanger | I have to run down to the road to new house, will be back shortly | 18:18 |
| *** jkilpatr has quit IRC | 18:23 | |
| *** dhinesh has quit IRC | 18:23 | |
| openstackgerrit | Merged openstack-infra/project-config master: Shift shade IRC activity to openstack-sdks https://review.openstack.org/523556 | 18:24 |
| openstackgerrit | Merged openstack-infra/project-config master: Fix handling of locked channels in access check https://review.openstack.org/524075 | 18:24 |
| andreaf | jeblair: yeah I would like to do something like {{ zuul.override_branch | default(zuul.branch) }} but that works only if override_branch is not defined - else I need more complex tasks | 18:26 |
| jesusaur | would any infra-puppet-core members care to review https://review.openstack.org/#/c/515228/ ? | 18:26 |
| *** rbrndt has quit IRC | 18:27 | |
| *** jpena is now known as jpena|off | 18:29 | |
| clarkb | jesusaur: nodepool doesn't accept arbitrary data in there does it? are you consuming the same file from some other service? | 18:29 |
| clarkb | (I've +2'd because its simple and backward compat, mostly just curious) | 18:30 |
| *** eharney has joined #openstack-infra | 18:34 | |
| jesusaur | clarkb: to be honest, I'm not sure what nodepool would do with unrecognized options in the config file; but what I'm trying to do is generate the config file from hiera data that doesn't look like your hiera data | 18:35 |
| jesusaur | and so I need a custom template to parse my custom hiera data | 18:36 |
| clarkb | jesusaur: pretty certain it would ignore unknown data in there, but gotcah the template itself is what differs not really the end result due to hiera | 18:36 |
| jesusaur | right | 18:36 |
| *** trown|lunch is now known as trown | 18:37 | |
| openstackgerrit | Merged openstack-infra/system-config master: Remove zuul-launcher support https://review.openstack.org/515181 | 18:37 |
| *** erlon has joined #openstack-infra | 18:38 | |
| *** jkilpatr has joined #openstack-infra | 18:39 | |
| dmsimard | clarkb, pabelanger: So I've given a shot at enforcing a minimum TTL on tripleo jobs. What I know is that 1) It doesn't break anything and 2) It is effective, as in github.com TTL was enforced to be 900 | 18:47 |
| dmsimard | http://paste.openstack.org/raw/627913/ from http://logs.openstack.org/18/524018/1/check/tripleo-ci-centos-7-3nodes-multinode/3489db8/logs/dns_cache.txt.gz | 18:47 |
| *** openstackgerrit has quit IRC | 18:48 | |
| *** armaan has quit IRC | 18:48 | |
| *** openstackgerrit has joined #openstack-infra | 18:48 | |
| openstackgerrit | Merged openstack-infra/openstack-zuul-jobs master: Remove legacy Designate jobs content https://review.openstack.org/523502 | 18:48 |
| dmsimard | I had categorized what appeared like legitimate DNS lookup failures yesterday here: https://ethercalc.openstack.org/c4z5uworv7kx | 18:49 |
| dmsimard | However, I can't quite put it in elastic-recheck because some of those aren't fatal | 18:49 |
| dmsimard | Do we want to put a minimum TTL on TripleO jobs, leave it for a week or so and see where that leads us ? | 18:49 |
| dmsimard | EmilienM, mwhahaha: ^ | 18:49 |
| clarkb | we can probably make an exception since it is a failure just not always fatal that we want to eliminate | 18:49 |
| clarkb | mtreinish: would probably be the person to convince and or mriedem | 18:50 |
| dmsimard | clarkb: What's more interesting is to see if there is a trend down | 18:50 |
| *** pcaruana has joined #openstack-infra | 18:50 | |
| dmsimard | Yesterday of ~52 failures (from that query) over 7 days, 12 of those were in TripleO jobs | 18:50 |
| EmilienM | dmsimard: I don't know what you're talking about, tbh | 18:50 |
| *** slaweq has joined #openstack-infra | 18:51 | |
| dmsimard | EmilienM: We're trying to reduce the amount of job failures because of DNS lookup failures | 18:51 |
| EmilienM | ok I see | 18:51 |
| EmilienM | why a minimum TTL would help | 18:51 |
| mwhahaha | less dns lookups to upstream | 18:51 |
| mwhahaha | caching would be more effective | 18:52 |
| dmsimard | EmilienM: Explained in the commit here https://review.openstack.org/#/c/523178/ | 18:52 |
| * EmilienM clicks | 18:52 | |
| dmsimard | Yesterday there was 52 failures over the last 7 days, looking today there's 85 now | 18:52 |
| dmsimard | Hmm, one of those seems like just a bad kolla patch. | 18:53 |
| EmilienM | dmsimard: lgtm | 18:53 |
| clarkb | dmsimard: ya re trends | 18:53 |
| *** slaweq has quit IRC | 18:53 | |
| dmsimard | EmilienM, mwhahaha: Okay so I'll update commit message for https://review.openstack.org/#/c/524018/ and we can merge that ? | 18:55 |
| mwhahaha | i'm ok with it | 18:55 |
| dmsimard | ack | 18:55 |
| EmilienM | dmsimard: go4it | 18:56 |
| *** dhinesh has joined #openstack-infra | 18:57 | |
| *** dhajare_ has joined #openstack-infra | 18:58 | |
| *** amito-infinidat is now known as amito | 18:59 | |
| *** dhajare has quit IRC | 19:00 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/tripleo-ci master: Enforce a minimum TTL for DNS records in TripleO jobs https://review.openstack.org/524018 | 19:01 |
| *** dhinesh_ has joined #openstack-infra | 19:03 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add zk01-03 servers to cluster zookeeper https://review.openstack.org/524267 | 19:04 |
| *** derekh has joined #openstack-infra | 19:04 | |
| dmsimard | mwhahaha: did you get around to undertanding why we had DNS lookup successes and failures right after ? | 19:05 |
| *** eroux has quit IRC | 19:05 | |
| *** dhinesh has quit IRC | 19:05 | |
| openstackgerrit | Louis Fourie proposed openstack-infra/irc-meetings master: Change meeting time and channel https://review.openstack.org/524319 | 19:05 |
| *** dhinesh has joined #openstack-infra | 19:06 | |
| *** dhinesh_ has quit IRC | 19:08 | |
| *** amoralej is now known as amoralej|off | 19:08 | |
| *** jascott1 has joined #openstack-infra | 19:11 | |
| pabelanger | clarkb: dmsimard: lets see if we can add the logstash query into elastic recheck, I find that easier to use then ethercalc.o.o | 19:13 |
| pabelanger | kolla / OSA likey need an audit to confirm they are using our reverse proxies directly | 19:14 |
| *** Goneri has quit IRC | 19:14 | |
| pabelanger | but agree, we should see what DNS is failing there | 19:15 |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Remove legacy jobs from Keystone https://review.openstack.org/524232 | 19:15 |
| *** felipemonteiro has joined #openstack-infra | 19:17 | |
| *** pblaho has quit IRC | 19:18 | |
| *** mat128_ has joined #openstack-infra | 19:19 | |
| *** pblaho has joined #openstack-infra | 19:19 | |
| *** mat128 has quit IRC | 19:22 | |
| mwhahaha | dmsimard: nope | 19:24 |
| dmsimard | pabelanger: I haven't found a query without false positives, that's just the only thing I'm concerned about | 19:25 |
| openstackgerrit | Jonathan Bryce proposed openstack-infra/system-config master: Create mailman server for Kata Containers https://review.openstack.org/524322 | 19:25 |
| *** xingchao has joined #openstack-infra | 19:29 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Remove tox-siblings role stub https://review.openstack.org/523996 | 19:30 |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added new get companies endpoint https://review.openstack.org/524323 | 19:30 |
| frickler | fungi: mordred: did some further testing, the user does get forwarded to the new channel after the message about the old channel. seems it just didn't happen to me on my initial testing because I was already joined to the new one. but looks like the instruction are working well in the end | 19:30 |
| *** adisky_ has quit IRC | 19:30 | |
| *** rbrndt has joined #openstack-infra | 19:30 | |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added new get companies endpoint https://review.openstack.org/524323 | 19:31 |
| pabelanger | fungi: clarkb: https://review.openstack.org/524267 should let us stand up a new zookeeper cluster, confirm it works, then join nodepool.o.o to it. | 19:32 |
| AJaeger | mordred: tox-siblings is done... | 19:34 |
| pabelanger | Yay | 19:34 |
| dhellmann | mordred : what was the final outcome of all the release notes jobs changes? I have one failing because openstackdocstheme isn't installed and I'm not sure how to add that to a dependency list any more | 19:34 |
| dhellmann | AJaeger : maybe you know? ^^ | 19:35 |
| *** rlandy|mtg is now known as rlandy | 19:35 | |
| dhellmann | I see it trying to install {{zuul_work_dir}}/requirements.txt but I don't want to add the theme to the requirements for stevedore just for the release notes build | 19:35 |
| dhellmann | it's already in a "docs" extra | 19:36 |
| dhellmann | ah, maybe doc/requirements.txt | 19:37 |
| pabelanger | dhellmann: yah, I believe that is correct now | 19:38 |
| *** electrofelix has quit IRC | 19:38 | |
| *** jkilpatr has quit IRC | 19:39 | |
| dhellmann | pabelanger : thanks | 19:40 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/puppet-openstackci master: Add support for installing ARA wsgi middleware for sqlite databases https://review.openstack.org/513866 | 19:40 |
| openstackgerrit | Gage Hugo proposed openstack-infra/project-config master: Remove legacy jobs from Keystone https://review.openstack.org/524232 | 19:41 |
| *** rwsu has quit IRC | 19:42 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: Don't run functional test jobs for requirements changes https://review.openstack.org/523947 | 19:43 |
| AJaeger | dhellmann: you can create doc/requirements.txt or add to test-requirements.txt | 19:46 |
| *** florianf|afk is now known as florianf | 19:46 | |
| *** xingchao has quit IRC | 19:47 | |
| openstackgerrit | sebastian marcet proposed openstack-infra/openstackid-resources master: Added new get groups endpoint https://review.openstack.org/524327 | 19:50 |
| openstackgerrit | Merged openstack/os-testr master: Updated from global requirements https://review.openstack.org/520476 | 19:51 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Added new get groups endpoint https://review.openstack.org/524327 | 19:51 |
| dmsimard | clarkb: I'm going to steal your hack to keep ara up to date on zuul executors to keep it up to date on logs.o.o (for sqlite over http) | 19:53 |
| dmsimard | however I'm noticing that there is a difference between pip<9 and pip>=9 | 19:53 |
| dmsimard | pip2 <9 doesn't support --format=columns.. can someone tell me what version of pip is on logs.o.o? :) | 19:54 |
| *** rwsu has joined #openstack-infra | 19:56 | |
| clarkb | dmsimard: pip 9.0.1 from /usr/local/lib/python2.7/dist-packages (python 2.7) | 19:56 |
| dmsimard | clarkb: ack, this also gives me the opportunity to test it | 19:56 |
| dmsimard | clarkb: I think onlyif might not be appropriate unless I'm mistaken | 19:56 |
| clarkb | onlyif says run the actual command only if this command succeeds | 19:57 |
| dmsimard | For example, if I'm not up to date, that snippet exits 1 though | 19:57 |
| clarkb | it should exit 0 due to the != | 19:57 |
| clarkb | its saying only run this if the local install does not equal latest upstream install | 19:58 |
| clarkb | (could be buggy though) | 19:58 |
| dmsimard | hmmmmm | 19:58 |
| dmsimard | clarkb: there's something weird going on: http://paste.openstack.org/raw/627922/ | 19:58 |
| dmsimard | full paste: http://paste.openstack.org/raw/627923/ | 19:59 |
| *** SumitNaiksatam has quit IRC | 20:00 | |
| clarkb | it is possible that the stuff after -- needs quoting because your shell is interpreting it | 20:00 |
| clarkb | I don't think it that is the case when puppet runs it because puppet isn't running it under a shell? | 20:00 |
| dmsimard | yeah I think it's the -- | 20:00 |
| clarkb | the -- should be fine, its the quoting I think | 20:00 |
| *** smatzek has quit IRC | 20:00 | |
| clarkb | (or lack of it) | 20:00 |
| dmsimard | clarkb: this works: http://paste.openstack.org/show/627924/ | 20:00 |
| dmsimard | I don't think you need '--' unless you're passing from stdin | 20:00 |
| *** smatzek has joined #openstack-infra | 20:00 | |
| *** smatzek has quit IRC | 20:01 | |
| clarkb | dmsimard: it is a way of avoiding the need for quotes in puppet because nested quotes in puppet makes eyeballs hurt | 20:01 |
| clarkb | but if its clearer for local reproduction we can use the quotes instead | 20:01 |
| dmsimard | well, does it really work in puppet ? cause like I said it returns 1 here | 20:01 |
| dmsimard | let me preprend bash -x | 20:01 |
| clarkb | dmsimard: I think it does beacuse puppet execs it directly, there is no shell to interpret the things after the -- | 20:01 |
| dmsimard | lol bash -x isn't very helpful, just outputs the test command | 20:02 |
| clarkb | the issue is the outer shell interpreting the stuff after -- before the inner shell gets it | 20:02 |
| clarkb | (I think) | 20:02 |
| dmsimard | clarkb: I'll try running it through puppet and see what happens | 20:02 |
| clarkb | I'm happy to have one version that works in both places even if it is a bit harder to read | 20:03 |
| *** dhajare_ has quit IRC | 20:05 | |
| *** jascott1 has quit IRC | 20:05 | |
| *** kmalloc has joined #openstack-infra | 20:07 | |
| fungi | yay wireless modem...a fiber cut has taken my broadband isp offline island-wide for going on two hours already | 20:07 |
| clarkb | fungi: vacation! | 20:08 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - testing change on mtus and step_2 https://review.openstack.org/524332 | 20:09 |
| fungi | well, it's been a good opportunity to catch up on housework i've been neglecting, but that got boring so i found alternative connectivity | 20:09 |
| *** bmjen has quit IRC | 20:09 | |
| dmsimard | clarkb: left a comment in https://review.openstack.org/#/c/516740/, I think we need to remove the '--' | 20:09 |
| *** mguiney has quit IRC | 20:10 | |
| clarkb | dmsimard: thanks for checking I'll get a new patchset up shortly. | 20:10 |
| *** bmjen has joined #openstack-infra | 20:10 | |
| dmsimard | clarkb: np, thanks for coming up with the solution in the first place :D | 20:11 |
| *** mguiney has joined #openstack-infra | 20:11 | |
| dmsimard | I'm very very rusty in puppet :) | 20:11 |
| *** jtomasek has quit IRC | 20:13 | |
| mordred | dmsimard: so say we all | 20:13 |
| clarkb | Heads up I signed us up for the PTG with the current data I have from informal polling. See everyone that can make it there | 20:13 |
| *** ldnunes has quit IRC | 20:14 | |
| dhellmann | it seems like someone said something earlier today about a doc build failure because of an rsync problem. Is that an ongoing issue? http://logs.openstack.org/25/524325/1/check/build-openstack-sphinx-docs/e7d682b/ara/ | 20:15 |
| openstackgerrit | Clark Boylan proposed openstack-infra/puppet-zuul master: Ensure ara is updated on executors https://review.openstack.org/516740 | 20:15 |
| clarkb | dmsimard: ^ there you go | 20:15 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/irc-meetings master: Change meeting chair for I18n team meeting https://review.openstack.org/524334 | 20:15 |
| openstackgerrit | Jonathan Bryce proposed openstack-infra/system-config master: Create mailman server for Kata Containers https://review.openstack.org/524322 | 20:15 |
| dhellmann | nevermind, this looks like there is another failure earlier in the process | 20:16 |
| clarkb | dhellmann: in that case it looks like tox failed due to no build_sphinx command. I wonder if that is fallout from the thing that mordred ran into early this mornign? | 20:16 |
| dhellmann | the fact that ara shows some steps in reverse order and others in the right order is confusing | 20:16 |
| clarkb | timestamps seem recent though so I don't think it is that | 20:17 |
| clarkb | dhellmann: ya it alpha sorts the filenames I think rather than sorting on timestamp | 20:17 |
| clarkb | dmsimard: ^ feature request :) | 20:17 |
| dhellmann | clarkb : it seems to show the YAML files in reverse order, and the steps within each file in chronological order | 20:17 |
| dhellmann | I suppose that puts the failure closer to the top of the output | 20:18 |
| dhellmann | so, does the build-openstack-sphinx-docs job work differently from the release notes job in terms of dependencies? the patch that's failing is moving the requirements into the new doc file | 20:18 |
| dhellmann | doc/requirements.txt that is | 20:19 |
| *** rwsu has quit IRC | 20:19 | |
| fungi | dhellmann: the earlier rsync comment was regarding the meetings page ical publisher which was missing a trailing slash (i expect dating back to the original v3 job conversion since the calendar last updated before then) | 20:19 |
| dhellmann | fungi : ah, right, thanks. this is definitely not that. | 20:19 |
| mordred | dhellmann: looking | 20:19 |
| fungi | got fixed yesterday if my memory is correct | 20:19 |
| dhellmann | mordred : I think I understand how to fix it. I'm just confused as to the state of these docs jobs. I thought they were all looking at the same files? | 20:20 |
| mordred | dhellmann: yes - well, that would be a version of the world that is lovely and is where we'll end us - we're unfortunately straddling a chasm of boiling lava currently ... | 20:21 |
| AJaeger | could I get some reviews for infra-manual, please? https://review.openstack.org/522642 mentions doc/test-requirements.txt | 20:21 |
| dhellmann | mordred : such vivid imagery | 20:22 |
| mordred | dhellmann: tl;dr - releasenotes new, build-sphinx old - so build-sphinx is still doing tox -evenv -- python setup.py build_sphinx | 20:22 |
| dhellmann | ok, so I'll put the doc requirements in the list for the venv env | 20:22 |
| AJaeger | fungi: yeah, a systematic conversion error - the missing slash. Hope we now have them all. I checked at one time but missed ical | 20:22 |
| mordred | dhellmann: I'm extra sad that it's taken this long to get this far :( | 20:22 |
| mordred | dhellmann: cool. and sorry - it's a saga that's definitely long in the tooth | 20:23 |
| dhellmann | mordred : yeah, I think I misunderstood something I saw late last week that made me think it was all done | 20:23 |
| mordred | dhellmann: I have learned many many things about tox_install.sh files over the last 2 weeks | 20:24 |
| dhellmann | mordred : with a little luck you'll be able to forget all of that again some day | 20:24 |
| dmsimard | dhellmann: hi, re: sorting and ordering in ARA. It'll be made more consistent (and configurable by the operator) in the next major release. It'll be a while but it's already in the todo. | 20:24 |
| dhellmann | dmsimard : sounds great, thanks! | 20:25 |
| dmsimard | Keep the feedback coming if there's anything else, happy to write things down | 20:25 |
| *** sree has joined #openstack-infra | 20:25 | |
| fungi | late to the game on doc/requirements.txt but this seems like something extras was designed to address... should/can pbr integrate those concepts at all? | 20:26 |
| mordred | dhellmann: we're getting closer! we're now in a position to remove all of the tox_install.sh files that don't have additional dependencies encoded in them ... now we just have to figure out how to script *that* | 20:26 |
| dhellmann | dmsimard : I find that I need a lot of clicks to get to useful details, and it's not always obvious what clicking on any given element of the UI is going to tell me (which maybe contributes to me clicking in the wrong places a bunch still). I don't have any actionable about how to change the UI to address that, though. | 20:26 |
| mordred | fungi: it can indeed ... and there is a todo list item to add support to pbr for exposing things in doc/requirements.txt as a doc extra ... HOWEVER ... | 20:27 |
| fungi | though i suppose extras assumes a context where you're installing the package which carries the extras list, so maybe that's a poor fit after all if we want to be able to build docs without installing the projects whose docs we're building? | 20:27 |
| dhellmann | mordred : the release team did have a discussion about just publishing all of our code to pypi. I thought that was one solution? | 20:27 |
| dhellmann | if a project needs neutron, it would just list neutron in the dependency list | 20:27 |
| mordred | dhellmann: yes - that's the thing that's required for the projects that use tox_install.sh to install software that is not listed in their requirements files | 20:27 |
| mordred | but a bunch of projects are only using it to deal with constraints- and there is another solution that's been found for that | 20:28 |
| dmsimard | dhellmann: yeah.. I'll admit that I am neither a frontend or a UX expert. I'd love to have contributions to improve it! | 20:28 |
| dhellmann | dmsimard : I will try to come up with at least a more specific suggestion | 20:28 |
| fungi | dhellmann: dmsimard: i think my related ui critique of ara is that we're using it to analyze job results but using its ui assumes an understanding of ansible terminology | 20:28 |
| openstackgerrit | Gaëtan Trellu proposed openstack/diskimage-builder master: Fix wrong epel-release-7* package URL https://review.openstack.org/524341 | 20:28 |
| dhellmann | fungi : good point | 20:28 |
| mordred | fungi: however - not all of the things that want to have sphinx docs built are python projects ... so yes, what you said, extras assumes a context where you're installing a python package | 20:28 |
| *** sree has quit IRC | 20:29 | |
| fungi | mordred: aha! yes excellent point. i had python tunnelvision again | 20:29 |
| dmsimard | fungi: I think some of the stuff slated for 1.0 will help alleviate some of that. Namely being able to name playbooks and put them in logical groups/phases | 20:30 |
| *** Goneri has joined #openstack-infra | 20:30 | |
| fungi | dhellmann: dmsimard: granted i don't know that people are likely to get very far reading raw zuul v3 job logs either if they don't understand the relationship between "playbooks," "roles" and "tasks" | 20:31 |
| openstackgerrit | Gaëtan Trellu proposed openstack/diskimage-builder master: Fix wrong epel-release-7* package URL https://review.openstack.org/524341 | 20:31 |
| fungi | though there is also the issue that i have to keep reminding myself that the way to view the task output is to click on its result status | 20:32 |
| *** slaweq has joined #openstack-infra | 20:32 | |
| *** Apoorva_ has joined #openstack-infra | 20:32 | |
| fungi | it's a clean enough way to avoid adding a separate ui element for "log" or "output" but it's still a little non-intuitive | 20:32 |
| dmsimard | Agreed | 20:33 |
| AJaeger | mordred: are you using a common topic for removing of tox_install? I have just pushed up two changes for docs repos to see whether it really works ... | 20:33 |
| fungi | same, though to a lesser extent, with clicking the task's name in the results breakdown to see the raw task definition | 20:33 |
| fungi | i tend to click on the name of the task expecting to get the log, and then stare confused for a moment at its definition before realizing i clicked the wrong thing again | 20:34 |
| *** slaweq has quit IRC | 20:34 | |
| AJaeger | mordred: does not work with my approach, I get "Could not satisfy constraints for 'openstackdocstheme': installation from path or url cannot be constrained to a version" - see http://logs.openstack.org/40/524340/1/check/build-openstack-sphinx-docs/dffbece/ara/ | 20:34 |
| dmsimard | There's definitely a lot of play on compromises and balance to keep the interface as simple as possible with the amount of data involved | 20:34 |
| *** slaweq has joined #openstack-infra | 20:34 | |
| mordred | AJaeger: no - haven't gotten as far as a topic yet | 20:34 |
| fungi | all that is to say... ui design is hard, and i think you've done a really great job with it | 20:35 |
| mordred | AJaeger: oh - piddle - lemme look at your patch | 20:35 |
| *** sboyron has joined #openstack-infra | 20:35 | |
| dmsimard | I agree that it needs to be more intuitive | 20:35 |
| dmsimard | If anyone has ideas I'm all ears | 20:35 |
| fungi | it's better than what i would probably have made ;) | 20:35 |
| dmsimard | Oh, there's also the question mark icon at the top right with tips | 20:35 |
| AJaeger | mordred: https://review.openstack.org/524340 - problem is that openstackdocstheme is in the constraints file | 20:35 |
| *** Apoorva has quit IRC | 20:36 | |
| fungi | it's a super-high-information-density interface, so really anything you do to make it more intuitive will probably mean reducing information density | 20:36 |
| mordred | AJaeger: I left you a comment | 20:37 |
| mordred | AJaeger: (it's likely too long of a comment - I seem to be in a verbose mood today) | 20:37 |
| * fungi imagines ara with a st:tng "lcars" style display | 20:37 | |
| AJaeger | mordred: thanks, reading and changing... | 20:38 |
| *** e0ne has joined #openstack-infra | 20:39 | |
| mordred | AJaeger: so far every time I've thought about attempting to script a patch-bomb for this, I have given up and done something else | 20:39 |
| AJaeger | mordred: yeah ;( For some changes in the past I did a script that called my editor - so 90 % automatic... | 20:40 |
| AJaeger | mordred: only 164 tox_install.sh files... | 20:40 |
| AJaeger | and I'm trying to fix two of them ;) | 20:41 |
| AJaeger | mordred: using topic rm-tox_install now... | 20:44 |
| mordred | cool | 20:44 |
| AJaeger | but not scripting it ;( | 20:46 |
| mordred | AJaeger: no - I think getting at least 2 or 3 of them solid by hand first is a very good idea | 20:46 |
| AJaeger | mordred: https://review.openstack.org/524340 is still not happy ;( What did I do wrong? | 20:47 |
| AJaeger | http://logs.openstack.org/40/524340/2/check/build-openstack-api-ref/14bc6db/job-output.txt.gz#_2017-11-30_20_44_32_459858 | 20:47 |
| mordred | AJaeger: it's probably my fault | 20:48 |
| mordred | AJaeger: oh - just remove line 12 | 20:48 |
| *** xingchao has joined #openstack-infra | 20:48 | |
| AJaeger | mordred: https://review.openstack.org/#/c/524342 is fine ;) | 20:49 |
| AJaeger | fixing... | 20:49 |
| mordred | awesome | 20:49 |
| mordred | also | 20:49 |
| mordred | setenv = | 20:50 |
| mordred | VIRTUAL_ENV={envdir} | 20:50 |
| mordred | ... doesn't virtualenv set that anyway? | 20:50 |
| AJaeger | mordred: wait, that means I can't use the [test] from setup.cfg anymore - can I? | 20:50 |
| mordred | AJaeger: that's right - we lose '.[test]' to be able to use constraints without a wrapper script ... is [test] from setup.cfg important and we need to figure out a way to keep it? | 20:51 |
| openstackgerrit | Ronelle Landy proposed openstack-infra/tripleo-ci master: DNM - testing change on mtus and step_2 https://review.openstack.org/524332 | 20:52 |
| *** derekh has quit IRC | 20:52 | |
| AJaeger | mordred: not sure whether it's important - but it's something people did and thus would need to change... | 20:52 |
| mordred | AJaeger: looking at openstackdocstheme now ... | 20:53 |
| AJaeger | mordred: I'll fix myself, shouldn't be too hard... | 20:53 |
| mordred | interesting - any idea why one would choose extras test vs. test-requirements.txt ? | 20:53 |
| mordred | AJaeger: I see a note about a dependency cycle | 20:53 |
| AJaeger | yeah, just read it as well ;( Probably come in from RPM packaging... | 20:54 |
| mordred | AJaeger: oh - you know what- for both of those I think the addition of doc/requirements.txt may help here | 20:54 |
| *** pcaruana has quit IRC | 20:55 | |
| AJaeger | ;) | 20:55 |
| AJaeger | will try.. | 20:55 |
| mordred | AJaeger: although, if you try doc/requirements.txt - be sure to add it to the deps list in tox for now, since the existing sphinx job still uses tox -evenv | 20:55 |
| AJaeger | done | 20:56 |
| mordred | AJaeger: once we land the sphinx update we should be able to move to only having doc/requirements.txt on docs or releasenotes helper envs | 20:56 |
| *** mhayden has quit IRC | 20:56 | |
| *** mhayden has joined #openstack-infra | 20:57 | |
| AJaeger | mordred: yeah... | 20:57 |
| *** e0ne has quit IRC | 20:58 | |
| AJaeger | mordred: next minefield ;/ http://logs.openstack.org/44/524344/1/check/legacy-nova-api-ref-src/8066735/job-output.txt.gz#_2017-11-30_20_48_45_233196 | 20:59 |
| mordred | AJaeger: yay! | 20:59 |
| mordred | AJaeger: so - legacy-nova-api-ref-src is a job that is running the nova api ref build job but with the proposed patch to api-ref right? | 21:01 |
| AJaeger | mordred: yes | 21:02 |
| *** Apoorva_ has quit IRC | 21:03 | |
| *** Apoorva has joined #openstack-infra | 21:04 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Create ovb-ha-ipv6 and deprecate fs024 job https://review.openstack.org/523903 | 21:04 |
| *** hashar has joined #openstack-infra | 21:05 | |
| AJaeger | mordred: are you going to convert the job? Or should we just patch it? I can patch it quickly... | 21:07 |
| mordred | AJaeger: yes - converted job coming ... | 21:07 |
| *** hasharDinner has quit IRC | 21:08 | |
| AJaeger | mordred: thanks | 21:08 |
| *** jkilpatr has joined #openstack-infra | 21:09 | |
| mordred | AJaeger: ok - I stacked yours on top of it - so we should be able to see if it works in both versions | 21:09 |
| mordred | and if so, we cna drop the legacy one | 21:09 |
| AJaeger | ok, thanks | 21:09 |
| clarkb | fungi: mordred care to be second reviewer on https://review.openstack.org/#/c/523955/ ? I can keep track of the workers after it merges to make sure that we actually don't fill up their disks | 21:11 |
| mordred | clarkb on it | 21:11 |
| mordred | clarkb: done | 21:12 |
| *** threestrands has joined #openstack-infra | 21:12 | |
| clarkb | tyty | 21:12 |
| * clarkb pops out for lunch while that does the zuul and puppet ansible dance | 21:12 | |
| *** aeng has joined #openstack-infra | 21:18 | |
| *** ccamacho has quit IRC | 21:21 | |
| *** pcaruana has joined #openstack-infra | 21:24 | |
| *** raissa_ has quit IRC | 21:25 | |
| *** raissa has joined #openstack-infra | 21:27 | |
| *** raissa has quit IRC | 21:27 | |
| *** rhallisey has quit IRC | 21:27 | |
| *** kgiusti has quit IRC | 21:27 | |
| *** raissa has joined #openstack-infra | 21:27 | |
| *** florianf has quit IRC | 21:28 | |
| *** raissa has quit IRC | 21:28 | |
| *** raissa has joined #openstack-infra | 21:28 | |
| *** raissa has joined #openstack-infra | 21:29 | |
| *** Apoorva_ has joined #openstack-infra | 21:29 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/openstack-zuul-jobs master: Remove legacy-nova-api-ref-src job https://review.openstack.org/524394 | 21:29 |
| AJaeger | mordred: I trust we get it fixed ;) - will WIP for now ^ | 21:29 |
| *** raissa has quit IRC | 21:29 | |
| openstackgerrit | Andreas Jaeger proposed openstack-infra/project-config master: Remove legacy-nova-api-ref-src https://review.openstack.org/524395 | 21:29 |
| *** raissa has joined #openstack-infra | 21:30 | |
| *** raissa has quit IRC | 21:30 | |
| *** raissa has joined #openstack-infra | 21:31 | |
| *** raissa has quit IRC | 21:31 | |
| *** Apoorva has quit IRC | 21:32 | |
| *** rlandy is now known as rlandy|afk | 21:32 | |
| openstackgerrit | Merged openstack-infra/system-config master: Revert "Disable crm114 on the logstash worker nodes" https://review.openstack.org/523955 | 21:34 |
| *** dave-mccowan has quit IRC | 21:35 | |
| *** sree has joined #openstack-infra | 21:35 | |
| AJaeger | mordred: the post job fails with your new job, see http://logs.openstack.org/44/524344/4/check/os-api-ref-nova-src/ff8ce00/job-output.txt.gz#_2017-11-30_21_33_49_426989 - but otherwise looks fine. | 21:38 |
| *** pcaruana has quit IRC | 21:39 | |
| *** mat128_ has quit IRC | 21:39 | |
| *** hashar has quit IRC | 21:39 | |
| AJaeger | mordred: I don't understand the failures in https://review.openstack.org/#/c/524353/ . Something looks really broken, will recheck. | 21:39 |
| *** sree has quit IRC | 21:40 | |
| * AJaeger calls it a day now and waves good night | 21:40 | |
| mordred | AJaeger: ah - I do - and yes, I think there is a thing broken | 21:40 |
| mordred | I think fetch-sphinx-output is not honoring zuul_work_dir | 21:40 |
| mordred | yup. that's it. it's actually the post-playbook ... | 21:41 |
| openstackgerrit | Frank Kloeker proposed openstack-infra/system-config master: Upgrade translate-dev.o.o to Zanata 4.3.1 https://review.openstack.org/524400 | 21:42 |
| *** jamesmcarthur has quit IRC | 21:42 | |
| *** jamesmcarthur has joined #openstack-infra | 21:43 | |
| *** esberglu has quit IRC | 21:43 | |
| eumel8 | clarkb: ^^ best thing after lunch ;) | 21:43 |
| clarkb | eumel8: ha :) I have pulled it up will review :) | 21:44 |
| openstackgerrit | Monty Taylor proposed openstack-infra/openstack-zuul-jobs master: Make api jobs post playbooks honor zuul_work_dir https://review.openstack.org/524401 | 21:44 |
| mordred | AJaeger: ^^ | 21:44 |
| eumel8 | great | 21:44 |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/devstack-gate master: WIP Create a tets matrix role https://review.openstack.org/524402 | 21:44 |
| sboyron | clarkb: Hi, thank you for your information about the translation check needs. | 21:44 |
| *** efoley has quit IRC | 21:45 | |
| *** jamesmcarthur has quit IRC | 21:45 | |
| clarkb | sboyron: hello, eumel8 is here and may be able to quickly fill you in on what is missing for that | 21:45 |
| sboyron | eumel8: Hi, clarkb said me that you can help me to understand what is needed for translation checks | 21:45 |
| clarkb | eumel8: sboyron is interested in helping infra and using OSA and so I pointed at the translation checksite as a possible task to help with | 21:45 |
| andreaf | jeblair, sdague: this is still WIP - but the idea is to have a test matrix role in d-g which can be used in devstack base job to set the base set of enabled services https://review.openstack.org/524402 | 21:46 |
| andreaf | jeblair, sdague: jobs could also use something like this https://review.openstack.org/524402 to disable all services if needed and override the list | 21:47 |
| eumel8 | sboyron: oh yeah, we're here: https://review.openstack.org/#/c/487936/ | 21:47 |
| andreaf | this should give roughly parity with what jobs can do today on enabling / disabling services | 21:47 |
| andreaf | jeblair, sdague: let me know if you have any comment on this solution | 21:48 |
| eumel8 | sboyron: setting up new machine, fetch OSA sources and start installation script | 21:48 |
| andreaf | this is the main big piece missing in devstack jobs (aparts from bits and pieces of logs and configs) | 21:48 |
| Shrews | clarkb: pabelanger: either of you want to chime in on the change to alien-list in https://review.openstack.org/522495 ? It really doesn't seem like the right thing to do to me, but maybe I'm wrong. | 21:49 |
| clarkb | Shrews: sure I'll take a look after reviewing this zanata change | 21:49 |
| eumel8 | sboyron: last information from andymccr was doing the last step manually, so there is ssh access configured | 21:49 |
| clarkb | eumel8: for the zanata-dev change can you add to the etherpad where in the upgrade process that chagne should be merged? | 21:51 |
| clarkb | eumel8: and maybe WIP the chagne so that we don't do it at the wrong step (if that is a concern) | 21:51 |
| *** gyee has quit IRC | 21:54 | |
| *** jamesmcarthur has joined #openstack-infra | 21:55 | |
| *** esberglu has joined #openstack-infra | 21:55 | |
| eumel8 | clarkb: yes, thats the gray zone for me. puppet apply is running in cron? | 21:56 |
| mordred | Shrews: I left a comment on it for one of the things | 21:56 |
| clarkb | eumel8: yes it runs in a cron, but we can disable it on the node. So one step would probably be disable puppet on translate-dev01.openstack.org, then do things, then later merge the change, then enable puppet again | 21:58 |
| *** mnencia_ has joined #openstack-infra | 21:58 | |
| eumel8 | clarkb: yes, first of all we need a backup of /opt/wildfly and zanata database. | 21:59 |
| eumel8 | but it's not so critical on dev server | 22:00 |
| clarkb | eumel8: we should run the steps just to be sure they work before the production upgrade though so we'll do them on dev too | 22:00 |
| clarkb | eumel8: so probably steps are stop puppet, perform backup, do anything else necessary, merge puppet change enable puppet? | 22:00 |
| eumel8 | clarkb: yes, I can agree | 22:02 |
| *** hemna_ has joined #openstack-infra | 22:04 | |
| *** rfolco has quit IRC | 22:04 | |
| Shrews | mordred: thx. i think the issue with that is that we are outputing public_v4, not interface_ip | 22:05 |
| mordred | Shrews: ah- well, in that case, we should probably be outputting interface_ip (which would also get us ipv6 if it's there) - although, if someone is using that command to get a list and is going to copy and paste the ip to a different machine for the purposes of login - it's possible that other machine might not have ipv6 | 22:06 |
| jeblair | we may want to consider removing the alien-list command | 22:06 |
| jeblair | what it was meant to accomplish is handled automatically now | 22:07 |
| Shrews | i don't know how useful it is to see non-nodepool nodes from it (which is why i thought it'd be good for others to comment) | 22:08 |
| clarkb | jeblair: oh right the alien cleanup cron deletes any node with nodepool metadata that is not in the nodepool db | 22:08 |
| *** Apoorva_ has quit IRC | 22:08 | |
| fungi | i agree, it's no longer needed (i haven't used it since shortly after nodepool learned how to clean up after itself) | 22:08 |
| mordred | jeblair, Shrews: I think the most important thing in that review is whether or not we want to explicitly support the shared-project use case - seems likea thing we should have an answer on and all agree that it's the answer | 22:09 |
| *** Apoorva has joined #openstack-infra | 22:09 | |
| mordred | well, 'most important' is not the right english | 22:09 |
| jeblair | yep. so we're left with either rui's suggestion, which should be automatic, or as-is, which is better handled by 'nova list' i think. | 22:09 |
| mordred | so "I think an important thing from that" ... | 22:09 |
| jeblair | mordred: aiui nodepool can currently coexist with other nodepools, and other uses of the same projectenant. but in all cases, you have to be very careful with quota or you will get lots of errors. | 22:10 |
| jeblair | all cases are likely improved by the pending quota patches | 22:10 |
| jeblair | (and by very careful, i mean, basically, more careful than anyone ever is, so it usually won't work well) | 22:11 |
| Shrews | it can also be confusing when you set max-servers to X, but you get "quota exceeded" when you've used less than X | 22:11 |
| jeblair | yep. | 22:11 |
| mordred | this is true -although aren't tobias' quota patches intended to make that suckless? | 22:12 |
| jeblair | i think the story changes significantly with tobiash's quota patches which grok actual limits. | 22:12 |
| mordred | jinx | 22:12 |
| jeblair | well, i tried to say that at 22:10 :) | 22:12 |
| *** kjackal has quit IRC | 22:12 | |
| jeblair | i just didn't say the magic word tobiash :) | 22:12 |
| tosky | mordred: totally unrelated question (I think it was I while since I nagged you about this): any progress on the "Change publication interface to be directories on node, not executor" proposal? | 22:13 |
| *** priteau has quit IRC | 22:13 | |
| jeblair | andreaf: you linked to the same change twice -- did you have an example use of 524402? | 22:15 |
| clarkb | Shrews: fwiw that totally happens with our single nodepool install and its extra confusing then | 22:16 |
| *** kjackal has joined #openstack-infra | 22:17 | |
| mordred | tosky: it's stacked behind a couple of other things - but it's VERY high on my todo list | 22:17 |
| jeblair | andreaf: but i like it :) | 22:17 |
| clarkb | mordred: re shared tenant for nodepools my "in a perfect world" answer is there is no reason for that because keystone v3 | 22:17 |
| andreaf | the other patch is https://review.openstack.org/#/c/524224/ | 22:17 |
| clarkb | mordred: you should just give each nodepool its own tenant/project and its own quotas because keystone v3 makes it easy | 22:17 |
| *** rfolco has joined #openstack-infra | 22:17 | |
| clarkb | reality is no one uses keystone v3 properly except for citycloud so we are all doomed | 22:17 |
| mordred | clarkb: well - yes, in a perfect world I totally agree with you | 22:17 |
| tosky | mordred: thanks; I'm waiting for it to convert the sahara jobs that publishes some tarballs, and in turn some changes for few new tarballs to be published | 22:18 |
| *** rcernin has joined #openstack-infra | 22:18 | |
| *** marst has quit IRC | 22:19 | |
| *** rcernin has quit IRC | 22:21 | |
| *** rcernin has joined #openstack-infra | 22:21 | |
| mordred | tosky: I will do my best to make headway on it tomorrow | 22:22 |
| *** ganso has quit IRC | 22:22 | |
| *** edmondsw has quit IRC | 22:24 | |
| *** edmondsw has joined #openstack-infra | 22:24 | |
| *** edmondsw has quit IRC | 22:25 | |
| tosky | mordred: thanks! I didn't want to push, just to know that it was still on the list | 22:25 |
| pabelanger | I can kinda see the want for a shared tennant and 2 nodepool. Poosible you don't have the budget to get a 2nd. | 22:25 |
| mordred | tosky: oh - very much so | 22:25 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove nodesets from builds canceled during reconfiguration https://review.openstack.org/524409 | 22:26 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Don't shrink windows on reconfiguration https://review.openstack.org/524410 | 22:26 |
| *** edmondsw_ has joined #openstack-infra | 22:27 | |
| jeblair | EmilienM, mwhahaha: ^ there are the bugfixes for this morning's fun | 22:27 |
| *** jascott1 has joined #openstack-infra | 22:27 | |
| jeblair | btw, we should keep an eye out for that happening again -- it absolutely could any time a queue grows longer than 20 items | 22:28 |
| *** camunoz has quit IRC | 22:28 | |
| mwhahaha | which is the tripleo queue every day :D | 22:28 |
| ianw | X-Clacks-Overhead: GNU Terry Pratchett ... that's a new one | 22:30 |
| *** edmondsw_ has quit IRC | 22:31 | |
| clarkb | I feel like I'm missing out on a good discworld joke by not having ever read any discworld | 22:32 |
| clarkb | amybe I will fix that this weekend | 22:32 |
| jeblair | clarkb: you are missing out on a *lot* of good discworld jokes that way :) | 22:32 |
| clarkb | they've been on my list of books to read but then i end up reading something super dark by Alastair Reynolds instead. I recently got halfway though the book about the angels and demons though I should finish that one first | 22:34 |
| *** erlon has quit IRC | 22:35 | |
| ianw | http://www.gnuterrypratchett.com/ ... fyi the GNU is not an indication of an attempt to make an open-source Terry Pratchett as i first assumed | 22:36 |
| ianw | bit of a shame his legacy is probably only noticed by annoyed developers debugging some silly issue, however :) | 22:37 |
| *** Goneri has quit IRC | 22:38 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Don't set job var override_checkout if null https://review.openstack.org/524414 | 22:42 |
| *** felipemonteiro has quit IRC | 22:44 | |
| jeblair | andreaf: ^ | 22:47 |
| *** wolverineav has quit IRC | 22:48 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Remove nodesets from builds canceled during reconfiguration https://review.openstack.org/524409 | 22:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Don't shrink windows on reconfiguration https://review.openstack.org/524410 | 22:49 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Don't set job var override_checkout if null https://review.openstack.org/524414 | 22:49 |
| *** jascott1 has quit IRC | 22:57 | |
| *** jascott1 has joined #openstack-infra | 22:58 | |
| openstackgerrit | Stibbons proposed openstack-dev/pbr master: allow version override only for non pkgmetadata https://review.openstack.org/524421 | 22:58 |
| *** boden has quit IRC | 22:58 | |
| *** jascott1 has quit IRC | 22:59 | |
| *** jascott1 has joined #openstack-infra | 22:59 | |
| *** jamesmcarthur has quit IRC | 23:00 | |
| *** jascott1 has quit IRC | 23:00 | |
| *** bobh has quit IRC | 23:01 | |
| *** slaweq has quit IRC | 23:02 | |
| *** felipemonteiro has joined #openstack-infra | 23:02 | |
| *** slaweq has joined #openstack-infra | 23:02 | |
| EmilienM | jeblair: ack, thanks | 23:05 |
| *** slaweq has quit IRC | 23:07 | |
| clarkb | general fyi disk use by elasticsearch still looks good after starting to keep additional days of data (up to 8 now) and logstash workers also haven't crumbled since the crm114 was added back in | 23:08 |
| clarkb | and queue sizes are still small | 23:08 |
| clarkb | sshnaidm|off: when you are back to a computer would be curious to know if the errors file is being indexed as you expect it | 23:09 |
| clarkb | looks like we still aren't generating an uncategorized jobs page | 23:10 |
| clarkb | I'll poke at that some more | 23:10 |
| clarkb | seems like there were changes to review related to that | 23:11 |
| *** jascott1 has joined #openstack-infra | 23:11 | |
| openstackgerrit | Stibbons proposed openstack-dev/pbr master: Test on Python 3.6 https://review.openstack.org/524426 | 23:11 |
| *** akscram1 has quit IRC | 23:12 | |
| clarkb | dmsimard: ^ I'm not seeing any changes to e-r related to that do you know if they got pushed or if I'm just blind? | 23:12 |
| *** akscram1 has joined #openstack-infra | 23:14 | |
| *** dprince has quit IRC | 23:16 | |
| *** Apoorva has quit IRC | 23:16 | |
| dmsimard | clarkb: I'm missing context | 23:16 |
| clarkb | dmsimard: http://status.openstack.org/elastic-recheck/data/integrated_gate.html still not updating | 23:17 |
| *** rlandy|afk is now known as rlandy | 23:17 | |
| clarkb | for some reason I think there is or was fixes for that but I could be misremembering with everyhting that has happened in the last couple montsh | 23:17 |
| clarkb | (if not yet fixes I'll dig in and see if I can fix) | 23:17 |
| dmsimard | I've... never seen that page before | 23:17 |
| dmsimard | and it looks amazing | 23:18 |
| dmsimard | moreso if it would be up to date | 23:18 |
| clarkb | ok I probbaly misremembered then. Will look into why it isn't updating | 23:18 |
| dmsimard | clarkb: what I remember is the date in the e-r main page being off while the results were up to date | 23:20 |
| dmsimard | and that was because of an outdated query (like, looking for console.html or something) | 23:20 |
| dmsimard | but the actual queries were accurate | 23:20 |
| clarkb | the timestamps on those listed failures are definitely too old to be up to date | 23:21 |
| dmsimard | clarkb: but that seems like a static page.. is something supposed to be generating it ? | 23:22 |
| dmsimard | clarkb: did we have a periodic zuul v2 job or something ? | 23:22 |
| *** iyamahat_ has joined #openstack-infra | 23:22 | |
| *** iyamahat has quit IRC | 23:22 | |
| *** bnemec has quit IRC | 23:22 | |
| clarkb | elastic recheck generates it on a cron twice per hour | 23:24 |
| clarkb | same as with the other e-r pages | 23:24 |
| pabelanger | Yah, looks like it hasn | 23:24 |
| pabelanger | 't updated since zuulv3 | 23:25 |
| *** pbourke has quit IRC | 23:28 | |
| clarkb | cd /var/lib/elastic-recheck && mkdir -p new && er_safe_run.sh elastic-recheck-uncategorized -d /opt/elastic-recheck/queries -t /usr/local/share/elastic-recheck/templates -o new && mv new/*.html . | 23:28 |
| clarkb | that is the cron command | 23:28 |
| clarkb | confirmed that the command is in cron as expected | 23:28 |
| *** pbourke has joined #openstack-infra | 23:30 | |
| clarkb | I05626c563a9a053e396782c54dae4c6fa7d6e269 <- was a fix for this so I am not entirely crazy | 23:30 |
| clarkb | its just not a sufficient fix I guess | 23:30 |
| clarkb | I'm going to try manually running that all fails query to see what I get | 23:31 |
| *** akscram1 has quit IRC | 23:32 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Don't shrink windows on reconfiguration https://review.openstack.org/524410 | 23:32 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Don't set job var override_checkout if null https://review.openstack.org/524414 | 23:32 |
| *** akscram1 has joined #openstack-infra | 23:34 | |
| *** sboyron has quit IRC | 23:37 | |
| *** felipemonteiro has quit IRC | 23:38 | |
| *** mnencia_ has quit IRC | 23:38 | |
| *** thorst has quit IRC | 23:41 | |
| *** salv-orlando has quit IRC | 23:41 | |
| *** stakeda has joined #openstack-infra | 23:43 | |
| openstackgerrit | Clark Boylan proposed openstack-infra/elastic-recheck master: Fix all fails query https://review.openstack.org/524428 | 23:44 |
| clarkb | pabelanger: dmsimard ^ based on manually running the query in kibana I think that is what is needed | 23:44 |
| *** Apoorva has joined #openstack-infra | 23:45 | |
| clarkb | mtreinish: mriedem ^ reviews on that much appreciated so that I can mark the e-r/logstash/elasticsearch zuulv3 stuff as mostly done (assuming this is the last missing piece) | 23:45 |
| mordred | clarkb: appropos of nothing, I have learned this evening that the version of pypy in xenial and the version of cryptography in upper-constraints are fundamentally incompatible | 23:49 |
| clarkb | mordred: yup | 23:50 |
| mordred | clarkb: and the solution is to use a newer version of pypy | 23:50 |
| clarkb | that is what instigated the lets just stop testing pypy iirc | 23:50 |
| clarkb | was everything broke one day after crytpography updated and we had a collective meh | 23:50 |
| *** rbrndt has quit IRC | 23:50 | |
| mordred | clarkb: well - for the sdk's pypy job I'm taking a stab at using a fedora-26 node instead of a xenial node | 23:50 |
| jeblair | mordred: oh, i guess we can't port that to c++ | 23:51 |
| mordred | since it has new enough pypy | 23:51 |
| mordred | jeblair: :) | 23:51 |
| mordred | jeblair: you say "can't" ... | 23:51 |
| mordred | jeblair: when I thnk you meant "probably shouldn't" | 23:51 |
| jeblair | yeah, i guess i mean, 'would be beside the point' :) | 23:51 |
| mordred | ++ | 23:51 |
| clarkb | you could always have a thin swig layer | 23:51 |
| mriedem | clarkb: commented - do you want to remove that TODO in there about zuulv2? | 23:52 |
| clarkb | except don't because track records have shown I will have to fix it for mordred | 23:52 |
| mordred | clarkb: comeon. you LOVE fixing mordred swig code | 23:52 |
| clarkb | mriedem: I think we need to keep supporting zuul v2 for other users | 23:52 |
| clarkb | mriedem: I feel like that is an in a year todo | 23:52 |
| mriedem | ah ok | 23:53 |
| mriedem | right, people actually maybe use e-r outside of upstream infra | 23:53 |
| clarkb | mriedem: ya that | 23:53 |
| mriedem | ok +2 | 23:53 |
| clarkb | mordred: love is a bit strong :) | 23:53 |
| *** Apoorva_ has joined #openstack-infra | 23:53 | |
| mordred | clarkb: oh - actually, this f26 pypy job may not be a terrible idea ... | 23:53 |
| mriedem | clarkb: you know what i loved recently? | 23:53 |
| mordred | I have just discovered that the bindep file is incompete | 23:53 |
| mordred | incomplete | 23:53 |
| *** jamesmcarthur has joined #openstack-infra | 23:53 | |
| clarkb | mordred: yay learning things | 23:53 |
| mriedem | blair walsh missing a game tying kick | 23:53 |
| clarkb | mriedem: case keenum? | 23:53 |
| clarkb | mriedem: lol | 23:53 |
| clarkb | mriedem: its so bad | 23:54 |
| mriedem | tbf, it was like 85 yards out | 23:54 |
| *** hemna_ has quit IRC | 23:54 | |
| mordred | anybdy konw the openssl devel package on f26 off the top of their heads? | 23:54 |
| mriedem | dansmith: got some hot sportball talk here for you | 23:54 |
| clarkb | mordred: fedora has a package search website, oen sec | 23:55 |
| clarkb | mordred: https://apps.fedoraproject.org/packages/ | 23:55 |
| clarkb | its annoying that centos does not | 23:55 |
| mordred | openssl-devel | 23:55 |
| mordred | thakns! | 23:55 |
| ianw | mordred: openssl-1.1.0f-7.fc26.src.rpm | 23:56 |
| *** felipemonteiro has joined #openstack-infra | 23:56 | |
| ianw | though we should have f27 soon | 23:56 |
| mordred | ianw: it should be a fairly seamless swap when we do - it's just a little tox job | 23:56 |
| *** Apoorva has quit IRC | 23:56 | |
| *** felipemonteiro_ has joined #openstack-infra | 23:57 | |
| *** Apoorva_ has quit IRC | 23:57 | |
| mordred | ianw: https://review.openstack.org/523383 Fix py35 and pypy tox env | 23:57 |
| mordred | fwiw | 23:57 |
| * ianw records that as famous last words | 23:57 | |
| *** Apoorva has joined #openstack-infra | 23:57 | |
| *** jamesmcarthur has quit IRC | 23:58 | |
| clarkb | mriedem: I'm mostly amazed that the rams are amazing | 23:58 |
| clarkb | mriedem: because well 8-8 is a meme | 23:59 |
| mordred | clarkb: yah. how the hell did the rams, you know, happen? | 23:59 |
| clarkb | mordred: ianw since you are both around either of you want to look at https://review.openstack.org/#/c/524428/ ? | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!