| *** dingyichen has joined #openstack-infra | 00:02 | |
| *** xarses has joined #openstack-infra | 00:03 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Remove comments questioning API capabilities https://review.openstack.org/499358 | 00:03 |
|---|---|---|
| *** xarses_ has quit IRC | 00:05 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Allow description fields in projects and project templates https://review.openstack.org/499365 | 00:07 |
| *** bobh has joined #openstack-infra | 00:08 | |
| *** xarses_ has joined #openstack-infra | 00:08 | |
| *** xarses has quit IRC | 00:10 | |
| *** thegreenhundred has joined #openstack-infra | 00:14 | |
| *** bobh has quit IRC | 00:14 | |
| *** ijw has joined #openstack-infra | 00:15 | |
| *** Swami has quit IRC | 00:15 | |
| *** ijw has quit IRC | 00:19 | |
| *** bobh has joined #openstack-infra | 00:21 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Handle logging ansible python errors properly https://review.openstack.org/499397 | 00:21 |
| *** salv-orlando has joined #openstack-infra | 00:22 | |
| *** markvoelker_ has quit IRC | 00:27 | |
| *** markvoelker has joined #openstack-infra | 00:28 | |
| *** markvoelker has quit IRC | 00:28 | |
| *** thorst_afk has joined #openstack-infra | 00:31 | |
| *** annegentle has joined #openstack-infra | 00:32 | |
| *** LindaWang has joined #openstack-infra | 00:33 | |
| *** Apoorva_ has quit IRC | 00:36 | |
| *** markvoelker has joined #openstack-infra | 00:44 | |
| *** baoli has joined #openstack-infra | 00:46 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Set the flag that allows pushing to checked out branch https://review.openstack.org/499400 | 00:47 |
| *** baoli has quit IRC | 00:47 | |
| pabelanger | jeblair: mordred: "msg": "[Errno 2] No such file or directory: 'kinit'", | 00:47 |
| pabelanger | http://logs.openstack.org/10/133c528c0e564cd3927d7c7640f23981b85a2310/post/publish-openstack-python-docs/0f7e2c4/job-output.txt.gz#_2017-08-31_00_07_17_932510 | 00:47 |
| pabelanger | guess we need to add the package to zuul-executors | 00:48 |
| pabelanger | I'll do that in the morning | 00:48 |
| *** baoli has joined #openstack-infra | 00:48 | |
| *** rama_y has quit IRC | 00:48 | |
| *** markvoelker has quit IRC | 00:48 | |
| pabelanger | guess we also need graphviz_dot in bindep too | 00:48 |
| *** zhurong has joined #openstack-infra | 00:48 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Remove no_log from fetch-sphinx-output https://review.openstack.org/499401 | 00:52 |
| mordred | pabelanger: oh - right - we nede ot add the afs::client puppet class to ze01 | 00:56 |
| mordred | thatshould be a fairly easy one-liner | 00:56 |
| pabelanger | ya | 00:56 |
| pabelanger | let me look real quick | 00:56 |
| mordred | pabelanger: got it | 00:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/system-config master: Install AFS client on ze* https://review.openstack.org/499402 | 00:57 |
| mordred | pabelanger: ^^ thereyago | 00:57 |
| pabelanger | Ah | 00:59 |
| pabelanger | +3 | 00:59 |
| pabelanger | thanks! | 00:59 |
| *** mriedem has quit IRC | 00:59 | |
| *** mudpuppy has quit IRC | 01:00 | |
| *** spotz has quit IRC | 01:00 | |
| *** yuanying has joined #openstack-infra | 01:00 | |
| *** yuanying_ has quit IRC | 01:04 | |
| *** yuanying_ has joined #openstack-infra | 01:04 | |
| *** yuanying has quit IRC | 01:05 | |
| *** mat128 has joined #openstack-infra | 01:07 | |
| *** ijw has joined #openstack-infra | 01:07 | |
| openstackgerrit | Merged openstack-infra/system-config master: Install AFS client on ze* https://review.openstack.org/499402 | 01:13 |
| *** ijw has quit IRC | 01:14 | |
| *** ijw has joined #openstack-infra | 01:15 | |
| *** bobh has quit IRC | 01:18 | |
| *** ijw has quit IRC | 01:20 | |
| *** Apoorva has joined #openstack-infra | 01:22 | |
| *** cuongnv has joined #openstack-infra | 01:24 | |
| *** s-shiono has joined #openstack-infra | 01:24 | |
| *** s-shiono has quit IRC | 01:24 | |
| *** Apoorva has quit IRC | 01:26 | |
| *** s-shiono has joined #openstack-infra | 01:27 | |
| *** squid has quit IRC | 01:29 | |
| *** squid has joined #openstack-infra | 01:33 | |
| *** mudpuppy has joined #openstack-infra | 01:35 | |
| *** spotz has joined #openstack-infra | 01:35 | |
| *** shu-mutou-AWAY is now known as shu-mutou | 01:36 | |
| *** abelur_ has joined #openstack-infra | 01:37 | |
| *** thorst_afk has quit IRC | 01:41 | |
| *** mat128 has quit IRC | 01:41 | |
| *** liujiong has joined #openstack-infra | 01:42 | |
| *** markvoelker has joined #openstack-infra | 01:44 | |
| *** hongbin has joined #openstack-infra | 01:50 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate master: [DMN] see what fails with special chars in passwords https://review.openstack.org/499415 | 01:52 |
| *** askb has quit IRC | 01:53 | |
| *** sdague has quit IRC | 01:56 | |
| *** thorst_afk has joined #openstack-infra | 02:00 | |
| *** jamesmcarthur has joined #openstack-infra | 02:01 | |
| *** yuanying_ has quit IRC | 02:01 | |
| *** yuanying has joined #openstack-infra | 02:04 | |
| *** jamesmcarthur has quit IRC | 02:06 | |
| *** Swami has joined #openstack-infra | 02:06 | |
| dmsimard | ianw: itshappening.gif | 02:07 |
| *** markvoelker has quit IRC | 02:18 | |
| *** yamahata has quit IRC | 02:19 | |
| *** iyamahat has quit IRC | 02:20 | |
| *** xinliang has quit IRC | 02:31 | |
| *** namnh has joined #openstack-infra | 02:35 | |
| *** mat128 has joined #openstack-infra | 02:41 | |
| *** xinliang has joined #openstack-infra | 02:44 | |
| *** ykarel has joined #openstack-infra | 02:44 | |
| *** thorst_afk has quit IRC | 02:45 | |
| *** thorst_afk has joined #openstack-infra | 02:46 | |
| *** thorst_afk has quit IRC | 02:50 | |
| *** jascott1 has quit IRC | 02:50 | |
| *** jascott1 has joined #openstack-infra | 02:51 | |
| openstackgerrit | Merged openstack-infra/devstack-gate master: Revert "Revert "Move fix_disk_layout to an Ansible role in setup_host"" https://review.openstack.org/499007 | 02:51 |
| *** gtrxcb has joined #openstack-infra | 02:54 | |
| *** jascott1 has quit IRC | 02:55 | |
| *** ijw has joined #openstack-infra | 02:56 | |
| ianw | dmsimard: thanks for working on it! guess what, you own it now :) | 02:56 |
| dmsimard | Awww yeah | 02:57 |
| dmsimard | Did you want to take a stab at ansibilization ? I can help review or vice versa | 02:57 |
| ianw | dmsimard: i'd like to, maybe tomorrow? | 02:59 |
| dmsimard | Sure, gave you a starting point in the gist from earlier, just add me as reviewer | 03:00 |
| *** ijw has quit IRC | 03:01 | |
| *** pcrews has quit IRC | 03:02 | |
| ianw | dmsimard: interestingly, maybe, ara seems to do something i just noticed in glance -> http://git.openstack.org/cgit/openstack/ara/tree/ara/db/env.py#n35 | 03:04 |
| ianw | see https://review.openstack.org/#/c/499410/ | 03:04 |
| *** nicolasbock has quit IRC | 03:05 | |
| dmsimard | Hm, never seen something like that before but then again we're not doing a very good job at testing MySQL in ara right now (which is something I want to address) | 03:07 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Reduce vexxhost to 10 server https://review.openstack.org/499425 | 03:09 |
| ianw | yeah, just came up within codesearch. anyway, adding a "@" to the mysql password makes for good coverage it seems | 03:09 |
| dmsimard | You can submit a patch to ara, I'll try and reproduce with and without it | 03:10 |
| dmsimard | Tomorrow :) | 03:10 |
| pabelanger | clarkb: ianw: mnaser: I'd like to reduce vexxhost down to 10nodes if possible, tripleo gate has reset about 4 times today because of timing out on vexxhost :( Since they still have released pike, it might help them meet there release schedule until we can explore more why the nodes are timing out | 03:10 |
| pabelanger | see 499425 | 03:11 |
| dmsimard | pabelanger: I've seen mnaser talk about Pike upgrades today, maybe related | 03:11 |
| pabelanger | dmsimard: oh, possible. I haven't had a chance to talk with mnaser much today. likely head down on that | 03:12 |
| *** mat128 has quit IRC | 03:12 | |
| pabelanger | in general, tripleo jobs are looking very well at the moment. Just the vexxhost times out have been hitting them mostly over the last week or so | 03:13 |
| *** ykarel has quit IRC | 03:13 | |
| dmsimard | pabelanger: the xvde patch is merging so hopefully that is a thing of the past | 03:14 |
| ianw | pabelanger: lgtm ... only so much we can do from the outside? | 03:15 |
| dmsimard | I'd like to check on that kind of recurring issue and iron them out after the ptg | 03:15 |
| *** markvoelker has joined #openstack-infra | 03:15 | |
| clarkb | ianw does dib do gpt yet? | 03:17 |
| pabelanger | ianw: I think there is possible 2 issues in vexxhost, maybe a networking limit between nodepool nodes and mirror (in different projects), and noisy neighbors. | 03:17 |
| pabelanger | ianw: these are just guesses right now, but I'd like to spend some time with mnaser on testing things | 03:17 |
| ianw | clarkb: no | 03:18 |
| pabelanger | clarkb: EmilienM: I also think tripleo can stop git cloning projects in devstack-gate, however that change likely needs to wait until PTG. Or we try an new experimental job | 03:19 |
| *** ramishra has joined #openstack-infra | 03:22 | |
| openstackgerrit | Merged openstack-infra/tripleo-ci master: In-tree ovs_vxlan_bridge function from devstack-gate https://review.openstack.org/498985 | 03:23 |
| ianw | pabelanger / mnaser : well, let me know if anything I can do, maybe it helps i'm in the opposite TZ for some of the testing | 03:24 |
| pabelanger | ianw: I've been looking at http://status.openstack.org/elastic-recheck/#1686542 to see if I can find a pattern. But haven't looked to deep. I know the last data I see, was some high dstat values | 03:25 |
| *** rama_y has joined #openstack-infra | 03:28 | |
| *** rama_y has quit IRC | 03:29 | |
| *** rama_y has joined #openstack-infra | 03:29 | |
| *** pcrews has joined #openstack-infra | 03:32 | |
| *** udesale has joined #openstack-infra | 03:37 | |
| *** links has joined #openstack-infra | 03:39 | |
| *** psachin has joined #openstack-infra | 03:43 | |
| *** thorst_afk has joined #openstack-infra | 03:47 | |
| *** markvoelker has quit IRC | 03:48 | |
| *** annegentle has quit IRC | 03:48 | |
| *** gouthamr has quit IRC | 03:49 | |
| *** thorst_afk has quit IRC | 03:51 | |
| EmilienM | pabelanger: ok | 03:53 |
| *** ykarel has joined #openstack-infra | 04:07 | |
| *** mat128 has joined #openstack-infra | 04:09 | |
| *** mat128 has quit IRC | 04:09 | |
| *** hongbin has quit IRC | 04:11 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: Skip gate-tripleo-buildimage-overcloud-full-centos when patching reno https://review.openstack.org/499452 | 04:13 |
| *** ijw has joined #openstack-infra | 04:16 | |
| *** yamahata has joined #openstack-infra | 04:19 | |
| *** ijw has quit IRC | 04:21 | |
| *** rama_y has quit IRC | 04:21 | |
| *** baoli has quit IRC | 04:23 | |
| *** zhurong has quit IRC | 04:29 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Preparing TripleO CI to test upgrades to Queens https://review.openstack.org/499359 | 04:29 |
| *** dhajare has joined #openstack-infra | 04:32 | |
| *** salv-orlando has quit IRC | 04:37 | |
| *** baoli has joined #openstack-infra | 04:37 | |
| *** markvoelker has joined #openstack-infra | 04:45 | |
| *** thorst_afk has joined #openstack-infra | 04:47 | |
| *** zhurong has joined #openstack-infra | 04:48 | |
| *** baoli has quit IRC | 04:49 | |
| *** thorst_afk has quit IRC | 04:52 | |
| *** armax has quit IRC | 04:53 | |
| *** salv-orlando has joined #openstack-infra | 05:09 | |
| openstackgerrit | Merged openstack-infra/groups master: Fix flag module unsupported operand types issue https://review.openstack.org/499340 | 05:10 |
| *** ianychoi__ has joined #openstack-infra | 05:12 | |
| *** ianychoi_ has quit IRC | 05:16 | |
| *** cuongnv has quit IRC | 05:17 | |
| *** markvoelker has quit IRC | 05:19 | |
| *** seanhandley has joined #openstack-infra | 05:19 | |
| *** cuongnv has joined #openstack-infra | 05:19 | |
| *** bhavik1 has joined #openstack-infra | 05:20 | |
| *** markvoelker has joined #openstack-infra | 05:24 | |
| *** markvoelker_ has joined #openstack-infra | 05:25 | |
| *** oomichi has quit IRC | 05:28 | |
| *** markvoelker has quit IRC | 05:29 | |
| *** deduped has quit IRC | 05:30 | |
| *** oomichi has joined #openstack-infra | 05:30 | |
| *** slaweq has joined #openstack-infra | 05:31 | |
| *** slaweq has quit IRC | 05:35 | |
| *** slaweq has joined #openstack-infra | 05:41 | |
| *** slaweq has quit IRC | 05:42 | |
| *** markvoelker_ has quit IRC | 05:48 | |
| *** thorst_afk has joined #openstack-infra | 05:48 | |
| *** pgadiya has joined #openstack-infra | 05:52 | |
| *** thorst_afk has quit IRC | 05:53 | |
| *** jascott1 has joined #openstack-infra | 05:59 | |
| *** jamesmcarthur has joined #openstack-infra | 06:01 | |
| *** jamesmcarthur has quit IRC | 06:06 | |
| *** psachin has quit IRC | 06:10 | |
| *** psachin has joined #openstack-infra | 06:14 | |
| *** links has quit IRC | 06:15 | |
| *** psachin has quit IRC | 06:16 | |
| *** psachin has joined #openstack-infra | 06:16 | |
| openstackgerrit | Ian Wienand proposed openstack-infra/devstack-gate master: [WIP] Start at ansible-ising ephemeral/swap setup https://review.openstack.org/499467 | 06:22 |
| *** pcaruana has joined #openstack-infra | 06:22 | |
| ianw | dmsimard: ^ incomplete, untested. one question at this point is if you think the idea of main.yaml conditionally including configure_[ephemeral|root].yaml is ok | 06:23 |
| *** isaacb has joined #openstack-infra | 06:24 | |
| *** slaweq has joined #openstack-infra | 06:26 | |
| *** david-lyle has quit IRC | 06:28 | |
| *** david-lyle has joined #openstack-infra | 06:28 | |
| *** slaweq has quit IRC | 06:28 | |
| *** slaweq has joined #openstack-infra | 06:28 | |
| *** isaacb has quit IRC | 06:31 | |
| *** jtomasek has quit IRC | 06:36 | |
| *** jtomasek has joined #openstack-infra | 06:36 | |
| *** jtomasek has quit IRC | 06:39 | |
| *** rcernin has joined #openstack-infra | 06:40 | |
| *** jtomasek has joined #openstack-infra | 06:40 | |
| *** chenying has quit IRC | 06:45 | |
| *** david-lyle has quit IRC | 06:47 | |
| *** dklyle has joined #openstack-infra | 06:47 | |
| *** thorst_afk has joined #openstack-infra | 06:49 | |
| *** dklyle has quit IRC | 06:53 | |
| *** david-lyle has joined #openstack-infra | 06:53 | |
| *** dpawlik has quit IRC | 06:53 | |
| *** thorst_afk has quit IRC | 06:54 | |
| *** danpawlik has joined #openstack-infra | 06:57 | |
| *** iyamahat has joined #openstack-infra | 06:59 | |
| *** iyamahat has quit IRC | 07:00 | |
| *** yamahata has quit IRC | 07:01 | |
| *** jianghuaw has quit IRC | 07:04 | |
| frickler | infra-root: ask.o.o seems to have gotten stuck again, something with the daily reload breaking apache maybe? | 07:08 |
| *** chenying has joined #openstack-infra | 07:10 | |
| *** jascott1 has quit IRC | 07:11 | |
| *** jascott1 has joined #openstack-infra | 07:11 | |
| *** apetrich has quit IRC | 07:14 | |
| *** apetrich has joined #openstack-infra | 07:15 | |
| *** jascott1 has quit IRC | 07:16 | |
| *** david-lyle has quit IRC | 07:17 | |
| *** gtrxcb has quit IRC | 07:22 | |
| *** deduped has joined #openstack-infra | 07:27 | |
| *** hashar has joined #openstack-infra | 07:29 | |
| *** links has joined #openstack-infra | 07:29 | |
| *** tesseract has joined #openstack-infra | 07:32 | |
| *** claudiub has joined #openstack-infra | 07:35 | |
| *** david-lyle has joined #openstack-infra | 07:35 | |
| *** apetrich has quit IRC | 07:35 | |
| *** bhavik1 has quit IRC | 07:39 | |
| *** jpich has joined #openstack-infra | 07:39 | |
| *** Swami has quit IRC | 07:41 | |
| *** apetrich has joined #openstack-infra | 07:42 | |
| *** funzo_ has joined #openstack-infra | 07:43 | |
| *** jpena|off is now known as jpena | 07:43 | |
| *** oomichi has quit IRC | 07:44 | |
| *** oomichi has joined #openstack-infra | 07:44 | |
| *** egonzalez has joined #openstack-infra | 07:45 | |
| *** funzo has quit IRC | 07:46 | |
| mrmartin | frickler: I'm checking it now. | 07:49 |
| *** thorst_afk has joined #openstack-infra | 07:50 | |
| mrmartin | frickler: fungi: I did an apache restart on ask.o.o, and it seems to be working again. | 07:51 |
| *** thorst_afk has quit IRC | 07:55 | |
| *** florianf has joined #openstack-infra | 07:58 | |
| frickler | mrmartin: thx, seems to have happened repeatedly in the last weeks, always at 6:30, maybe put it on a list somewhere for more thorough investigation | 08:05 |
| *** chenying has quit IRC | 08:08 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add stable branches to nova patchbot reporting https://review.openstack.org/499167 | 08:10 |
| *** jascott1 has joined #openstack-infra | 08:13 | |
| openstackgerrit | Merged openstack-infra/project-config master: Remove redundant OVb jobs from TripleO https://review.openstack.org/499097 | 08:16 |
| *** sflanigan has quit IRC | 08:16 | |
| openstackgerrit | Merged openstack-infra/project-config master: Add the stable/pike for Packstack's gerritbot notifications https://review.openstack.org/499175 | 08:17 |
| *** openstackgerrit has quit IRC | 08:17 | |
| *** efoley has joined #openstack-infra | 08:23 | |
| *** ralonsoh has joined #openstack-infra | 08:23 | |
| *** efoley_ has joined #openstack-infra | 08:24 | |
| *** efoley has quit IRC | 08:24 | |
| *** bogdando has joined #openstack-infra | 08:24 | |
| bogdando | hi. PTAL https://review.openstack.org/#/c/498766/ e-r queries | 08:24 |
| *** efoley_ has quit IRC | 08:25 | |
| *** efoley has joined #openstack-infra | 08:25 | |
| *** openstackgerrit has joined #openstack-infra | 08:28 | |
| openstackgerrit | Michele Baldessari proposed openstack-infra/elastic-recheck master: Add query for bug 1713127 https://review.openstack.org/499516 | 08:28 |
| openstack | bug 1713127 in tripleo "tripleo fails to deploy in ci : Failed to call refresh: /usr/bin/clustercheck" [High,Triaged] https://launchpad.net/bugs/1713127 | 08:28 |
| *** lucas-afk is now known as lucasagomes | 08:30 | |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT REVIEW: test verbosity https://review.openstack.org/499518 | 08:33 |
| *** dingyichen has quit IRC | 08:34 | |
| *** liusheng has quit IRC | 08:42 | |
| *** s-shiono has quit IRC | 08:43 | |
| *** tosky has joined #openstack-infra | 08:44 | |
| *** aviau has quit IRC | 08:48 | |
| *** aviau has joined #openstack-infra | 08:48 | |
| *** thorst_afk has joined #openstack-infra | 08:51 | |
| *** liujiong has quit IRC | 08:53 | |
| *** thorst_afk has quit IRC | 08:55 | |
| *** openstackgerrit has quit IRC | 09:03 | |
| *** openstackgerrit has joined #openstack-infra | 09:03 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Move working centos jobs in bifrost to check queue https://review.openstack.org/499525 | 09:03 |
| *** electrofelix has joined #openstack-infra | 09:06 | |
| *** liusheng has joined #openstack-infra | 09:07 | |
| *** e0ne has joined #openstack-infra | 09:09 | |
| *** sambetts|afk is now known as sambetts | 09:11 | |
| *** arturb has quit IRC | 09:15 | |
| *** admcleod has quit IRC | 09:17 | |
| *** admcleod has joined #openstack-infra | 09:17 | |
| *** tosky has quit IRC | 09:18 | |
| *** Nakato has quit IRC | 09:18 | |
| openstackgerrit | yolanda.robla proposed openstack-infra/project-config master: Move working centos jobs in bifrost to check queue https://review.openstack.org/499525 | 09:19 |
| *** Nakato has joined #openstack-infra | 09:20 | |
| *** tosky has joined #openstack-infra | 09:20 | |
| *** apetrich has quit IRC | 09:21 | |
| openstackgerrit | Jiri Stransky proposed openstack-infra/elastic-recheck master: Track DLRN build failures https://review.openstack.org/499532 | 09:22 |
| *** seanhandley has quit IRC | 09:37 | |
| *** sdague has joined #openstack-infra | 09:38 | |
| *** aviau has quit IRC | 09:40 | |
| *** eranrom has quit IRC | 09:42 | |
| *** shu-mutou is now known as shu-mutou-AWAY | 09:42 | |
| *** psachin has quit IRC | 09:45 | |
| *** sflanigan has joined #openstack-infra | 09:48 | |
| *** thorst_afk has joined #openstack-infra | 09:51 | |
| *** wolverineav has joined #openstack-infra | 09:54 | |
| *** thorst_afk has quit IRC | 09:56 | |
| *** claudiub|2 has joined #openstack-infra | 09:57 | |
| *** psachin has joined #openstack-infra | 09:58 | |
| *** liusheng has quit IRC | 09:59 | |
| *** claudiub has quit IRC | 10:01 | |
| *** seanhandley has joined #openstack-infra | 10:02 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack-infra/project-config master: zuul: layout: Skip openSUSE bifrost jobs for newton/ocata https://review.openstack.org/499544 | 10:02 |
| *** nicolasbock has joined #openstack-infra | 10:02 | |
| *** cuongnv has quit IRC | 10:02 | |
| *** ralonsoh has quit IRC | 10:03 | |
| *** ralonsoh has joined #openstack-infra | 10:04 | |
| *** priteau has joined #openstack-infra | 10:04 | |
| priteau | Hello. Is anyone able to fix this typo on the Pike announcement page? 'discover how your team can Summit"enhance their OpenStack skills through certification' | 10:05 |
| priteau | s/Summit"// on https://www.openstack.org/software/pike/ | 10:06 |
| *** nicolasbock has quit IRC | 10:06 | |
| *** liusheng has joined #openstack-infra | 10:09 | |
| *** hashar is now known as hasharLunch | 10:14 | |
| *** apetrich has joined #openstack-infra | 10:16 | |
| *** nicolasbock has joined #openstack-infra | 10:19 | |
| *** udesale has quit IRC | 10:27 | |
| *** priteau has quit IRC | 10:28 | |
| *** priteau has joined #openstack-infra | 10:31 | |
| *** szaher has quit IRC | 10:41 | |
| *** jkilpatr has quit IRC | 10:41 | |
| *** apetrich has quit IRC | 10:42 | |
| *** szaher has joined #openstack-infra | 10:46 | |
| *** stakeda has quit IRC | 10:47 | |
| *** bogdando has left #openstack-infra | 10:49 | |
| *** sflanigan has quit IRC | 10:50 | |
| *** rhallisey has joined #openstack-infra | 10:50 | |
| *** raissa has quit IRC | 10:51 | |
| *** raissa has joined #openstack-infra | 10:52 | |
| *** thorst_afk has joined #openstack-infra | 10:52 | |
| *** thorst_afk has quit IRC | 10:57 | |
| *** salv-orlando has quit IRC | 11:00 | |
| *** jkilpatr has joined #openstack-infra | 11:01 | |
| *** namnh has quit IRC | 11:01 | |
| *** sflanigan has joined #openstack-infra | 11:07 | |
| *** psachin has quit IRC | 11:08 | |
| *** jistr is now known as jistr|biab | 11:12 | |
| *** dave-mccowan has joined #openstack-infra | 11:18 | |
| *** psachin has joined #openstack-infra | 11:19 | |
| *** pbourke has quit IRC | 11:21 | |
| *** pbourke has joined #openstack-infra | 11:23 | |
| *** hasharLunch is now known as hashar | 11:24 | |
| *** claudiub has joined #openstack-infra | 11:24 | |
| *** claudiub|2 has quit IRC | 11:27 | |
| openstackgerrit | Witold Bedyk proposed openstack-infra/project-config master: Add monasca-specs repository https://review.openstack.org/499562 | 11:27 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test undercloud localhost dns https://review.openstack.org/499564 | 11:35 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: DONT MERGE: test undercloud rh1 dns https://review.openstack.org/499565 | 11:36 |
| *** salv-orlando has joined #openstack-infra | 11:36 | |
| openstackgerrit | Lingxian Kong proposed openstack-infra/project-config master: Add an experimental functional job for Qinling https://review.openstack.org/499567 | 11:37 |
| *** mat128 has joined #openstack-infra | 11:37 | |
| *** thorst_afk has joined #openstack-infra | 11:40 | |
| *** ldnunes has joined #openstack-infra | 11:41 | |
| openstackgerrit | Witold Bedyk proposed openstack-infra/project-config master: Add monasca-specs repository https://review.openstack.org/499562 | 11:43 |
| *** lucasagomes is now known as lucas-hungry | 11:44 | |
| *** mriedem has joined #openstack-infra | 11:47 | |
| *** efried_off is now known as efried | 11:50 | |
| fungi | frickler: mrmartin: it happened semi-regularly in the past too (always right around 06:30-07:00 utc) but didn't coincide with any of the daily system cron jobs as far as i could tell and i never found anything in the logs to explain it either. it also usually recovered on its own within 30-60 minutes | 11:52 |
| mrmartin | fungi: what i saw, that two apache processes had 46% cpu consumption. | 11:53 |
| fungi | mrmartin: interesting find. i'm never awake when it happens and it was always back to normal by the time i saw it reported | 11:54 |
| fungi | garbage collection in apache maybe? | 11:54 |
| *** apetrich has joined #openstack-infra | 11:54 | |
| *** thegreenhundred has quit IRC | 11:55 | |
| *** maishsk has joined #openstack-infra | 11:55 | |
| mrmartin | I had a similar experience with an other apache site, and the reason was an external both that tried to brute-force wp. | 11:55 |
| cmurphy | we saw something similar with files.o.o around the same time of day, we tried https://review.openstack.org/#/c/445991/ and around the time that was merged the problem seemed to resolve though i'm not 100% sure they were correlated | 11:56 |
| fungi | mrmartin: good point, i had wondered if it might be some crawler trying to index things (which would have explained the lack of correlation to any local activity scheduled on the server) | 11:58 |
| fungi | i can't recall whether i ever did an activity analysis on the apache access logs to look for excessive requests from a specific client during that timeframe | 11:59 |
| frickler | my test got connection refused and traffic dropped close to 0: http://cacti.openstack.org/cacti/graph.php?action=view&local_graph_id=2549&rra_id=all | 12:00 |
| *** jkilpatr has quit IRC | 12:03 | |
| *** alexchadin has joined #openstack-infra | 12:08 | |
| *** jkilpatr has joined #openstack-infra | 12:09 | |
| *** jbadiapa has quit IRC | 12:09 | |
| *** jkilpatr has quit IRC | 12:12 | |
| *** jkilpatr has joined #openstack-infra | 12:12 | |
| *** claudiub has quit IRC | 12:14 | |
| *** claudiub has joined #openstack-infra | 12:14 | |
| *** jpena is now known as jpena|lunch | 12:16 | |
| *** saneax has joined #openstack-infra | 12:17 | |
| *** jkilpatr has quit IRC | 12:17 | |
| *** bobh has joined #openstack-infra | 12:18 | |
| fungi | i'm disappearing soon for ~6 hours... stuck in a car most of the day but should be back around 1900z and will catch up then | 12:19 |
| *** jistr|biab is now known as jistr | 12:20 | |
| *** sree has quit IRC | 12:21 | |
| *** sree has joined #openstack-infra | 12:21 | |
| *** bobh has quit IRC | 12:22 | |
| *** sdague has quit IRC | 12:23 | |
| *** annegentle has joined #openstack-infra | 12:24 | |
| *** sree has quit IRC | 12:26 | |
| *** jbadiapa has joined #openstack-infra | 12:26 | |
| *** dprince has joined #openstack-infra | 12:26 | |
| *** mat128 has quit IRC | 12:27 | |
| *** jkilpatr has joined #openstack-infra | 12:31 | |
| *** mat128 has joined #openstack-infra | 12:31 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Remove keystoneclient and ironicclient as direct depends https://review.openstack.org/492684 | 12:32 |
| openstackgerrit | Merged openstack-infra/infra-manual master: Add support for sidebars https://review.openstack.org/499361 | 12:33 |
| *** rama_y has joined #openstack-infra | 12:34 | |
| *** eharney has joined #openstack-infra | 12:34 | |
| *** rlandy has joined #openstack-infra | 12:35 | |
| *** sflanigan has quit IRC | 12:36 | |
| *** sdague has joined #openstack-infra | 12:37 | |
| *** jaosorior has quit IRC | 12:37 | |
| *** pgadiya has quit IRC | 12:37 | |
| *** thegreenhundred has joined #openstack-infra | 12:38 | |
| *** jaosorior has joined #openstack-infra | 12:38 | |
| openstackgerrit | Merged openstack-infra/infra-manual master: Add more content to zuul v3 migration doc https://review.openstack.org/499362 | 12:40 |
| openstackgerrit | Merged openstack-infra/infra-manual master: Minor cleanup to zuulv3 example https://review.openstack.org/499363 | 12:42 |
| *** LindaWang has quit IRC | 12:44 | |
| openstackgerrit | Merged openstack-infra/infra-manual master: Make variant behavior more clear https://review.openstack.org/499378 | 12:44 |
| *** jaosorior has quit IRC | 12:44 | |
| *** jaosorior has joined #openstack-infra | 12:45 | |
| *** jaosorior has quit IRC | 12:45 | |
| *** jaosorior has joined #openstack-infra | 12:46 | |
| *** rhallisey has quit IRC | 12:47 | |
| *** esberglu has joined #openstack-infra | 12:49 | |
| *** lucas-hungry is now known as lucasagomes | 12:51 | |
| *** raissa has quit IRC | 12:52 | |
| *** sflanigan has joined #openstack-infra | 12:53 | |
| *** sflanigan has joined #openstack-infra | 12:53 | |
| *** salv-orlando has quit IRC | 12:54 | |
| *** jamesmcarthur has joined #openstack-infra | 12:55 | |
| *** bobh has joined #openstack-infra | 12:56 | |
| dmsimard | pabelanger, clarkb, ianw: can I get reviews on https://review.openstack.org/#/c/499005/ ? We merged the fix_disk_layout revamp last night and I'd like to track if it's a success | 12:57 |
| *** bh526r has joined #openstack-infra | 12:57 | |
| *** trown|outtypewww is now known as trown | 12:57 | |
| *** dave-mccowan has quit IRC | 12:57 | |
| *** raissa has joined #openstack-infra | 12:58 | |
| *** udesale has joined #openstack-infra | 13:00 | |
| *** baoli has joined #openstack-infra | 13:02 | |
| *** Goneri has joined #openstack-infra | 13:03 | |
| *** annegentle has quit IRC | 13:06 | |
| *** dave-mccowan has joined #openstack-infra | 13:06 | |
| *** rhallisey has joined #openstack-infra | 13:08 | |
| *** dave-mcc_ has joined #openstack-infra | 13:09 | |
| *** dave-mccowan has quit IRC | 13:11 | |
| *** seanhandley has left #openstack-infra | 13:11 | |
| openstackgerrit | Eric Fried proposed openstack-infra/gerritbot master: Support regexes in channel config yaml https://review.openstack.org/499367 | 13:11 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove bindep_command lines https://review.openstack.org/499589 | 13:12 |
| efried | mgagne ^^ added implicit ^anchor$ behavior | 13:12 |
| *** sree has joined #openstack-infra | 13:12 | |
| mnaser | pabelanger go for the reduction, network bw limits are possible on the mirror node, bad neighbours also a strong one that we're trying to work around or fundamentally fix | 13:14 |
| *** zhurong has quit IRC | 13:14 | |
| *** udesale has quit IRC | 13:15 | |
| *** jamesmcarthur has quit IRC | 13:15 | |
| *** annegentle has joined #openstack-infra | 13:16 | |
| *** mat128 has quit IRC | 13:17 | |
| *** gouthamr has joined #openstack-infra | 13:18 | |
| *** jpena|lunch is now known as jpena | 13:20 | |
| *** ianychoi__ is now known as ianychoi | 13:20 | |
| *** rcarrillocruz has quit IRC | 13:21 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add integration test for zuul_stream https://review.openstack.org/498209 | 13:22 |
| openstackgerrit | Rabi Mishra proposed openstack-infra/project-config master: Add docs publish job for heat-agents https://review.openstack.org/499596 | 13:22 |
| *** alexchadin has quit IRC | 13:22 | |
| fungi | priteau: the foundation web devs have corrected your typo after i forwarded your message to them--thanks for reporting! | 13:23 |
| fungi | and now i'm disappearing for the next 5-6 hours | 13:23 |
| *** rcarrillocruz has joined #openstack-infra | 13:23 | |
| priteau | Thank you fungi! | 13:24 |
| *** kgiusti has joined #openstack-infra | 13:24 | |
| *** slaweq has quit IRC | 13:29 | |
| *** camunoz has joined #openstack-infra | 13:32 | |
| *** slaweq has joined #openstack-infra | 13:32 | |
| *** salv-orlando has joined #openstack-infra | 13:33 | |
| *** jcoufal has joined #openstack-infra | 13:34 | |
| *** rama_y has quit IRC | 13:34 | |
| openstackgerrit | Rabi Mishra proposed openstack-infra/project-config master: Add docs publish job for heat-agents https://review.openstack.org/499596 | 13:36 |
| *** andreas_s has joined #openstack-infra | 13:39 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add tox_install.sh to deal with upper-constraints https://review.openstack.org/499602 | 13:41 |
| openstackgerrit | Doug Hellmann proposed openstack/ptgbot master: ignore local config file https://review.openstack.org/499603 | 13:42 |
| openstackgerrit | Doug Hellmann proposed openstack/ptgbot master: add color command https://review.openstack.org/499604 | 13:42 |
| andreas_s | pabelanger, hi. I have a brief question to https://github.com/openstack/ansible-role-zuul/commit/747f3ba540d68bc8cbfd260d0b4ccb06d2322d51 | 13:44 |
| andreas_s | pabelanger, was there a certain reason for skipping layout.yaml in this patch? | 13:44 |
| andreas_s | I have a use case where I would like to template the layout.yaml file... | 13:45 |
| *** xyang1 has joined #openstack-infra | 13:48 | |
| *** danpawlik has quit IRC | 13:50 | |
| *** ihrachys has joined #openstack-infra | 13:50 | |
| *** slaweq has quit IRC | 13:52 | |
| *** slaweq has joined #openstack-infra | 13:53 | |
| *** jamesmcarthur has joined #openstack-infra | 13:53 | |
| *** sree has quit IRC | 13:54 | |
| *** sree has joined #openstack-infra | 13:55 | |
| *** slaweq has quit IRC | 13:57 | |
| *** jaosorior has quit IRC | 13:57 | |
| *** vhosakot has joined #openstack-infra | 13:58 | |
| *** slaweq has joined #openstack-infra | 13:59 | |
| *** jaosorior has joined #openstack-infra | 13:59 | |
| *** psachin has quit IRC | 14:04 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add support for debug statements https://review.openstack.org/499608 | 14:06 |
| *** hongbin has joined #openstack-infra | 14:07 | |
| *** marst has joined #openstack-infra | 14:08 | |
| *** armax has joined #openstack-infra | 14:10 | |
| *** armax_ has joined #openstack-infra | 14:12 | |
| *** ijw has joined #openstack-infra | 14:13 | |
| *** kjackal has joined #openstack-infra | 14:14 | |
| *** kjackal__ has joined #openstack-infra | 14:14 | |
| *** armax has quit IRC | 14:15 | |
| *** armax_ is now known as armax | 14:16 | |
| openstackgerrit | Doug Hellmann proposed openstack/ptgbot master: add color command https://review.openstack.org/499604 | 14:19 |
| openstackgerrit | Doug Hellmann proposed openstack/ptgbot master: add color command https://review.openstack.org/499604 | 14:21 |
| *** mriedem is now known as mriedem_away | 14:23 | |
| *** Julien-z_ has joined #openstack-infra | 14:24 | |
| *** LindaWang has joined #openstack-infra | 14:27 | |
| *** sree has quit IRC | 14:28 | |
| *** srobert has joined #openstack-infra | 14:28 | |
| *** sree has joined #openstack-infra | 14:29 | |
| *** annegentle has quit IRC | 14:30 | |
| pabelanger | andreas_s: ya, wrote that forward looking to zuulv3, at the time I wasnt' sure what the file would look like. I'm planning on doing a refresh of the role this weekend now were almost ready to go live with zuulv3 | 14:30 |
| *** slaweq has quit IRC | 14:32 | |
| *** slaweq has joined #openstack-infra | 14:33 | |
| *** sree has quit IRC | 14:33 | |
| andreas_s | pabelanger, ah great. Then I will have a look next week how the role looks like. I'm using it in our nova thirdparty ci, but still with jenkins. Will the new role still be backwardscompatible? | 14:35 |
| openstackgerrit | Merged openstack-infra/elastic-recheck master: Add additional signature for xvde failures https://review.openstack.org/499005 | 14:36 |
| pabelanger | andreas_s: not really, I'm trying to support zuulv3 only right now. So I would expect some breaking changes. | 14:37 |
| pabelanger | andreas_s: should know more after PTG, once we are running zuulv3 in production | 14:37 |
| dmsimard | pabelanger: would E-R go back and find previous instances if we update a query or is it only moving forward ? | 14:38 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Handle pushing to non-bare remote repos https://review.openstack.org/499620 | 14:38 |
| pabelanger | dmsimard: it should | 14:39 |
| dmsimard | pabelanger: ok great | 14:39 |
| openstackgerrit | Merged openstack-infra/openstackid-resources master: Updated Summit get main page class https://review.openstack.org/499287 | 14:39 |
| pabelanger | jeblair: mordred: do you think publishing to https://docs.openstack.org/developer/sandbox for openstack-dev/sandbox is okay? I think I'll be able to itterate faster on testing afs publishing on that repo | 14:40 |
| *** jascott1 has quit IRC | 14:43 | |
| *** slaweq_ has joined #openstack-infra | 14:43 | |
| jeblair | pabelanger: hrm... what about zuul-jobs? we're landing stuff there pretty fast :) | 14:44 |
| andreas_s | pabelanger, ah ok - would you mind merging a patch that changes the layout.yaml configuration to template as well (I can prepare it)? Then I could pin the role to this commit and could continue working independent from the refactoring that is planned... | 14:45 |
| jeblair | pabelanger: if you still want to use sandbox, i have two suggestions: 1) delete the job *and* delete the content from afs when you're done. 2) ask the docs team if it's okay. :) | 14:45 |
| *** kjackal has quit IRC | 14:45 | |
| pabelanger | jeblair: ya, that might be better | 14:45 |
| *** rama_y has joined #openstack-infra | 14:45 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Only add changes to status page with jobs https://review.openstack.org/499191 | 14:45 |
| pabelanger | jeblair: I was think sandbox was easier, since I could just +3 all changes. But, going back and deleting does sound like a good idea | 14:46 |
| *** rama_y has quit IRC | 14:46 | |
| *** kjackal__ has quit IRC | 14:46 | |
| *** kjackal has joined #openstack-infra | 14:46 | |
| *** kjackal__ has joined #openstack-infra | 14:46 | |
| jeblair | pabelanger: also, note that i think when you finish the final docs publishing job(s), you'll need to use job.allowed-projects to list all of the official openstack repos, since those are the only ones that should be able to use that (those) job(s). | 14:46 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Remove bindep_command and bindep_fallback references https://review.openstack.org/498913 | 14:46 |
| pabelanger | andreas_s: Oh, I know why. Because I templated the file in a playbook, then the role just copied it across. But ya, we can do that | 14:47 |
| pabelanger | jeblair: good call, didn't think of that | 14:47 |
| *** slaweq_ has quit IRC | 14:47 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add tox_install.sh to deal with upper-constraints https://review.openstack.org/499602 | 14:48 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Add roles for adding and removing launchpadlib credentials https://review.openstack.org/498633 | 14:49 |
| andreas_s | pabelanger, cool, thanks! https://review.openstack.org/#/c/499628/ | 14:50 |
| mordred | andreas_s: | 14:51 |
| mordred | gah | 14:51 |
| *** annegentle has joined #openstack-infra | 14:51 | |
| mordred | jeblair: final only disallows modificaiton of the job, not adding a job toa project pipeline right? that's why allowed-projects? | 14:52 |
| *** Swami has joined #openstack-infra | 14:52 | |
| *** armax has quit IRC | 14:53 | |
| *** sflanigan has quit IRC | 14:54 | |
| *** maishsk has quit IRC | 14:57 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Handle pushing to non-bare remote repos https://review.openstack.org/499620 | 14:57 |
| *** ramishra has quit IRC | 14:58 | |
| *** jascott1 has joined #openstack-infra | 15:00 | |
| jeblair | mordred: correct | 15:02 |
| *** annegentle has quit IRC | 15:08 | |
| *** maishsk has joined #openstack-infra | 15:08 | |
| *** salv-orlando has quit IRC | 15:08 | |
| *** mriedem_away is now known as mriedem | 15:10 | |
| *** dhajare has quit IRC | 15:11 | |
| *** dprince has quit IRC | 15:11 | |
| *** ramishra has joined #openstack-infra | 15:12 | |
| clarkb | sr | 15:13 |
| clarkb | derp | 15:13 |
| *** salv-orlando has joined #openstack-infra | 15:21 | |
| *** annegentle has joined #openstack-infra | 15:21 | |
| *** andreas_s has quit IRC | 15:22 | |
| *** gmann has quit IRC | 15:23 | |
| *** gmann has joined #openstack-infra | 15:23 | |
| *** ramishra has quit IRC | 15:23 | |
| *** ralonsoh has quit IRC | 15:23 | |
| *** maishsk has quit IRC | 15:23 | |
| *** jascott1 has quit IRC | 15:24 | |
| *** jascott1 has joined #openstack-infra | 15:24 | |
| *** jascott1 has quit IRC | 15:25 | |
| *** jascott1 has joined #openstack-infra | 15:25 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Fully qualify AFS principal https://review.openstack.org/499681 | 15:28 |
| *** jascott1 has quit IRC | 15:30 | |
| *** jascott1 has joined #openstack-infra | 15:31 | |
| pabelanger | clarkb: jeblair: mind a +3^ working on afs docs publishing, ran into http://logs.openstack.org/4b/79c6453cd269d56d2d3dd255445340afc030084b/post/publish-openstack-python-docs/d014be7/job-output.txt.gz#_2017-08-31_15_19_54_882218 | 15:31 |
| *** pcaruana has quit IRC | 15:32 | |
| dtroyer | anything odd going on with the static.o.o web server? I'm getting its directory listing when I hit summit.o.o | 15:32 |
| *** ykarel has quit IRC | 15:32 | |
| pabelanger | clarkb: dmsimard: http://logs.openstack.org/75/486175/2/gate/gate-tripleo-ci-centos-7-scenario004-multinode-oooq-puppet/eb6374e/logs/devstack-gate-setup-host.txt swap failure | 15:32 |
| pabelanger | /dev/xvde2: Device or resource busy while setting up superblock | 15:33 |
| dmsimard | xvde2 is not swap | 15:33 |
| pabelanger | right, but failure in new swap role | 15:33 |
| dmsimard | correct | 15:33 |
| dmsimard | and there's udevadm settle for xvde2 too, wth | 15:33 |
| openstackgerrit | Antoine Musso proposed openstack/diskimage-builder master: dpkg: fake initctl version now parseable by puppet https://review.openstack.org/322305 | 15:34 |
| *** srobert has quit IRC | 15:34 | |
| dmsimard | can put sync and partprobe back in, I dunno... sigh | 15:34 |
| pabelanger | dmsimard: seems to be the only hit in logstash ATM | 15:34 |
| dmsimard | pabelanger: adding it to E-R | 15:34 |
| *** salv-orlando has quit IRC | 15:35 | |
| *** slaweq has quit IRC | 15:36 | |
| *** slaweq has joined #openstack-infra | 15:37 | |
| pabelanger | clarkb: also okay with reducing vexxhost to 10 servers? https://review.openstack.org/499425/ I figure post PTG we might have time to look into mirror server networking limits, looks like we might be throttled acorrding to mnaser | 15:38 |
| mnaser | pabelanger agreed | 15:38 |
| openstackgerrit | Sagi Shnaidman proposed openstack-infra/tripleo-ci master: Use localhost DNS and rh1 dns as secondary https://review.openstack.org/499564 | 15:38 |
| dmsimard | pabelanger: should this query work ? it's not doing what I was hoping it to do | 15:40 |
| dmsimard | (message:"/dev/xvde1: No such file or directory") OR (message:"/dev/xvde" AND message:"Device or resource busy while setting up superblock") AND tags:"console" | 15:40 |
| dmsimard | tl;dr, I don't want to limit the device busy error to xvde2 | 15:40 |
| dmsimard | in case it happens with xvde1 | 15:40 |
| clarkb | pabelanger: ya, sorry have plumber over | 15:40 |
| clarkb | so am distracted | 15:41 |
| *** slaweq has quit IRC | 15:41 | |
| pabelanger | clarkb: okay, np | 15:42 |
| *** apetrich has quit IRC | 15:45 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Re-introduce sync/partprobe in fix_disk_layout https://review.openstack.org/499687 | 15:46 |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Re-introduce sync/partprobe in fix_disk_layout https://review.openstack.org/499687 | 15:46 |
| dmsimard | clarkb, pabelanger ^ | 15:47 |
| *** e0ne has quit IRC | 15:47 | |
| *** jamesmcarthur has quit IRC | 15:49 | |
| *** jamesmcarthur has joined #openstack-infra | 15:50 | |
| jeblair | mordred, clarkb, pabelanger, dmsimard: gah! 'awk not found' with push git repo thing -- running "git status |head -1 |awk '{ print $NF }" -- should we (a) install awk; (b) write an ansible module to parse the git status output; (c) replace awk with perl ? | 15:55 |
| openstackgerrit | Merged openstack-infra/project-config master: Fully qualify AFS principal https://review.openstack.org/499681 | 15:55 |
| dmsimard | jeblair: what kind of server doesn't come with awk ? | 15:55 |
| dmsimard | I would go with (a) | 15:55 |
| jeblair | dmsimard: a very minimal one indeed | 15:55 |
| dmsimard | I have a habit of cursing at centos/rhel for not including wget by default and only including curl | 15:56 |
| dmsimard | not having awk by default would drive me nuts :) | 15:56 |
| *** xarses has joined #openstack-infra | 15:57 | |
| *** kjackal__ has quit IRC | 15:57 | |
| *** kjackal has quit IRC | 15:57 | |
| dmsimard | jeblair: I mean, git isn't installed by default and we're installing it -- installing awk doesn't seem much of a stretch. It's probably assumed to be installed by end users running jobs as well. | 15:57 |
| jeblair | dmsimard: well, we have a facility for allowing end users to specify what binary packages they need explicitly, so we don't have to rely on assumptions that much | 15:58 |
| jeblair | dmsimard: so i'd say we should not focus on 'this would also be convenient' for end users as an argument | 15:58 |
| *** armax has joined #openstack-infra | 15:59 | |
| dmsimard | jeblair: I don't particularly disagree, you'd basically be asking users to add awk in their bindep, and whatever else might not end up in that *very* minimal image, convenience and UX is important too :) | 15:59 |
| *** ykarel has joined #openstack-infra | 16:00 | |
| dmsimard | I don't remember the last time I had to actually install awk, if it ever happened | 16:00 |
| bkero | I'd be surprised if awk weren't already used and is just inadvertently not in bindep | 16:00 |
| openstackgerrit | Merged openstack-infra/project-config master: Reduce vexxhost to 10 server https://review.openstack.org/499425 | 16:00 |
| *** egonzalez has quit IRC | 16:02 | |
| *** Julien-z_ has quit IRC | 16:02 | |
| *** lucasagomes is now known as lucas-hungry | 16:04 | |
| *** Julien-z_ has joined #openstack-infra | 16:04 | |
| *** srobert has joined #openstack-infra | 16:08 | |
| *** slaweq has joined #openstack-infra | 16:10 | |
| *** kjackal has joined #openstack-infra | 16:10 | |
| *** rama_y has joined #openstack-infra | 16:11 | |
| *** slaweq has quit IRC | 16:14 | |
| *** mat128 has joined #openstack-infra | 16:15 | |
| *** jpich has quit IRC | 16:17 | |
| *** eroux has joined #openstack-infra | 16:17 | |
| *** LindaWang has quit IRC | 16:21 | |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config master: Enable Cinder unit test job for driverfixes/ocata https://review.openstack.org/499705 | 16:25 |
| pabelanger | jeblair: install awk wfm | 16:25 |
| *** bhavik1 has joined #openstack-infra | 16:26 | |
| *** jascott1 has quit IRC | 16:28 | |
| *** jascott1 has joined #openstack-infra | 16:29 | |
| *** jamesmcarthur has quit IRC | 16:29 | |
| *** dprince has joined #openstack-infra | 16:29 | |
| *** esberglu has quit IRC | 16:30 | |
| *** jistr is now known as jistr|afk | 16:31 | |
| *** jamesmcarthur has joined #openstack-infra | 16:31 | |
| *** arif-ali has left #openstack-infra | 16:33 | |
| *** blznblzn2 has joined #openstack-infra | 16:34 | |
| *** sambetts is now known as sambetts|afk | 16:34 | |
| *** trown is now known as trown|lunch | 16:35 | |
| *** salv-orlando has joined #openstack-infra | 16:36 | |
| *** salv-orlando has quit IRC | 16:41 | |
| *** Julien-z_ has quit IRC | 16:41 | |
| *** Apoorva has joined #openstack-infra | 16:41 | |
| *** Julien-z_ has joined #openstack-infra | 16:42 | |
| *** kjackal has quit IRC | 16:42 | |
| *** mat128 has quit IRC | 16:44 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add /etc/openafs/ to trusted_ro_paths for zuul-executor https://review.openstack.org/499717 | 16:44 |
| *** Julien-z_ has joined #openstack-infra | 16:45 | |
| *** Julien-z_ has quit IRC | 16:45 | |
| pabelanger | jeblair: clarkb: mordred: fungi: ^ bindmount /etc/openafs for kinit, it needs to read the configuration files. | 16:45 |
| openstackgerrit | Eric Harney proposed openstack-infra/project-config master: Enable Cinder unit test job for driverfixes/ocata https://review.openstack.org/499705 | 16:47 |
| *** kjackal has joined #openstack-infra | 16:49 | |
| jeblair | pabelanger: can you add it to untrusted as well? | 16:50 |
| jeblair | pabelanger, dmsimard: adding awk will require new images; so i'm going to use perl for now and we can change it later if we want | 16:50 |
| dmsimard | jeblair: sure, I'll send the element patch | 16:51 |
| *** Julien-z_ has joined #openstack-infra | 16:51 | |
| *** Julien-z_ has quit IRC | 16:51 | |
| *** xarses has quit IRC | 16:51 | |
| dmsimard | jeblair: wait, which specific job was failing on the missing awk ? | 16:52 |
| *** Julien-z_ has joined #openstack-infra | 16:52 | |
| dmsimard | jeblair: or which specific task, rather | 16:52 |
| pabelanger | jeblair: sure, is there a reason for an untrusted job to use afs in the future? | 16:53 |
| dmsimard | i.e, could it be a delegated task/running in the bubblewrap rather than the image ? | 16:53 |
| *** Julien-z_ has quit IRC | 16:53 | |
| dmsimard | I'm still surprised that awk wouldn't be installed by default, even on a minimal install | 16:53 |
| pabelanger | Oh right | 16:53 |
| pabelanger | we cannot run apt-get inside bwrap | 16:53 |
| pabelanger | we are missing things for the apt-get client | 16:53 |
| *** Julien-z_ has joined #openstack-infra | 16:54 | |
| jeblair | dmsimard: nice catch :) it is indeed that. | 16:54 |
| *** Julien-z_ has quit IRC | 16:54 | |
| dmsimard | jeblair: there you go, is that an "easier" fix ? | 16:54 |
| jeblair | dmsimard: probably, but i no longer know the problem, as awk *is* installed on the executor. :) | 16:54 |
| jeblair | pabelanger: no reason not to | 16:55 |
| jeblair | pabelanger: oh, hrm | 16:55 |
| *** mwarad has joined #openstack-infra | 16:55 | |
| *** Julien-z_ has joined #openstack-infra | 16:55 | |
| jeblair | pabelanger: an untrusted job won't be able to by virtue of not being able to run the necessary commands | 16:55 |
| *** Julien-z_ has quit IRC | 16:55 | |
| *** annegentle has quit IRC | 16:55 | |
| jeblair | pabelanger: so we'd need more work for that anyway. i'll flip my -1 to a +2 | 16:55 |
| dmsimard | jeblair: I'm not very familiar with how host binaries would be exposed to the bwrap environment. Maybe a case of the binary not being in $PATH ? | 16:57 |
| pabelanger | jeblair: thanks | 16:57 |
| *** pvaneck has joined #openstack-infra | 16:57 | |
| *** felipemonteiro has joined #openstack-infra | 16:58 | |
| *** jascott1 has quit IRC | 17:00 | |
| *** jascott1 has joined #openstack-infra | 17:00 | |
| jeblair | dmsimard: yeah, /usr/bin doesn't seem to be in PATH oO | 17:01 |
| dmsimard | jeblair: according to https://github.com/openstack-infra/zuul/blob/feature/zuulv3/zuul/driver/bubblewrap/__init__.py#L192 we ro mount /usr | 17:01 |
| dmsimard | do we need to ro mount /usr/bin explicitely ? | 17:01 |
| *** dave-mcc_ is now known as dave-mccowan | 17:01 | |
| pabelanger | jeblair: is this code running in bwrap? If so, ya, I've needed to use full path, because PATH is not properly setup | 17:01 |
| dmsimard | or maybe we need to re-export PATH | 17:01 |
| jeblair | hrm, that's weird: | 17:02 |
| jeblair | zuul-bwrap /tmp -- ansible localhost -m shell -a "echo $PATH" | 17:02 |
| jeblair | /home/corvus/bin:/home/corvus/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin | 17:02 |
| jeblair | apparently path is there and includes /usr/bin | 17:02 |
| *** jascott1 has quit IRC | 17:02 | |
| jeblair | zuul-bwrap /tmp -- ansible localhost -m shell -a "awk" | 17:03 |
| jeblair | /bin/sh: 1: awk: not found | 17:03 |
| *** jascott1 has joined #openstack-infra | 17:03 | |
| dmsimard | what about command instead of shell | 17:03 |
| jlvillal | awkward I'd say | 17:03 |
| jlvillal | I'll be here all week! ;) | 17:03 |
| *** baoli has quit IRC | 17:04 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: DNM: see if we can validate job output https://review.openstack.org/499732 | 17:04 |
| dmsimard | jeblair: oh, hang on a second | 17:04 |
| jeblair | dmsimard: command fails with [Errno 2] No such file or directory: 'awk' | 17:04 |
| *** bhavik1 has quit IRC | 17:04 | |
| jeblair | dmsimard: which i'd expect -- there's nothing to process path | 17:04 |
| jeblair | but shell should | 17:04 |
| *** baoli has joined #openstack-infra | 17:04 | |
| dmsimard | jeblair: I think your shell is expanding $PATH so really you're asking ansible to echo "/home/corvus/bin:/home/corvus/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin" | 17:05 |
| jeblair | jlvillal: boom tish | 17:05 |
| jlvillal | heh | 17:05 |
| jeblair | dmsimard: aaaah | 17:05 |
| dmsimard | jeblair: how about if you try ansible -m debug -a "msg={{ lookup('env', 'PATH' }}" instead | 17:05 |
| dmsimard | that's missing a closing parenthesis | 17:05 |
| jeblair | ftr, it also didn't like the word "instead" :) | 17:06 |
| *** baoli has quit IRC | 17:06 | |
| jeblair | "msg": "/home/corvus/bin:/home/corvus/.local/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin" | 17:06 |
| dmsimard | hmm, ok, what about ansible -m shell -a "echo \"{{ lookup('env', 'PATH' }}\"" instead ? | 17:07 |
| jeblair | aha! | 17:07 |
| jeblair | lrwxrwxrwx 1 root root 21 May 17 14:15 /usr/bin/awk -> /etc/alternatives/awk | 17:07 |
| *** jascott1 has quit IRC | 17:07 | |
| dmsimard | It seems like there's a distinction between a shell session being spawned from within ansible vs something provided by python | 17:07 |
| dmsimard | oh, so we're not really using /usr/bin/awk, then | 17:08 |
| dmsimard | ew | 17:08 |
| dmsimard | need to brb. | 17:08 |
| jeblair | i think everything regarding shells is working exactly as expected, we really are missing /usr/bin/awk after all :) | 17:08 |
| *** sshnaidm is now known as sshnaidm|off | 17:09 | |
| pabelanger | Ya, I'm starting to think running this in bubblewrap is going to be different :) | 17:09 |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: DNM: see if we can validate job output https://review.openstack.org/499732 | 17:09 |
| *** jascott1 has joined #openstack-infra | 17:10 | |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul feature/zuulv3: Add /etc/alternatives to bwrap https://review.openstack.org/499736 | 17:11 |
| *** psachin has joined #openstack-infra | 17:11 | |
| *** esberglu has joined #openstack-infra | 17:12 | |
| *** rcernin has quit IRC | 17:12 | |
| *** felipemonteiro_ has joined #openstack-infra | 17:12 | |
| *** felipemonteiro__ has joined #openstack-infra | 17:13 | |
| *** jascott1 has quit IRC | 17:14 | |
| *** tesseract has quit IRC | 17:14 | |
| *** felipemonteiro has quit IRC | 17:14 | |
| *** baoli has joined #openstack-infra | 17:15 | |
| *** srobert_ has joined #openstack-infra | 17:15 | |
| *** srobert has quit IRC | 17:15 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/gerritbot master: Add unit test framework and one unit test https://review.openstack.org/499377 | 17:15 |
| *** esberglu has quit IRC | 17:16 | |
| *** jkilpatr has quit IRC | 17:16 | |
| *** felipemonteiro_ has quit IRC | 17:17 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: DNM: see if we can validate job output https://review.openstack.org/499732 | 17:19 |
| *** esberglu has joined #openstack-infra | 17:20 | |
| *** jamesmcarthur has quit IRC | 17:20 | |
| jeblair | pabelanger: can you +3 499736? devstack-gate blocker | 17:20 |
| *** mat128 has joined #openstack-infra | 17:21 | |
| hogepodge | what's up with http://puppetboard.openstack.org ? | 17:23 |
| openstackgerrit | John L. Villalovos proposed openstack-infra/gerritbot master: Add unit test framework and one unit test https://review.openstack.org/499377 | 17:24 |
| *** jamesmcarthur has joined #openstack-infra | 17:25 | |
| pabelanger | jeblair: done | 17:26 |
| pabelanger | hogepodge: dead, we haven't used it in some time. We're inthe process of removing it, and going to talk about ARA at PTG | 17:27 |
| *** Swami has quit IRC | 17:27 | |
| hogepodge | pabelanger: ah, ok. refstack team used it to monitor site updates. is there any alternative we can use to see what the status of a new update is? | 17:27 |
| *** ijw has quit IRC | 17:28 | |
| *** jkilpatr has joined #openstack-infra | 17:29 | |
| *** ijw has joined #openstack-infra | 17:29 | |
| pabelanger | hogepodge: events are published to firehose.o.o I believe | 17:29 |
| pabelanger | hogepodge: so, you could run the mqtt client and see them | 17:29 |
| jeblair | hogepodge: to be clear, there was no concious decision to remove it; it just required a lot of work to keep working and we lost all the volunteers who were interested in doing that. | 17:29 |
| *** jamesmcarthur has quit IRC | 17:29 | |
| pabelanger | but ARA will be the properly replacement | 17:29 |
| pabelanger | Ya, the ARA process would need an infra-spec for sure | 17:30 |
| *** felipemonteiro_ has joined #openstack-infra | 17:30 | |
| pabelanger | but, puppetboard is running precise and we opted to delete it over upgrading to trusty | 17:30 |
| jeblair | well, we opted to delete it because it was broken :) | 17:31 |
| pabelanger | indeed! | 17:31 |
| hogepodge | jeblair: sure, no problem. We were just sad to see it not working. | 17:31 |
| jeblair | me too | 17:31 |
| hogepodge | jeblair: but clearly I'm not sad enough to volunteer to make it work #oversubscribedalready | 17:31 |
| pabelanger | infra-root: I'd love a +3 on https://review.openstack.org/499717/ to keep moving forward with afs docs testing | 17:31 |
| jeblair | i mostly wanted to communicate the situation so you didn't think it was capricious :) | 17:32 |
| jeblair | hogepodge: yeah, we think we'll be able to get something useful going with ara with a lot less effort, so hopefully it can slot into our already oversubscribed workloads without major disruption | 17:33 |
| *** trown|lunch is now known as trown | 17:33 | |
| *** ijw has quit IRC | 17:33 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add /etc/alternatives to bwrap https://review.openstack.org/499736 | 17:33 |
| *** felipemonteiro__ has quit IRC | 17:34 | |
| *** felipemonteiro_ has quit IRC | 17:35 | |
| *** salv-orlando has joined #openstack-infra | 17:37 | |
| openstackgerrit | David Shrewsbury proposed openstack-infra/zuul feature/zuulv3: Validate zuul_stream func test output https://review.openstack.org/499732 | 17:40 |
| *** kambiz has quit IRC | 17:41 | |
| *** salv-orlando has quit IRC | 17:41 | |
| *** se-tester_ has joined #openstack-infra | 17:42 | |
| dmsimard | hogepodge: FWIW it so happens that I have a topic item for infra PTG to replace puppetboard by ARA | 17:42 |
| dmsimard | It's on the infra etherpad, feel free to join :) | 17:42 |
| *** Swami has joined #openstack-infra | 17:45 | |
| *** kambiz has joined #openstack-infra | 17:45 | |
| openstackgerrit | Merged openstack-infra/system-config master: Add /etc/openafs/ to trusted_ro_paths for zuul-executor https://review.openstack.org/499717 | 17:47 |
| openstackgerrit | Alex Schultz proposed openstack-infra/tripleo-ci master: Revert "Stop trying to build networking-bagpipe with DLRN" https://review.openstack.org/499744 | 17:47 |
| *** Apoorva has quit IRC | 17:47 | |
| *** Apoorva has joined #openstack-infra | 17:49 | |
| *** baoli has quit IRC | 17:49 | |
| *** baoli has joined #openstack-infra | 17:49 | |
| *** jistr|afk is now known as jistr | 17:50 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add tox_install.sh to deal with upper-constraints https://review.openstack.org/499602 | 17:51 |
| *** efoley has quit IRC | 17:51 | |
| *** psachin has quit IRC | 17:52 | |
| *** links has quit IRC | 17:52 | |
| *** hashar has quit IRC | 17:52 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Use new keystoneauth version discovery https://review.openstack.org/493582 | 17:53 |
| *** eharney has quit IRC | 17:56 | |
| *** ykarel_ has joined #openstack-infra | 17:59 | |
| *** electrofelix has quit IRC | 17:59 | |
| *** mwarad has quit IRC | 18:00 | |
| *** mwarad has joined #openstack-infra | 18:00 | |
| *** rwsu has quit IRC | 18:00 | |
| *** ykarel has quit IRC | 18:01 | |
| pabelanger | clarkb: I'll be promoting 499424 for tripleo, to help fix broken gate jobs on stable/pike. Patch was able to make it into gate itself, but there are 20+ patches in front of it that will mostly likely result in a few gate resets | 18:02 |
| clarkb | pabelanger: dmsimard any idea if xvde2 busy problems are widespread? if not then we are probably no worse than before | 18:02 |
| clarkb | pabelanger: ok | 18:02 |
| clarkb | also there is no longer a man under my house with a torch so I'm back to computer now | 18:02 |
| dmsimard | clarkb: logstash showed only one occurence in 24h last I checked | 18:03 |
| *** ijw has joined #openstack-infra | 18:03 | |
| jeblair | i'm going to restart ze01 to pick up /etc/alternatives is bwrap | 18:03 |
| clarkb | dmsimard: ya so thats similar to the previous error rate. Lets watch it but I don't think ist a major emergency to revert | 18:03 |
| dmsimard | Didn't revert but I did add in back sync/partprobe | 18:04 |
| clarkb | dmsimard: ok | 18:04 |
| dmsimard | Except that failed and I haven't looked at why yet | 18:04 |
| clarkb | pabelanger: so was tripleo always uploading all images for every container job? | 18:04 |
| pabelanger | clarkb: Right, so now they are going to just fetch the containers they need for the job | 18:05 |
| pabelanger | clarkb: that will result in less data and hopefully faster run times | 18:05 |
| clarkb | and fewer points of failure | 18:05 |
| *** yamahata has joined #openstack-infra | 18:05 | |
| jeblair | i'm cleaning up /var/lib/zuul/builds as well | 18:05 |
| pabelanger | clarkb: Ya, in fact the docker reverse proxy cache is working very well. There's only 1 issue where they sometime fail to download from docker.io, but I am working to fix taht. | 18:06 |
| pabelanger | clarkb: all in all, it has been very stable | 18:06 |
| clarkb | cool good to hear | 18:06 |
| pabelanger | clarkb: but, with vexxhost, I just don't think we have the bandwith on the mirror | 18:06 |
| *** dave-mccowan has quit IRC | 18:07 | |
| *** vhosakot has quit IRC | 18:08 | |
| *** wolverineav has quit IRC | 18:08 | |
| *** wolverineav has joined #openstack-infra | 18:08 | |
| *** hashar has joined #openstack-infra | 18:11 | |
| *** jascott1 has joined #openstack-infra | 18:12 | |
| *** vhosakot has joined #openstack-infra | 18:12 | |
| *** dave-mccowan has joined #openstack-infra | 18:14 | |
| *** iyamahat has joined #openstack-infra | 18:15 | |
| *** hashar has quit IRC | 18:15 | |
| *** se-tester_ has quit IRC | 18:16 | |
| *** rwsu has joined #openstack-infra | 18:16 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Handle logging ansible python errors properly https://review.openstack.org/499397 | 18:17 |
| *** iyamahat has quit IRC | 18:20 | |
| *** jistr is now known as jistr|off | 18:21 | |
| *** jascott1 has quit IRC | 18:22 | |
| *** jascott1 has joined #openstack-infra | 18:22 | |
| *** hashar has joined #openstack-infra | 18:23 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: tripleo: run container jobs when touching ^container-images/.*$ https://review.openstack.org/499751 | 18:25 |
| EmilienM | pabelanger, mwhahaha ^ | 18:27 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove -vvv from playbook invocation for log streaming test https://review.openstack.org/499753 | 18:27 |
| *** iyamahat has joined #openstack-infra | 18:27 | |
| *** hashar has quit IRC | 18:27 | |
| *** xarses has joined #openstack-infra | 18:30 | |
| *** xarses has quit IRC | 18:32 | |
| *** hashar has joined #openstack-infra | 18:32 | |
| *** xarses has joined #openstack-infra | 18:33 | |
| *** iyamahat_ has joined #openstack-infra | 18:33 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add support for debug statements https://review.openstack.org/499608 | 18:34 |
| *** mat128_ has joined #openstack-infra | 18:34 | |
| *** iyamahat__ has joined #openstack-infra | 18:37 | |
| *** iyamahat has quit IRC | 18:37 | |
| *** mat128 has quit IRC | 18:37 | |
| *** jtomasek has quit IRC | 18:37 | |
| *** salv-orlando has joined #openstack-infra | 18:38 | |
| *** eranrom has joined #openstack-infra | 18:39 | |
| *** iyamahat_ has quit IRC | 18:40 | |
| *** salv-orlando has quit IRC | 18:43 | |
| *** mat128_ has quit IRC | 18:43 | |
| *** mat128 has joined #openstack-infra | 18:43 | |
| *** eranrom has quit IRC | 18:43 | |
| *** ldnunes has quit IRC | 18:47 | |
| *** pabelanger-web has joined #openstack-infra | 18:48 | |
| pabelanger-web | ISP having routing issues, so using webchat.freenode.net | 18:48 |
| *** hashar has quit IRC | 18:48 | |
| fungi | pabelanger: i was reviewing the 488878 infra docs afs testing change but it seems to run counter to 499717. duplicated effort? should the earlier one get abandoned or is it still needed? | 18:49 |
| *** armax has quit IRC | 18:49 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Don't output complex items in the summary line https://review.openstack.org/499755 | 18:49 |
| clarkb | for awk is the problem that it poinst to alternatives and we didn't mount alternatives in bwrap? | 18:50 |
| *** hashar has joined #openstack-infra | 18:50 | |
| dmsimard | clarkb: yes, and the fix is merged already | 18:50 |
| pabelanger-web | fungi: I'm unable to reach review.o.o currently, so I'll have look once ISP routing is fixed | 18:50 |
| pabelanger-web | fungi: I'm unable to reach review.o.o currently, so I'll have look once ISP routing is fixed | 18:50 |
| dmsimard | clarkb: also I found the issue on my sync/partprobe patch.. silly ansible issue haunting me | 18:50 |
| clarkb | pabelanger-web: ipv6 problems maybe? | 18:50 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Fix error in mirr-workspace-git-repos https://review.openstack.org/499757 | 18:50 |
| *** annegentle has joined #openstack-infra | 18:51 | |
| openstackgerrit | David Moreau Simard proposed openstack-infra/devstack-gate master: Re-introduce sync/partprobe in fix_disk_layout https://review.openstack.org/499687 | 18:51 |
| openstackgerrit | James E. Blair proposed openstack-infra/zuul-jobs master: Fix error in mirror-workspace-git-repos https://review.openstack.org/499757 | 18:51 |
| pabelanger-web | clarkb: not sure, sadly I don't have native IPv6 from ISP. I've been meaning to setup tunnel with ipv6 broker | 18:51 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Don't output complex items in the summary line https://review.openstack.org/499755 | 18:51 |
| dmsimard | pabelanger-web: who are you with ? | 18:52 |
| pabelanger-web | dmsimard: teksavvy | 18:52 |
| dmsimard | Videotron (in Quebec) has ipv6rd | 18:52 |
| dmsimard | teksavvy, at least in Quebec, resells Videotron | 18:52 |
| dmsimard | So maybe you have ipv6rd :) | 18:52 |
| pabelanger-web | dmsimard: not on cable | 18:52 |
| dmsimard | ah, then nope | 18:53 |
| pabelanger-web | DSL does | 18:53 |
| fungi | pabelanger: no sweat, that 488878 change is mordred's anyway so maybe he knows whether it's a dead-end | 18:55 |
| *** eharney has joined #openstack-infra | 18:57 | |
| *** jkilpatr has quit IRC | 18:57 | |
| *** jkilpatr has joined #openstack-infra | 18:57 | |
| *** ldnunes has joined #openstack-infra | 19:00 | |
| *** rcernin has joined #openstack-infra | 19:01 | |
| *** ykarel_ has quit IRC | 19:02 | |
| pabelanger-web | Okay, offline for the next while, interwebs not working if anybody is looking for me | 19:03 |
| *** pabelanger-web has quit IRC | 19:03 | |
| *** ldnunes has quit IRC | 19:06 | |
| *** ijw has quit IRC | 19:08 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Pass the correct object to local module check https://review.openstack.org/499761 | 19:08 |
| clarkb | my old isp in seattle was the other way around no ipv6 on dsl but yes ipv6 otherwise | 19:09 |
| clarkb | any other project config reviewer willing to take a look at https://review.openstack.org/#/c/492231/ to get tls testing enabled in ironic? | 19:13 |
| clarkb | and infra-root reviews on https://review.openstack.org/#/c/491090/ and https://review.openstack.org/#/c/492329/ to finish up the gerrit contact store changes | 19:14 |
| *** krtaylor has quit IRC | 19:15 | |
| *** ijw has joined #openstack-infra | 19:16 | |
| *** slaweq has joined #openstack-infra | 19:16 | |
| *** eranrom has joined #openstack-infra | 19:16 | |
| *** slaweq has quit IRC | 19:16 | |
| *** ijw has quit IRC | 19:16 | |
| openstackgerrit | Merged openstack-infra/infra-specs master: Revise security spec to discuss SSH keys https://review.openstack.org/462207 | 19:16 |
| *** ijw has joined #openstack-infra | 19:16 | |
| *** slaweq has joined #openstack-infra | 19:16 | |
| clarkb | dmsimard: hahaha that bug again | 19:17 |
| clarkb | dmsimard: also my favorite part of that bug was the "what is the use case for this" | 19:17 |
| dmsimard | yeah.. that bug | 19:17 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add tests of accessing paths with file is ok https://review.openstack.org/499762 | 19:18 |
| *** ldnunes has joined #openstack-infra | 19:19 | |
| clarkb | dmsimard: looks like it conflicts with my alignment change, I will rebase | 19:20 |
| clarkb | I wonder if we will see any performance boost with better alignment | 19:21 |
| pabelanger | o/ | 19:22 |
| dmsimard | clarkb: eh, it's performance for swap | 19:22 |
| clarkb | dmsimard: and /opt | 19:22 |
| dmsimard | if you're swapping, you're already throwing performance out the window | 19:22 |
| clarkb | dmsimard: which is where devstack and git and a bunch of stuff happen | 19:22 |
| dmsimard | ah, I guess | 19:22 |
| clarkb | but ya the swap is there as a last ditch effort. We know we need ti for some jobs and just use file backed for other clouds | 19:23 |
| mordred | clarkb: https://review.openstack.org/#/c/491090 is all +2d - I didn't pull the +3 trigger though | 19:23 |
| clarkb | ok thanks, I'll work with fungi to get that in today | 19:25 |
| clarkb | fungi: ^ fyi | 19:25 |
| openstackgerrit | Merged openstack-infra/project-config master: Enable TLS in ironic gate jobs except grenade https://review.openstack.org/492231 | 19:25 |
| *** slaweq_ has joined #openstack-infra | 19:28 | |
| *** slaweq has quit IRC | 19:28 | |
| *** jamesmcarthur has joined #openstack-infra | 19:29 | |
| openstackgerrit | Merged openstack-infra/system-config master: Limit PTL rolls to foundation members https://review.openstack.org/492329 | 19:30 |
| *** xyang1 has quit IRC | 19:35 | |
| *** salv-orlando has joined #openstack-infra | 19:39 | |
| fungi | clarkb: yay! | 19:39 |
| pabelanger | clarkb: fungi: do you mind a +3 on https://review.openstack.org/499751/ trying to help triple avoid more breakages to the gate in the future. I think for zuulv3, tripleo could revist the usuage of files and skip-if logic. | 19:39 |
| *** ijw has quit IRC | 19:39 | |
| *** jkilpatr has quit IRC | 19:40 | |
| fungi | clarkb: i believe 491090 should be a no-op for us at this point, it's basically just cleanup | 19:41 |
| fungi | pabelanger: welcome back to the modern era! how was your brief visit to the 20th century? | 19:43 |
| pabelanger | :) | 19:43 |
| *** salv-orlando has quit IRC | 19:43 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Pass the correct object to local module check https://review.openstack.org/499761 | 19:44 |
| fungi | pabelanger: slightly confused by 499751... wouldn't that switch the job to _only_ run when those files are modified (rather than all the time)? | 19:44 |
| pabelanger | fungi: ya, I think you are right. I think the correct patch would be to add files to the existing filters a few lines below | 19:46 |
| *** slaweq_ has quit IRC | 19:47 | |
| fungi | did you maybe want to add it to an additional project? | 19:47 |
| pabelanger | EmilienM: ^ I think we want to move that logic down to lower filtering on specific container jobs, we'll need it for all 4 scenerios | 19:47 |
| *** slaweq has joined #openstack-infra | 19:48 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add tests of accessing paths with file is ok https://review.openstack.org/499762 | 19:49 |
| EmilienM | pabelanger: do I need to change something in https://review.openstack.org/#/c/499751/ ? | 19:49 |
| pabelanger | EmilienM: ya, let me comment | 19:49 |
| *** HeOS has quit IRC | 19:49 | |
| EmilienM | pabelanger: can you push over maybe? | 19:50 |
| EmilienM | if you know | 19:50 |
| EmilienM | otherwise, comment and I'll look | 19:50 |
| pabelanger | EmilienM: comments left | 19:52 |
| EmilienM | let me look now | 19:53 |
| *** e0ne has joined #openstack-infra | 19:53 | |
| EmilienM | pabelanger: I see, doing the patchset now. | 19:53 |
| EmilienM | pabelanger: well, the problem is that classic multinode scenario will jobs as well | 19:54 |
| EmilienM | pabelanger: the ones which aren't containerized ... | 19:54 |
| EmilienM | pabelanger: that's why I created a separated layout | 19:54 |
| pabelanger | EmilienM: right, so what fungi is saying, if we added to that regex, if any jobs that runs today, doesn't have container-files, it will stop running those jobs | 19:55 |
| clarkb | fungi: ya, but we should probably keep an eye on it as it goes in | 19:55 |
| *** annegentle has quit IRC | 19:55 | |
| EmilienM | pabelanger: I'm fine running it, cool | 19:56 |
| *** olaph1 has joined #openstack-infra | 19:57 | |
| *** olaph has quit IRC | 19:57 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: tripleo: run container jobs when touching ^container-images/.*$ https://review.openstack.org/499751 | 19:57 |
| EmilienM | pabelanger: done ^ | 19:57 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove bindep_command lines https://review.openstack.org/499589 | 19:57 |
| fungi | clarkb: agreed, no argument there. i'm around and watching the syslog on review.o.o now | 19:58 |
| fungi | so feel free to approve at will | 19:59 |
| clarkb | fungi: ok will approve now | 19:59 |
| *** slaweq_ has joined #openstack-infra | 20:00 | |
| *** slaweq has quit IRC | 20:02 | |
| jeblair | restarted ze01 | 20:02 |
| *** jkilpatr has joined #openstack-infra | 20:03 | |
| *** olaph has joined #openstack-infra | 20:05 | |
| *** olaph1 has quit IRC | 20:05 | |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade master: De-client-ify baremetal node_set_provision_state https://review.openstack.org/499773 | 20:06 |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade master: de-client-ify baremetal get_machine https://review.openstack.org/499774 | 20:06 |
| openstackgerrit | Julia Kreger proposed openstack-infra/shade master: Catch attrbute error for other APIs https://review.openstack.org/499775 | 20:06 |
| *** yee379 has quit IRC | 20:09 | |
| *** yee379 has joined #openstack-infra | 20:09 | |
| *** camunoz has quit IRC | 20:10 | |
| openstackgerrit | Merged openstack-infra/puppet-gerrit master: Stop supporting the Contact Store feature https://review.openstack.org/491090 | 20:13 |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: WIP: Move run-docs.sh intree https://review.openstack.org/499778 | 20:15 |
| *** krtaylor has joined #openstack-infra | 20:16 | |
| clarkb | fungi: looks like that merged just before the 20:15 UTC puppet run so you should see that update soon if not already | 20:17 |
| *** jpena is now known as jpena|brb | 20:18 | |
| kong | morning, can anybody have a review for https://review.openstack.org/499567 please? | 20:18 |
| pabelanger | EmilienM: -1 with comment | 20:20 |
| EmilienM | pabelanger: ok... | 20:20 |
| clarkb | kong: done | 20:21 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: tripleo: run container jobs when touching ^container-images/.*$ https://review.openstack.org/499751 | 20:21 |
| EmilienM | pabelanger: done | 20:21 |
| kong | clarkb: thanks for review, will update the patch accordingly | 20:21 |
| fungi | clarkb: there was a puppet pass in the syslog at 20:18 which seems to have applied those changes correctly | 20:21 |
| pabelanger | EmilienM: oh, wait. We still need the regex, just the files section is no longer needed | 20:22 |
| fungi | (removed the unused files, and updated the apache vhost config accordingly) | 20:22 |
| EmilienM | pabelanger: lol | 20:22 |
| EmilienM | ok | 20:22 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix error in mirror-workspace-git-repos https://review.openstack.org/499757 | 20:22 |
| fungi | clarkb: i've been poking around gerrit a bit, seems normal | 20:23 |
| fungi | so... success i guess! | 20:23 |
| clarkb | fungi: woot, I think that means the cleanup spec can be merged whenever we are ready | 20:23 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/project-config master: tripleo: run container jobs when touching ^container-images/.*$ https://review.openstack.org/499751 | 20:23 |
| EmilienM | pabelanger: and done ^ !! :-) | 20:23 |
| fungi | fire at will | 20:23 |
| pabelanger | EmilienM: thanks! | 20:26 |
| EmilienM | pabelanger: no, thanks to you... really | 20:26 |
| pabelanger | EmilienM: want to make sure job reports peoperly then +2 | 20:26 |
| *** kgiusti has left #openstack-infra | 20:27 | |
| EmilienM | ok wfm! | 20:27 |
| *** slaweq_ has quit IRC | 20:30 | |
| *** esberglu has quit IRC | 20:31 | |
| *** esberglu has joined #openstack-infra | 20:31 | |
| *** annegentle has joined #openstack-infra | 20:32 | |
| *** tosky has quit IRC | 20:35 | |
| pabelanger | EmilienM: fungi: okay, I think 499751 is correct now, do you mind reviewing again | 20:35 |
| *** e0ne has quit IRC | 20:36 | |
| *** esberglu has quit IRC | 20:36 | |
| mtreinish | fungi: if you get a sec can you take a look at: https://review.openstack.org/#/c/490123/ | 20:37 |
| mtreinish | we haven't run an update on the openstack-health api server in over six months at this point | 20:37 |
| *** jamesmcarthur has quit IRC | 20:39 | |
| *** slaweq has joined #openstack-infra | 20:39 | |
| *** salv-orlando has joined #openstack-infra | 20:39 | |
| *** ijw has joined #openstack-infra | 20:40 | |
| *** slaweq has quit IRC | 20:40 | |
| *** slaweq has joined #openstack-infra | 20:41 | |
| *** armax has joined #openstack-infra | 20:43 | |
| openstackgerrit | James E. Blair proposed openstack-infra/infra-manual master: Add more content to zuulv3 migration doc https://review.openstack.org/499793 | 20:43 |
| jeblair | mordred, fungi: ^ i have produced another unit of work | 20:44 |
| *** esberglu has joined #openstack-infra | 20:44 | |
| *** eharney has quit IRC | 20:45 | |
| *** salv-orlando has quit IRC | 20:45 | |
| jeblair | Shrews, jlk: ^ | 20:45 |
| openstackgerrit | Monty Taylor proposed openstack-infra/shade master: Add tox_install.sh to deal with upper-constraints https://review.openstack.org/499602 | 20:45 |
| mordred | jeblair: woot | 20:45 |
| *** ijw has quit IRC | 20:45 | |
| Shrews | okie | 20:46 |
| *** annegentle has quit IRC | 20:46 | |
| jlk | jeblair: will read | 20:46 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Remove no_log from fetch-sphinx-output https://review.openstack.org/499401 | 20:46 |
| *** florianf has quit IRC | 20:50 | |
| *** jamesmcarthur has joined #openstack-infra | 20:50 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Add support for debug statements https://review.openstack.org/499608 | 20:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Don't output complex items in the summary line https://review.openstack.org/499755 | 20:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Remove -vvv from playbook invocation for log streaming test https://review.openstack.org/499753 | 20:52 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul feature/zuulv3: Handle logging ansible python errors properly https://review.openstack.org/499397 | 20:52 |
| *** annegentle has joined #openstack-infra | 20:52 | |
| *** jamesmcarthur has quit IRC | 20:53 | |
| *** mat128 has quit IRC | 20:55 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Ensure afs_target directory exists https://review.openstack.org/499800 | 20:55 |
| clarkb | EmilienM: pabelanger so the problem is the container jobs weren't running when those files were changed right? | 20:58 |
| pabelanger | clarkb: EmilienM: yes, and a breaking change was merged and broke other jobs | 20:59 |
| clarkb | pabelanger: re whether or not we can remove the git clones from the jobs. Thinking about that a bit more and tripleo jobs run against other projects now right? How do you get say the proposed change to nova installed on the node for those jobs if not via the git clones | 21:00 |
| pabelanger | clarkb: before they the dlrn build process would use the git repo in /opt/stack/new, but I think new tripleo-quickstart roles, are fetching the ref if needed. Which, isn't good either because it is already on disk | 21:02 |
| clarkb | pabelanger: is it at least zuul aware? beacuse it may not gate properly if just fetching the ref in gerrit | 21:02 |
| pabelanger | clarkb: so, I think at PTG, when discussing zuulv3 things, we maybe help learn and reorg | 21:03 |
| pabelanger | clarkb: ya, they have zuul-clone logic | 21:03 |
| clarkb | ok thats good | 21:03 |
| pabelanger | ya | 21:03 |
| openstackgerrit | Merged openstack-infra/infra-manual master: Add more content to zuulv3 migration doc https://review.openstack.org/499793 | 21:03 |
| *** trown is now known as trown|outtypewww | 21:04 | |
| *** ldnunes has quit IRC | 21:04 | |
| *** wolverineav has quit IRC | 21:04 | |
| *** askb has joined #openstack-infra | 21:04 | |
| *** ijw has joined #openstack-infra | 21:05 | |
| *** wolverineav has joined #openstack-infra | 21:05 | |
| *** annegentle has quit IRC | 21:07 | |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Add tests of accessing paths with file is ok https://review.openstack.org/499762 | 21:07 |
| *** thorst_afk has quit IRC | 21:08 | |
| *** askb has quit IRC | 21:09 | |
| *** wolverineav has quit IRC | 21:09 | |
| *** askb has joined #openstack-infra | 21:10 | |
| openstackgerrit | Merged openstack-infra/project-config master: tripleo: run container jobs when touching ^container-images/.*$ https://review.openstack.org/499751 | 21:10 |
| *** Goneri has quit IRC | 21:13 | |
| *** olaph1 has joined #openstack-infra | 21:14 | |
| *** jpena|brb is now known as jpena | 21:15 | |
| *** olaph has quit IRC | 21:16 | |
| *** ldnunes has joined #openstack-infra | 21:16 | |
| *** ijw has quit IRC | 21:16 | |
| *** ldnunes has quit IRC | 21:17 | |
| *** dave-mccowan has quit IRC | 21:20 | |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Preparing TripleO CI to test upgrades to Queens https://review.openstack.org/499359 | 21:26 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/tripleo-ci master: Preparing TripleO CI to test upgrades to Queens https://review.openstack.org/499359 | 21:26 |
| openstackgerrit | Merged openstack-infra/zuul feature/zuulv3: Log cachecontrol info by default https://review.openstack.org/499257 | 21:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Rework and decompose the fileserver secret https://review.openstack.org/499809 | 21:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove the old add-fileserver parameters https://review.openstack.org/499810 | 21:30 |
| openstackgerrit | Monty Taylor proposed openstack-infra/zuul-jobs master: Change the parameters to add-fileserver https://review.openstack.org/499811 | 21:30 |
| *** esberglu has quit IRC | 21:31 | |
| mordred | jeblair, pabelanger, jlk: ^^ I could use some eyeballs on that stack - this is related to the discussion from yesterday about bunding non-secret data like hostnames with secrets - and I believe the next thing I was going to do is the example of why we should decouple | 21:31 |
| mordred | I _believe_ that that stack does expand/contract correctly | 21:31 |
| openstackgerrit | Merged openstack-infra/puppet-openstack_health master: Switch api server to use system python instead of venv https://review.openstack.org/490123 | 21:32 |
| *** inc0 has quit IRC | 21:34 | |
| *** jascott1 has quit IRC | 21:34 | |
| *** thorst_afk has joined #openstack-infra | 21:34 | |
| *** annegentle has joined #openstack-infra | 21:35 | |
| *** jascott1 has joined #openstack-infra | 21:35 | |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/hacking master: Release notes for 0.11.0 https://review.openstack.org/499814 | 21:35 |
| *** hashar has quit IRC | 21:35 | |
| *** inc0 has joined #openstack-infra | 21:35 | |
| *** jascott1 has joined #openstack-infra | 21:35 | |
| *** thorst_afk has quit IRC | 21:36 | |
| *** srobert_ has quit IRC | 21:36 | |
| *** jascott1 has quit IRC | 21:37 | |
| *** jascott1 has joined #openstack-infra | 21:37 | |
| *** eroux has quit IRC | 21:37 | |
| mtreinish | fungi: thanks for the +A | 21:38 |
| *** thorst_afk has joined #openstack-infra | 21:39 | |
| *** jascott1 has quit IRC | 21:39 | |
| mtreinish | hah, apparently I wrote that same patch ~1 yr ago forgot about and pushed a new one up | 21:39 |
| mtreinish | after that merged I got a merge conflict email :) | 21:39 |
| *** salv-orlando has joined #openstack-infra | 21:40 | |
| pabelanger | mordred: jeblair: clarkb: fungi: so, need help on variable bikeshed, I need to rename http://git.openstack.org/cgit/openstack-infra/zuul/tree/.zuul.yaml?h=feature/zuulv3#n38 to something else. in this context, 'infra/zuul' will be appended to '/afs/.openstack.org/docs', and we cannot call it afs_target, because we already afs_target already defined. So, option A is just rename this to another | 21:40 |
| pabelanger | variable, option b, is rework upload-afs role, to accept 3 paramter and build up full path within role. | 21:40 |
| pabelanger | publisher_target maybe? | 21:41 |
| mordred | pabelanger: ah - so that original questoin about what was the difference between the three parameters ... | 21:43 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/hacking master: Release notes for 0.14.0 https://review.openstack.org/499814 | 21:43 |
| *** baoli has quit IRC | 21:43 | |
| mordred | pabelanger: is the intent something like {{ afs_base }}/{{ afs_publisher_target }} - if afs_base was /afs/.openstack.org/docs and afs_publisher_target was infra/zuul ? | 21:44 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/hacking master: Release notes for 0.14.0 https://review.openstack.org/499814 | 21:44 |
| mordred | pabelanger: cause /afs/.openstack.org/docs is the volume we're publishing to, right? and infra/zuul is just a subdirectory where we put zuul things? | 21:45 |
| openstackgerrit | Lingxian Kong proposed openstack-infra/project-config master: Add an experimental functional job for Qinling https://review.openstack.org/499567 | 21:45 |
| *** baoli has joined #openstack-infra | 21:45 | |
| *** salv-orlando has quit IRC | 21:45 | |
| pabelanger | mordred: yes, correct. | 21:45 |
| dmsimard | clarkb: https://review.openstack.org/#/c/499687/ passed | 21:46 |
| pabelanger | mordred: issues is because afs_target is already defined, we are trying to redefine it at runtime and ansible is bombing | 21:46 |
| dmsimard | Saw another disk busy issue | 21:46 |
| pabelanger | mordred: so need a 3rd varible, which we will expost to jobs to setup there 'infra/zuul' target path | 21:46 |
| dmsimard | clarkb: http://logs.openstack.org/16/442716/31/check/gate-tripleo-ci-centos-7-scenario002-multinode-oooq-container/5722d13/logs/devstack-gate-setup-host.txt | 21:46 |
| pabelanger | mordred: well, override the default value we'll set | 21:46 |
| mordred | pabelanger: yah - because for non-infra jobs the value is zuul.project.short_name right? | 21:47 |
| pabelanger | mordred: exactly yes | 21:47 |
| mordred | cool | 21:48 |
| pabelanger | branch jobs would be different too, | 21:48 |
| pabelanger | but we'll handle that with default variables and facts | 21:48 |
| mordred | yah | 21:48 |
| *** priteau has quit IRC | 21:49 | |
| jeblair | mordred: got a second to chat about your decompose patch? | 21:49 |
| *** baoli has quit IRC | 21:50 | |
| mordred | jeblair: yes! | 21:50 |
| jeblair | mordred: part of what we baked into the secret was also some safety due to variable precedence | 21:50 |
| jeblair | mordred: https://docs.openstack.org/infra/zuul/feature/zuulv3/user/jobs.html#variables | 21:50 |
| jeblair | mordred: the patch as written will allow any job to stick any file anywhere on tarballs.o.o by overriding those job variables | 21:51 |
| jeblair | or rather, on static.o.o | 21:51 |
| jeblair | mordred: so i think we may want to make those actual site variables | 21:52 |
| *** jascott1 has joined #openstack-infra | 21:52 | |
| jeblair | mordred: which you hinted at by including 'site_' in their name :) | 21:52 |
| mordred | jeblair: excellent point - and yes, I think you're right about that - lemme to ponder the patches again with that in mind | 21:52 |
| openstackgerrit | Emilien Macchi proposed openstack-infra/elastic-recheck master: Add query for 1714361 https://review.openstack.org/499821 | 21:52 |
| mordred | pabelanger: I think maybe just call the parameter you set in zuul.yaml afs_publisher_target - then you can make the line in openstack-afs.yaml afs_target: "{{ afs.path }}/{{ afs_publisher_target }}" | 21:53 |
| mordred | pabelanger: and avoid the recursion without too much fuss | 21:53 |
| jeblair | mordred: the other thing i'd say about that is -- perhaps we *should* use a different key for the wheel builders? | 21:54 |
| jeblair | mordred: in which case, the marginal cost of secret bundling is small | 21:54 |
| pabelanger | mordred: okay, wfm | 21:54 |
| mordred | jeblair: actually ... returning to "will allow any job to stick any file anywhere" ... will it actually? | 21:55 |
| mordred | jeblair: add-fileserver runs in a post job on a base job that's defined ... nevermind - I see it | 21:56 |
| jeblair | mordred: yeah, secrets bind tightly to playbooks but variables don't; so the base job gets overridden variables | 21:56 |
| mordred | jeblair: it's because we put variables defined for a job into the inventory | 21:56 |
| mordred | yup | 21:56 |
| mordred | with you | 21:56 |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Rename to afs_publisher_target https://review.openstack.org/499824 | 21:56 |
| jeblair | (and, unlike secrets, that has legit uses) | 21:56 |
| hongbin | hi, in our gate, some config files are missing in http://logs.openstack.org/17/498617/3/check/gate-zun-devstack-dsvm-docker-sql/003b63c/logs/etc/ (kuryr-libnetwork config file is missing), do anyone know how to figure it out? | 21:56 |
| mordred | yup | 21:56 |
| *** rlandy is now known as rlandy|bbl | 21:58 | |
| *** bobh has quit IRC | 21:59 | |
| pabelanger | mordred: jeblair: do you mind a review of https://review.openstack.org/499824/ and if you agree. That fixes our afs bug | 22:00 |
| mordred | pabelanger: lgtm | 22:02 |
| jlk | What is the "link-logs" builder, and is that something that's just "Taken care of" in v3? | 22:02 |
| jeblair | pabelanger: +3 | 22:02 |
| jeblair | jlk: it just prints out the URL for the logs; it was especially useful when we were running jenkins; i'd probably ignore it for now | 22:03 |
| jeblair | jlk: if we do something similar, it should be at the base job level anyway | 22:03 |
| jlk | kk | 22:03 |
| fungi | pabelanger: yeah, "back in the day" you might look at the console log in jenkins and want to map that back to where we stored the other related logs on logs.o.o | 22:04 |
| fungi | so that provided a convenient url at the top of the console log | 22:04 |
| fungi | i suppose once we get rolling with the websockets console log stream it might end up being useful again, but i wouldn't worry too much about that for now | 22:05 |
| fungi | and maybe we can do something more fancy to solve that need now that it's a log streamer under our control so we're not just limited to what content we can spam into the job's stdout | 22:06 |
| jeblair | nice headers or footers, for instance | 22:06 |
| fungi | just what i was thinking | 22:06 |
| jeblair | this is all *slightly* complicated by the fact that it's now the responsibility of a small snippet of code that runs at the very end of the job to actually determine that location... but that just sounds like a fun problem to solve. :) | 22:07 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/hacking master: Release notes for 0.14.0 https://review.openstack.org/499814 | 22:07 |
| jeblair | later | 22:07 |
| openstackgerrit | Andrea Frittoli proposed openstack-dev/hacking master: Release notes for 0.14.0 https://review.openstack.org/499814 | 22:08 |
| *** gouthamr has quit IRC | 22:08 | |
| fungi | yeah, maybe some low-hanging fruit for someone post-v3 | 22:08 |
| *** vhosakot has quit IRC | 22:12 | |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove the old add-fileserver parameters https://review.openstack.org/499810 | 22:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Rework and decompose the fileserver secret https://review.openstack.org/499809 | 22:12 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Add fileserver and log server host and paths to site vars https://review.openstack.org/499829 | 22:12 |
| mordred | jeblair: ^^ that better? | 22:12 |
| *** vhosakot has joined #openstack-infra | 22:12 | |
| openstackgerrit | Merged openstack-infra/project-config master: Rename to afs_publisher_target https://review.openstack.org/499824 | 22:13 |
| jeblair | mordred: should probably s/variables/vars/ | 22:13 |
| *** jcoufal has quit IRC | 22:16 | |
| jeblair | mordred: yes that looks good. the downsides to this approach are that the keys, hostnames, and paths are now in separate locations with a separate update path (some in puppet, some in zuul). so a logserver migration is now a multistep process (whereas if they are bundled in secrets, it's a one-line secret change). | 22:16 |
| *** ijw has joined #openstack-infra | 22:17 | |
| openstackgerrit | Andrea Frittoli proposed openstack-infra/project-config master: Add release not jobs for hacking https://review.openstack.org/499832 | 22:19 |
| *** dprince has quit IRC | 22:20 | |
| jeblair | mordred: actually i take that back -- why do you still have some variables? that still allows for mischief | 22:20 |
| jeblair | mordred: it's not as serious, but users can still break log uploading easily | 22:20 |
| *** vhosakot_ has joined #openstack-infra | 22:21 | |
| *** vhosakot has quit IRC | 22:23 | |
| *** ijw has quit IRC | 22:23 | |
| jeblair | mordred: another option (i'm not sure i like this one) would be to use 2 secrets. | 22:24 |
| jeblair | mordred: another option (i think i like this one more) would be to put the non-secret values in the playbook. | 22:24 |
| jeblair | mordred: that's close to your first idea, but dodges the variable precedence problem and keeps everything in zuul. | 22:25 |
| jlk | question, the "proposal" node was a special node that had a special ssh key on it, right? and that's why some jobs were directed there, so that they could do things with that key? | 22:27 |
| jeblair | jlk: yes | 22:27 |
| *** ijw has joined #openstack-infra | 22:27 | |
| *** annegentle has quit IRC | 22:27 | |
| *** tosky has joined #openstack-infra | 22:27 | |
| fungi | specifically, ssh key for an account in gerrit so that those jobs could propose changes | 22:27 |
| jlk | I'm working on the job propose-project-config-updates, which needs the key. I could make the job a child of the 'propose-updates' job, which uses the secret to add the key, but it also does some rsyncing that's unnecessary for this job. Other jobs needed it because they used scripts out of this repo to do things | 22:28 |
| jlk | this job only runs on this repo, and uses the content directly from the repo | 22:28 |
| jlk | would it be better to break the parent relationship, and just add the secret to the job? | 22:28 |
| *** krtaylor has quit IRC | 22:28 | |
| fungi | or could the secret be moved into a role that both jobs inherit? | 22:29 |
| *** salv-orlando has joined #openstack-infra | 22:29 | |
| jlk | it is sortof | 22:29 |
| jlk | the secret use is in a generic 'add-sshkey' role | 22:29 |
| fungi | not sure if that's helpful since i guess the secret is already an object unto itself | 22:29 |
| *** andreww has joined #openstack-infra | 22:29 | |
| jlk | which is called by the parent's pre playbook | 22:29 |
| fungi | yeah | 22:29 |
| jlk | so I'd make a new pre playbook at this job's level, that uses the secret and calls that generic role | 22:30 |
| jlk | I think that makes most sense. | 22:30 |
| fungi | however both jobs run some specific commands to propose a change to gerrit, at least | 22:30 |
| jlk | avoids the unecessary rsync bits | 22:30 |
| *** rcernin has quit IRC | 22:30 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/openstack-zuul-jobs master: Move run-docs.sh intree https://review.openstack.org/499778 | 22:31 |
| *** slaweq has quit IRC | 22:32 | |
| *** xarses has quit IRC | 22:33 | |
| mordred | jeblair: how do dependencies work with variants? | 22:33 |
| *** andreww has quit IRC | 22:34 | |
| *** xarses has joined #openstack-infra | 22:34 | |
| jlk | oh | 22:34 |
| mordred | jeblair: nod - I'll poke at the playbook idea | 22:34 |
| jlk | another way to do this | 22:34 |
| *** annegentle has joined #openstack-infra | 22:34 | |
| *** xarses has quit IRC | 22:34 | |
| jlk | I could set a job vars perhaps, and make hte parent pre playbook default to copying the script but read a var to opt out | 22:34 |
| *** xarses has joined #openstack-infra | 22:34 | |
| jlk | Are job vars passed to parent (pre) playbooks? | 22:34 |
| jlk | jeblair: ^ | 22:34 |
| mordred | yes | 22:35 |
| jeblair | mordred: i think i need more specifics re variants/dependencies. | 22:35 |
| mordred | jeblair: if I define 6 variants of a job in a project pipeline definition, and then I want a job to run once they're all done | 22:35 |
| jeblair | mordred: the job will only run once | 22:35 |
| jeblair | mordred: (in v3 as in v2, a single item only gets one run of a job) | 22:36 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Fix syntax issue with NamedTemporaryFile https://review.openstack.org/499800 | 22:36 |
| jeblair | mordred: so if your 6 variants apply to, say, 6 different branches, then only the variant matching that branch will affect the job being run | 22:36 |
| mordred | jeblair: lemme push patch -- too abstract | 22:37 |
| jeblair | mordred: if your 6 variants all apply to the same branch, then they'll all apply | 22:37 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: WIP Add wheel mirror jobs https://review.openstack.org/499843 | 22:37 |
| mordred | jeblair: cool - so the dependency in that ^^ does th ething I expect | 22:38 |
| *** thegreenhundred has quit IRC | 22:38 | |
| mordred | jeblair: (there are obviously several things missing from that patch) | 22:39 |
| jeblair | mordred: the release job will, but i'm afraid the build job won't. | 22:39 |
| jeblair | mordred: that will run 2 jobs build-wheel-mirror with wheel-mirror-ubuntu-xenial-amd64.slave.openstack.org and the release-wheel-mirror | 22:39 |
| mordred | jeblair: that will not do 6 different variants of the job with different variables? | 22:39 |
| jeblair | mordred: everything before then will effectively be ignored because it's overridden | 22:40 |
| mordred | hrm. OH - you know what - I'm thinking abot this wrongly | 22:40 |
| jeblair | mordred: i think you want inheritance here. 6 jobs named build-wheel-mirror-$something all inheriting from build-wheel-mirror | 22:40 |
| mordred | jeblair: I've got an even better idea | 22:40 |
| mordred | jeblair: one job that adds multiple hosts and then does a single playbook that runs content on all 3 hosts | 22:41 |
| *** tosky has quit IRC | 22:41 | |
| mordred | because, you konw what? we have ansible - we don't need to make 6 different jobs :) | 22:41 |
| jeblair | mordred: :) | 22:41 |
| *** armax has quit IRC | 22:41 | |
| openstackgerrit | John L. Villalovos proposed openstack-infra/project-config master: Add release note job for hacking https://review.openstack.org/499832 | 22:41 |
| *** armax has joined #openstack-infra | 22:41 | |
| mordred | jeblair: I have a feeling the next year is going to have many such 'oh, no, you're trying to put things into the wrong layer' | 22:41 |
| mordred | moments | 22:41 |
| jeblair | mordred: yeah, it's pretty exciting to have so many new tools :) | 22:42 |
| mordred | jeblair: and the playbook can even just do with-items: - python2 - python3 - since we can't run 2 and 3 in parallel on those nodes ANYWAY | 22:42 |
| *** jgriffith has quit IRC | 22:43 | |
| *** iyamahat__ has quit IRC | 22:43 | |
| *** jgriffith has joined #openstack-infra | 22:44 | |
| jeblair | mordred: be sure to double the job runtime :) | 22:45 |
| jeblair | s/runtime/timeout/ | 22:45 |
| mordred | ++ | 22:45 |
| *** claudiub has quit IRC | 22:47 | |
| jeblair | i'm going to restart zuulv3 scheduler as soon as the next zuul-jobs change lands | 22:48 |
| *** yamahata has quit IRC | 22:49 | |
| *** slaweq has joined #openstack-infra | 22:49 | |
| openstackgerrit | Jesse Keating proposed openstack-infra/project-config master: Add propose-project-config-update job https://review.openstack.org/499845 | 22:49 |
| jlk | ^^ that's my attempt at this job. | 22:50 |
| jlk | gotta go | 22:51 |
| *** slaweq has quit IRC | 22:54 | |
| mordred | jlk: thanks! | 22:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove the old add-fileserver parameters https://review.openstack.org/499810 | 22:55 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Rework and decompose the fileserver secret https://review.openstack.org/499809 | 22:56 |
| mordred | jeblair: there ya go | 22:56 |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Fix syntax issue with NamedTemporaryFile https://review.openstack.org/499800 | 22:56 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove the old add-fileserver parameters https://review.openstack.org/499810 | 22:58 |
| jeblair | restarting zuulv3 scheduler | 22:59 |
| pabelanger | ack | 23:01 |
| *** salv-orlando has quit IRC | 23:01 | |
| jeblair | the cachecontrol debug logs are pretty chatty; we'll probably want to dial them down once we have a handle on things | 23:02 |
| *** salv-orlando has joined #openstack-infra | 23:02 | |
| mordred | jeblair: ++ | 23:03 |
| *** annegentle has quit IRC | 23:03 | |
| mordred | jeblair: they have basically 2 settings - on and off | 23:03 |
| jeblair | good news! the devstack-legacy job got its repos put in place, in about 1.5 minutes | 23:03 |
| mordred | jeblair: but I agree, once we have a handle, turning them back off is likely great | 23:04 |
| jeblair | on infracloud-chocolate | 23:04 |
| mordred | jeblair: WOOT! | 23:04 |
| mordred | jeblair: that's super exciting | 23:04 |
| jeblair | that's less than 2 hours. | 23:04 |
| jeblair | er, 1 hour. | 23:04 |
| pabelanger | much less | 23:04 |
| mordred | jeblair: it is definitely less than 2 hours OR 1 hour | 23:04 |
| jeblair | the job itself still failed, and took 2 hours to do so | 23:04 |
| jeblair | so on to see what's missing :) | 23:04 |
| mordred | jeblair: dude. getting the git repos onto the node and running a script is really all I care about :) | 23:05 |
| *** olaph has joined #openstack-infra | 23:05 | |
| *** olaph1 has quit IRC | 23:05 | |
| *** salv-orlando has quit IRC | 23:06 | |
| *** salv-orlando has joined #openstack-infra | 23:06 | |
| *** kjackal has quit IRC | 23:07 | |
| *** kjackal has joined #openstack-infra | 23:07 | |
| openstackgerrit | Ken Dreyer proposed openstack/python-jenkins master: build_job: fix grammar in comment https://review.openstack.org/499847 | 23:07 |
| mordred | pabelanger: is this stack ok with you? https://review.openstack.org/#/c/499809/ https://review.openstack.org/#/c/499811/ https://review.openstack.org/#/c/499810/ ? | 23:08 |
| *** xarses has quit IRC | 23:08 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add /afs/.openstack.org to trusted_rw_paths https://review.openstack.org/499848 | 23:08 |
| pabelanger | jeblair: mordred: ^adds trusted_rw_paths for /afs/.openstack.org | 23:09 |
| pabelanger | mordred: looking | 23:09 |
| *** jpena is now known as jpena|off | 23:09 | |
| jeblair | pabelanger: suggest adding /afs/ to trusted and untrusted | 23:09 |
| *** ihrachys has quit IRC | 23:09 | |
| pabelanger | jeblair: sure | 23:10 |
| jeblair | as long as we don't give the executor an ip acl, that should be fine | 23:10 |
| jeblair | pabelanger: well | 23:10 |
| jeblair | pabelanger: i guess it's hard to use that in an untrusted job | 23:10 |
| mordred | pabelanger: also, anything else of yours I should be reviewing? | 23:10 |
| jeblair | pabelanger: so maybe still keep that for trusted only, but change to /afs ? | 23:11 |
| *** ijw has quit IRC | 23:11 | |
| pabelanger | jeblair: mordred: let me fix quickly | 23:11 |
| openstackgerrit | Paul Belanger proposed openstack-infra/system-config master: Add /afs to trusted_rw_paths https://review.openstack.org/499848 | 23:12 |
| *** ijw has joined #openstack-infra | 23:12 | |
| pabelanger | mordred: https://review.openstack.org/499778/ should also be ready, but we might need to bikeshed on required-projects | 23:13 |
| pabelanger | mordred: +2 on 499809 with comment | 23:13 |
| openstackgerrit | Ken Dreyer proposed openstack/python-jenkins master: get_job_name: fix grammar in comment https://review.openstack.org/499849 | 23:14 |
| pabelanger | jeblair: mordred: so, with system-config change, zuul-afs should works. Job passed, but data was just written into bwrap | 23:15 |
| *** ijw has quit IRC | 23:16 | |
| mordred | pabelanger: cool | 23:19 |
| mordred | pabelanger: +2 from me | 23:19 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Rework and decompose the fileserver secret https://review.openstack.org/499809 | 23:21 |
| mordred | pabelanger: ^^ I updated that from yourcomment - I wasn't intending on changing anything about that | 23:21 |
| kong | guys, i have updated https://review.openstack.org/499567, can I ask review again? I really need it asap | 23:22 |
| *** pvaneck has quit IRC | 23:22 | |
| *** hongbin has quit IRC | 23:22 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Allow user to select source directory in fetch-sphinx-output https://review.openstack.org/499852 | 23:22 |
| *** salv-orlando has quit IRC | 23:23 | |
| *** salv-orlando has joined #openstack-infra | 23:23 | |
| *** stakeda has joined #openstack-infra | 23:24 | |
| pabelanger | mordred: sorry, another comment on 499809 | 23:24 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: WIP Add wheel mirror jobs https://review.openstack.org/499843 | 23:26 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Remove the old add-fileserver parameters https://review.openstack.org/499810 | 23:26 |
| openstackgerrit | Monty Taylor proposed openstack-infra/project-config master: Rework and decompose the fileserver secret https://review.openstack.org/499809 | 23:26 |
| openstackgerrit | Merged openstack-infra/system-config master: Add /afs to trusted_rw_paths https://review.openstack.org/499848 | 23:27 |
| *** salv-orlando has quit IRC | 23:28 | |
| *** dimak has quit IRC | 23:28 | |
| openstackgerrit | Merged openstack-infra/shade master: Add tox_install.sh to deal with upper-constraints https://review.openstack.org/499602 | 23:28 |
| *** dimak has joined #openstack-infra | 23:29 | |
| *** HeOS has joined #openstack-infra | 23:30 | |
| *** yamamoto_ has joined #openstack-infra | 23:31 | |
| *** jamesmcarthur has joined #openstack-infra | 23:31 | |
| *** yamamoto_ has quit IRC | 23:31 | |
| *** yamamot__ has joined #openstack-infra | 23:31 | |
| *** Julien-z_ has joined #openstack-infra | 23:32 | |
| *** slaweq has joined #openstack-infra | 23:33 | |
| *** jamesmcarthur has quit IRC | 23:35 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: Allow user to select source directory in fetch-sphinx-output https://review.openstack.org/499852 | 23:35 |
| *** iyamahat has joined #openstack-infra | 23:36 | |
| *** s-shiono has joined #openstack-infra | 23:37 | |
| *** slaweq has quit IRC | 23:38 | |
| *** thorst_afk has quit IRC | 23:39 | |
| openstackgerrit | James E. Blair proposed openstack-infra/project-config master: Zuul v3: Use mirrored git repos in base job https://review.openstack.org/499854 | 23:43 |
| openstackgerrit | Paul Belanger proposed openstack-infra/zuul-jobs master: DNM - testing base-test playbook https://review.openstack.org/490945 | 23:43 |
| *** kjackal has quit IRC | 23:45 | |
| *** kjackal has joined #openstack-infra | 23:45 | |
| *** ijw has joined #openstack-infra | 23:45 | |
| *** dingyichen has joined #openstack-infra | 23:46 | |
| *** salv-orlando has joined #openstack-infra | 23:47 | |
| *** rama_y has quit IRC | 23:48 | |
| openstackgerrit | Samuel de Medeiros Queiroz proposed openstack-infra/shade master: De-client-ify User Update https://review.openstack.org/499284 | 23:49 |
| *** priteau has joined #openstack-infra | 23:49 | |
| openstackgerrit | Paul Belanger proposed openstack-infra/project-config master: Disable facts on logs.o.o https://review.openstack.org/499855 | 23:50 |
| *** ijw has quit IRC | 23:51 | |
| *** sdague has quit IRC | 23:54 | |
| *** priteau has quit IRC | 23:54 | |
| openstackgerrit | Merged openstack-infra/zuul-jobs master: Allow user to select source directory in fetch-sphinx-output https://review.openstack.org/499852 | 23:54 |
| *** marst has quit IRC | 23:57 | |
| *** Apoorva_ has joined #openstack-infra | 23:57 | |
| *** xarses has joined #openstack-infra | 23:59 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!