| *** DSpider has quit IRC | 00:47 | |
| *** hamalq has quit IRC | 01:01 | |
| openstackgerrit | Ian Wienand proposed opendev/bindep master: [WIP] Option to only match given profiles https://review.opendev.org/753198 | 01:03 |
|---|---|---|
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: [dnm] merge-output test https://review.opendev.org/753199 | 02:05 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: [dnm] merge-output test https://review.opendev.org/753199 | 02:06 |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: [dnm] merge-output test https://review.opendev.org/753199 | 02:10 |
| *** hamalq has joined #opendev | 02:25 | |
| openstackgerrit | sebastian marcet proposed opendev/puppet-openstackid master: Fixed typo ( extra =) https://review.opendev.org/753205 | 03:27 |
| *** ykarel|away has joined #opendev | 04:05 | |
| *** ykarel|away is now known as ykarel | 04:10 | |
| *** ykarel has quit IRC | 04:44 | |
| *** ykarel has joined #opendev | 04:46 | |
| AJaeger | ianw: could you review https://review.opendev.org/752745, please? | 05:19 |
| openstackgerrit | Merged openstack/project-config master: Linaro US: Add a 16GB RAM label for CentOS 8 https://review.opendev.org/753036 | 05:22 |
| AJaeger | clarkb, ianw , it's now the 22nd - want to switch fedora-latest to Fedora 32? https://review.opendev.org/#/c/752744/ | 05:25 |
| ianw | AJaeger: not sure if devstack is working yet? but anyway, i guess that's something we need to debug at any rate and waiting won't magically make it get better | 05:26 |
| openstackgerrit | Merged openstack/project-config master: Switch grafana nodepool to Fedora 32 https://review.opendev.org/752745 | 05:28 |
| AJaeger | ianw: no idea about devstack... | 05:31 |
| AJaeger | ianw: do you know why the infra-prod-service-nodepool deploy job failed for https://review.opendev.org/753036? | 05:31 |
| *** ykarel has quit IRC | 05:33 | |
| cgoncalves | job infra-prod-service-nodepool (Zuul deploy pipeline) in https://review.opendev.org/#/c/753036/ failed with: Timeout exception waiting for the logger. Please check connectivity to [bridge.openstack.org:19885] | 05:33 |
| ianw | cgoncalves: yeah, we don't log the output because it hasn't been fully audited to remove sensitive bits | 05:35 |
| ianw | i'm looking at the on-disk log file and it seems to be ok... | 05:35 |
| ianw | nb03.opendev.org : ok=1 changed=0 unreachable=1 | 05:35 |
| ianw | i tell a lie | 05:35 |
| ianw | nb03.opendev.org | SHUTOFF | 05:36 |
| ianw | kevinz: ^ we need to figure out what's happening here :/ | 05:36 |
| AJaeger | ianw: https://review.opendev.org/#/c/752741/ remvoed nb03, didn't it? | 05:38 |
| AJaeger | Was that wrong? | 05:38 |
| AJaeger | clarkb: ^ | 05:39 |
| ianw | AJaeger: that was nb03.openstack.org, not opendev.org (I hope :) | 05:39 |
| AJaeger | ianw: Ah, good! Yeah, noticed the different domain now as well.. | 05:39 |
| ianw | but something shut the host down | 05:39 |
| ianw | hopefully i can catch kevinz at some point to see what logs might exist | 05:40 |
| AJaeger | understood | 05:40 |
| openstackgerrit | Carlos Goncalves proposed openstack/project-config master: CentOS 8 Stream initial deployment https://review.opendev.org/734791 | 05:50 |
| *** ysandeep|away is now known as ysandeep | 05:50 | |
| openstackgerrit | Ian Wienand proposed zuul/zuul-jobs master: [WIP] Revert "Disable broken fetch-sphinx-tarball test job" https://review.opendev.org/753199 | 05:52 |
| openstackgerrit | Carlos Goncalves proposed openstack/diskimage-builder master: Remove doc files and autoremove packages https://review.opendev.org/675546 | 05:55 |
| openstackgerrit | Merged zuul/zuul-jobs master: Disable broken fetch-sphinx-tarball test job https://review.opendev.org/752957 | 06:04 |
| *** ykarel has joined #opendev | 06:08 | |
| *** hamalq has quit IRC | 06:11 | |
| openstackgerrit | Merged zuul/zuul-jobs master: Add managed jobs to periodic-weekly https://review.opendev.org/748682 | 06:20 |
| *** qchris has quit IRC | 06:20 | |
| *** eolivare has joined #opendev | 06:27 | |
| *** diablo_rojo has quit IRC | 06:34 | |
| *** qchris has joined #opendev | 06:34 | |
| *** ykarel has quit IRC | 06:37 | |
| *** hashar has joined #opendev | 06:49 | |
| *** andrewbonney has joined #opendev | 06:53 | |
| *** slaweq has joined #opendev | 07:08 | |
| *** tosky has joined #opendev | 07:40 | |
| *** moppy has quit IRC | 08:01 | |
| *** moppy has joined #opendev | 08:02 | |
| *** kden has joined #opendev | 08:11 | |
| *** kden has quit IRC | 08:20 | |
| *** kden has joined #opendev | 08:20 | |
| *** priteau has joined #opendev | 08:23 | |
| *** priteau has quit IRC | 08:35 | |
| *** kden has quit IRC | 08:48 | |
| *** priteau has joined #opendev | 08:49 | |
| *** fressi has joined #opendev | 08:51 | |
| *** ysandeep is now known as ysandeep|lunch | 09:08 | |
| *** DSpider has joined #opendev | 09:17 | |
| openstackgerrit | Alfredo Moralejo proposed zuul/zuul-jobs master: Use Train repo to install openvswitch from multi-node-bridge in CentOS 8 https://review.opendev.org/752908 | 09:20 |
| *** fressi has quit IRC | 09:33 | |
| *** dtantsur has joined #opendev | 09:38 | |
| dtantsur | hi folks! some log pages timeout currently, try e.g. https://zuul.opendev.org/t/openstack/build/737556b9764e424884d60758050dae8c/log/controller/logs/devstacklog.txt. May be temporary, but I decided to let you know. | 09:39 |
| dtantsur | the underlying raw files download without issues | 09:39 |
| *** ysandeep|lunch is now known as ysandeep | 09:56 | |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python https://review.opendev.org/751611 | 09:58 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed zuul/zuul-jobs master: Add support to use stow for ensure-python https://review.opendev.org/751611 | 09:59 |
| *** hashar is now known as hasharAway | 10:08 | |
| *** owalsh has quit IRC | 10:15 | |
| openstackgerrit | zbr proposed zuul/zuul-jobs master: Update ensure-docker for new releases https://review.opendev.org/752630 | 10:27 |
| *** fressi has joined #opendev | 10:48 | |
| *** hasharAway is now known as hashar | 10:55 | |
| *** fressi has quit IRC | 11:02 | |
| *** priteau has quit IRC | 11:08 | |
| *** eolivare has quit IRC | 11:13 | |
| *** fressi has joined #opendev | 11:21 | |
| openstackgerrit | Pierre-Louis Bonicoli proposed zuul/zuul-jobs master: explicit error when test_command is undef https://review.opendev.org/751659 | 11:39 |
| *** owalsh has joined #opendev | 11:42 | |
| *** hashar has quit IRC | 11:43 | |
| *** owalsh has quit IRC | 11:49 | |
| frickler | dtantsur: that page works fine for me, might have been some temporary issue | 12:00 |
| *** ysandeep is now known as ysandeep|brb | 12:05 | |
| *** owalsh has joined #opendev | 12:07 | |
| *** fressi has quit IRC | 12:11 | |
| *** hashar has joined #opendev | 12:16 | |
| fungi | it would be interesting for the raw file to work but the cooked file to timeout... the latter is just javascript loading the raw file url and decorating it | 12:16 |
| *** ysandeep|brb is now known as ysandeep | 12:16 | |
| fungi | so the browser fetches the file content from the same place (cloud object storage) either way | 12:17 |
| *** jhesketh has quit IRC | 12:32 | |
| openstackgerrit | Merged opendev/puppet-openstackid master: Fixed typo ( extra =) https://review.opendev.org/753205 | 12:32 |
| *** fressi has joined #opendev | 12:46 | |
| *** fressi has joined #opendev | 12:48 | |
| *** jhesketh has joined #opendev | 13:19 | |
| *** fressi has quit IRC | 13:39 | |
| *** priteau has joined #opendev | 13:46 | |
| *** mlavalle has joined #opendev | 13:59 | |
| *** lpetrut has joined #opendev | 14:02 | |
| *** eolivare has joined #opendev | 14:24 | |
| *** ysandeep is now known as ysandeep|away | 14:27 | |
| *** hashar has quit IRC | 14:29 | |
| *** iurygregory has quit IRC | 14:46 | |
| *** iurygregory has joined #opendev | 14:51 | |
| *** lpetrut has quit IRC | 15:49 | |
| *** bhagyashri|rover has quit IRC | 16:08 | |
| *** bhagyashris has joined #opendev | 16:10 | |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Add noop jobs to os-loganalyze https://review.opendev.org/753398 | 16:14 |
| *** hamalq has joined #opendev | 16:16 | |
| *** redrobot has quit IRC | 16:25 | |
| *** johnsom has quit IRC | 16:26 | |
| *** johnsom has joined #opendev | 16:27 | |
| *** dtantsur is now known as dtantsur|afk | 16:34 | |
| *** mlavalle has quit IRC | 16:41 | |
| *** mlavalle has joined #opendev | 16:42 | |
| *** andrewbonney has quit IRC | 17:13 | |
| *** eolivare has quit IRC | 17:26 | |
| *** hamalq has quit IRC | 17:41 | |
| openstackgerrit | Adam Coldrick proposed opendev/storyboard master: Allow Project Groups to be filtered by project https://review.opendev.org/753417 | 17:52 |
| *** diablo_rojo has joined #opendev | 18:03 | |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Add noop jobs to os-loganalyze https://review.opendev.org/753398 | 18:35 |
| fungi | looks like i'm going to need to skip the meeting. we have a pet situation, headed to the vet's office now. i'll check back in later | 18:37 |
| fungi | clarkb: ^ | 18:37 |
| clarkb | fungi: no worries, hope thinsg go well | 18:40 |
| openstackgerrit | Clark Boylan proposed openstack/project-config master: Retire os-loganalyze https://review.opendev.org/753428 | 18:43 |
| *** hamalq has joined #opendev | 19:09 | |
| cgoncalves | hey folks! it looks like there's a mirror issue with linaro us. at least two builds fail with curl timing out with "Operation too slow" | 19:13 |
| cgoncalves | https://zuul.opendev.org/t/openstack/build/0b47cda88381452bad01dd226357530f/log/controller/logs/dib-build/amphora-x64-haproxy.qcow2_log.txt#2646 | 19:13 |
| *** priteau has quit IRC | 19:23 | |
| *** Tengu has quit IRC | 19:32 | |
| *** Tengu has joined #opendev | 19:33 | |
| openstackgerrit | Merged opendev/system-config master: launch-node: get sshfp entries from the host https://review.opendev.org/744821 | 19:39 |
| openstackgerrit | Merged opendev/system-config master: Wait for ipv6 addrs when launching nodes https://review.opendev.org/750049 | 19:39 |
| ianw | cgoncalves: let me see if the mirror is unhappy | 20:02 |
| ianw | [Tue Sep 22 19:55:00 2020] afs: Lost contact with volume location server 23.253.200.228 in cell openstack.org (code -1) | 20:03 |
| ianw | [Tue Sep 22 19:55:17 2020] afs: volume location server 23.253.200.228 in cell openstack.org is back up (code 0) | 20:03 |
| ianw | [Tue Sep 22 18:15:27 2020] afs: file server 104.130.138.161 in cell openstack.org is back up (code 105) (multi-homed address; other same-host interfaces may still be down) | 20:03 |
| ianw | [Tue Sep 22 18:15:55 2020] afs: Lost contact with file server 23.253.73.143 in cell openstack.org (code -1) (all multi-homed ip addresses down for the server) | 20:03 |
| ianw | sorry, that's right about the same time | 20:04 |
| ianw | i think we sort of know things aren't great | 20:04 |
| ianw | there's some hope that openafs 1.8 will give better performance | 20:04 |
| cgoncalves | ianw: thanks for checking! What can we do meanwhile? recheck? Any ETA for that openafs 1.8 update? | 20:07 |
| ianw | umm, no :) it requires redoing the servers | 20:08 |
| ianw | i would say recheck, i guess the more that is cached the less networking affects things | 20:08 |
| ianw | we also have some unresolved stability issues, but i haven't managed to catch kevinz yet | 20:09 |
| cgoncalves | Alright, thanks | 20:10 |
| *** tosky_ has joined #opendev | 21:09 | |
| *** tosky is now known as Guest33200 | 21:10 | |
| *** tosky_ is now known as tosky | 21:10 | |
| *** slaweq has quit IRC | 21:18 | |
| mnaser | infra-root: is it possible that the docker mirror is currently broken? | 21:39 |
| mnaser | all loci jobs are failing https://review.opendev.org/#/c/753424/ and we use teh deb-docker mirror | 21:39 |
| mnaser | with "apt cache update failed" | 21:39 |
| mnaser | more specifically http://mirror.bhs1.ovh.opendev.org/deb-docker/ | 21:40 |
| clarkb | mnaser: it was updated recently to fix the per distro release packaging of all the various docker things | 21:41 |
| clarkb | previously we were just mirroring something old iirc | 21:41 |
| clarkb | I wonder if that broke things | 21:41 |
| mnaser | oh, that's quite possible, i don't think loci uses ensure-docker role yet | 21:41 |
| mnaser | https://opendev.org/openstack/loci/src/branch/master/playbooks/setup-gate.yaml | 21:42 |
| clarkb | mnaser: ah then that is likely the issue | 21:42 |
| mnaser | i think that setup-gate playbook could use some refactoring | 21:42 |
| clarkb | mnaser: basically everything got pushed down a level under distro specific dirs so that we can actually mirror it properly | 21:42 |
| clarkb | mnaser: looking at https://zuul.opendev.org/t/openstack/build/114d1775eca04df8a2829526beb2f69d/console#1/0/22/ubuntu-bionic I think you want it to be something like "deb http://mirror.iad.rax.opendev.org/deb-docker/$release $release stable" ? | 21:43 |
| clarkb | mnaser: see https://review.opendev.org/#/c/746272/1/zuul.d/docker-images/base.yaml | 21:44 |
| mnaser | clarkb: if i'm playing with that i'll just flip it to use configure-swap and ensure-docker and call it a day :) i think that's the path ill go towards | 21:44 |
| clarkb | mnaser: ok I think you may need to set the url as in the change link above but it should do the rest from there | 21:45 |
| mnaser | i wonder if it makes sense for us to add `docker_mirror_base_url` to the site.yml | 21:45 |
| clarkb | mnaser: I think we don't because we don't mirror for rpm distros? | 21:46 |
| mnaser | ah, treu | 21:46 |
| clarkb | and with podman == docker on rhel8 and friends I'm not sure if that is a generally safe thing to do | 21:47 |
| mnaser | docker_mirror_base_url | 21:47 |
| mnaser | https://docs.ansible.com/ansible/latest/modules/include_role_module.html | 21:47 |
| mnaser | welp, that's unlucky | 21:47 |
| ianw | i'm getting Error Code: | 21:52 |
| ianw | invalid_grant | 21:52 |
| ianw | trying to log into storyboard | 21:52 |
| fungi | huh | 21:52 |
| fungi | checking | 21:52 |
| fungi | ianw: i'm able to log out and in with no problem. when's the last time you were able to successfully log in? | 21:54 |
| ianw | umm, some time in the past :) sorry i don't really know | 21:54 |
| fungi | just wondering if the issue is account-specific | 21:54 |
| ianw | hrm, well i closed the window and navigated directly to storyboard and now i can log in | 21:55 |
| fungi | that's an OAuthException subclass | 21:55 |
| ianw | previously i was following a link | 21:56 |
| fungi | we don't explicitly raise the InvalidGrant exception in the sb api as far as i can see, we just define it (presumably so that we can pass a unique error string for it when the oauth lib raises it) | 21:57 |
| ianw | it is a link to a item i actually probably don't have permissions to see; let me see if i can log out and replicate it | 21:57 |
| fungi | what was it a link to? | 21:57 |
| fungi | heh, ignore my last question ;) | 21:57 |
| fungi | and yeah, i was about to guess it could have been for a private story which hasn't been made visible to you | 21:58 |
| ianw | it seems repeatable. so if you are logged out, follow a link to a private story not made visible to you you get a 404 box, but then if you follow the login link you get to the InvalidGrant exception upon returning to storyboard from launchpad | 22:00 |
| *** mwhahaha has quit IRC | 22:04 | |
| *** gmann has quit IRC | 22:04 | |
| *** mwhahaha has joined #opendev | 22:04 | |
| *** seongsoocho has quit IRC | 22:04 | |
| *** aannuusshhkkaa has quit IRC | 22:04 | |
| *** seongsoocho has joined #opendev | 22:05 | |
| *** gmann has joined #opendev | 22:05 | |
| *** gouthamr has quit IRC | 22:06 | |
| *** aannuusshhkkaa has joined #opendev | 22:06 | |
| clarkb | I've approved the fedora-latest update change | 22:06 |
| *** mnaser has quit IRC | 22:06 | |
| fungi | ianw: that does sound like enough of a bug worth filing | 22:07 |
| fungi | though probably not a common issue for folks since they would need to try to access a resource they're not authorized for while not logged in | 22:07 |
| fungi | s/while/and while/ | 22:08 |
| clarkb | I'll keep an eye out for any unexpected issues related to that | 22:08 |
| *** mnaser has joined #opendev | 22:10 | |
| *** gouthamr has joined #opendev | 22:11 | |
| ianw | fungi: done https://storyboard.openstack.org/#!/story/2008184 :) | 22:12 |
| fungi | thanks! | 22:16 |
| openstackgerrit | Merged opendev/base-jobs master: Switch fedora-latest to version 32 https://review.opendev.org/752744 | 22:19 |
| *** tosky has quit IRC | 22:48 | |
| *** tkajinam has joined #opendev | 22:57 | |
| *** mlavalle has quit IRC | 22:57 | |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Update gitea project descriptions https://review.opendev.org/753464 | 23:16 |
| clarkb | corvus: ianw ^ fyi followup from the meeting | 23:17 |
| clarkb | oh it has a bug | 23:17 |
| fungi | oh, i did catch up on the meeting log, but i didn't really have anything to add other than the docs timeouts (which are hopefully solved now) | 23:18 |
| openstackgerrit | Clark Boylan proposed opendev/system-config master: Update gitea project descriptions https://review.opendev.org/753464 | 23:18 |
| clarkb | note that doesn't yet use the futures stuff | 23:19 |
| clarkb | I want to see it work serially (for simplicity) then add it into the thread pool | 23:19 |
| openstackgerrit | Merged zuul/zuul-jobs master: Use Train repo to install openvswitch from multi-node-bridge in CentOS 8 https://review.opendev.org/752908 | 23:44 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!