*** zzzeek has quit IRC | 00:16 | |
*** zzzeek has joined #openstack-infra | 00:17 | |
*** hamalq has quit IRC | 00:26 | |
*** yamamoto has quit IRC | 00:38 | |
*** yamamoto has joined #openstack-infra | 00:39 | |
*** yamamoto has quit IRC | 00:44 | |
*** yamamoto has joined #openstack-infra | 00:44 | |
*** Goneri has quit IRC | 01:03 | |
*** yamamoto has quit IRC | 01:08 | |
*** yamamoto has joined #openstack-infra | 01:45 | |
*** yamamoto has quit IRC | 01:57 | |
*** stevebaker has quit IRC | 02:18 | |
*** stevebaker has joined #openstack-infra | 02:45 | |
*** gyee has quit IRC | 02:57 | |
*** yamamoto has joined #openstack-infra | 03:08 | |
*** tkajinam has quit IRC | 03:10 | |
*** stevebaker has quit IRC | 03:21 | |
*** lamt has quit IRC | 03:22 | |
*** arne_wiebalck has quit IRC | 03:22 | |
*** arne_wiebalck has joined #openstack-infra | 03:23 | |
*** yonglihe has quit IRC | 03:23 | |
*** yonglihe has joined #openstack-infra | 03:25 | |
*** yamamoto has quit IRC | 03:35 | |
*** psachin has joined #openstack-infra | 03:36 | |
*** psachin has joined #openstack-infra | 03:37 | |
*** rcernin has quit IRC | 03:48 | |
*** rcernin has joined #openstack-infra | 03:53 | |
*** yamamoto has joined #openstack-infra | 04:13 | |
*** sean-k-mooney has quit IRC | 04:16 | |
*** sean-k-mooney has joined #openstack-infra | 04:16 | |
*** stevebaker has joined #openstack-infra | 04:21 | |
*** ykarel has joined #openstack-infra | 04:24 | |
*** jamesdenton has quit IRC | 05:23 | |
*** jamesdenton has joined #openstack-infra | 05:24 | |
*** matt_kosut has joined #openstack-infra | 05:26 | |
*** evrardjp has quit IRC | 05:33 | |
*** evrardjp has joined #openstack-infra | 05:33 | |
*** openstackgerrit has quit IRC | 05:46 | |
*** ricolin_ has joined #openstack-infra | 05:56 | |
*** ricolin_ has quit IRC | 05:58 | |
*** ricolin has joined #openstack-infra | 05:59 | |
*** ysandeep|away is now known as ysandeep|ruck | 06:08 | |
*** dklyle has quit IRC | 06:32 | |
*** lmiccini has joined #openstack-infra | 06:45 | |
*** tkajinam has joined #openstack-infra | 06:53 | |
*** yamamoto has quit IRC | 06:59 | |
*** sshnaidm|afk is now known as sshnaidm|rover | 07:00 | |
*** eolivare has joined #openstack-infra | 07:22 | |
*** rcernin has quit IRC | 07:30 | |
*** sboyron has joined #openstack-infra | 07:30 | |
*** yamamoto has joined #openstack-infra | 07:39 | |
*** ykarel has quit IRC | 07:44 | |
*** ralonsoh has joined #openstack-infra | 07:45 | |
*** ykarel has joined #openstack-infra | 07:45 | |
*** rpittau|afk is now known as rpittau | 07:51 | |
*** yamamoto has quit IRC | 07:53 | |
*** rcernin has joined #openstack-infra | 07:53 | |
*** slaweq has joined #openstack-infra | 08:00 | |
*** jcapitao has joined #openstack-infra | 08:02 | |
*** lmiccini has quit IRC | 08:03 | |
*** hberaud has joined #openstack-infra | 08:07 | |
*** andrewbonney has joined #openstack-infra | 08:10 | |
*** lpetrut has joined #openstack-infra | 08:11 | |
*** rcernin has quit IRC | 08:15 | |
*** lmiccini has joined #openstack-infra | 08:17 | |
*** yolanda has joined #openstack-infra | 08:19 | |
*** ociuhandu has joined #openstack-infra | 08:38 | |
*** hashar has joined #openstack-infra | 08:42 | |
*** ociuhandu has quit IRC | 08:48 | |
*** ykarel_ has joined #openstack-infra | 08:49 | |
*** ykarel has quit IRC | 08:52 | |
*** jpena|off is now known as jpena | 08:54 | |
*** tosky has joined #openstack-infra | 08:57 | |
*** rchanter has joined #openstack-infra | 08:58 | |
*** ysandeep|ruck is now known as ysandeep|lunch | 09:00 | |
*** krah has quit IRC | 09:04 | |
*** yamamoto has joined #openstack-infra | 09:07 | |
*** lucasagomes has joined #openstack-infra | 09:12 | |
*** ociuhandu has joined #openstack-infra | 09:21 | |
*** openstack has quit IRC | 09:21 | |
*** openstack has joined #openstack-infra | 09:22 | |
*** ChanServ sets mode: +o openstack | 09:22 | |
*** yamamoto has quit IRC | 09:23 | |
*** gfidente has joined #openstack-infra | 09:24 | |
*** logan- has quit IRC | 09:27 | |
*** logan- has joined #openstack-infra | 09:27 | |
*** lajoskatona has joined #openstack-infra | 09:28 | |
lajoskatona | Hi, I need some help regarding networking-l2gw, which was recently moved to x/networking-l2gw | 09:29 |
---|---|---|
lajoskatona | The pypi owner is still openstackci, is there a way to change that? | 09:30 |
*** rcernin has joined #openstack-infra | 09:36 | |
AJaeger | lajoskatona: openstackci needs to be one owner so that we can push to it when you tag a release. | 09:39 |
AJaeger | lajoskatona: for what do you need access? | 09:39 |
lajoskatona | AJaeger: I added a tag (17.0.0) to x/networking-l2gw, but my assumption was that it has no affect for projects in x/ | 09:42 |
lajoskatona | AJaeger: I mean no automatic push will happen | 09:42 |
*** yamamoto has joined #openstack-infra | 09:43 | |
AJaeger | lajoskatona: the push will happen if you configured it correctly | 09:45 |
AJaeger | let me check... | 09:45 |
*** ysandeep|lunch is now known as ysandeep|ruck | 09:45 | |
lajoskatona | AJaeger: thanks | 09:45 |
AJaeger | publish-to-pypi should be part of your job setup - but is not. Send a patch for project-config to add it. | 09:46 |
AJaeger | lajoskatona: one that is in, push 17.0.1 and have it appear automatically on pypi | 09:48 |
*** rchanter has quit IRC | 09:50 | |
*** ykarel_ is now known as ykarel | 09:51 | |
lajoskatona | AJaeger: Add to https://opendev.org/openstack/project-config/src/branch/master/zuul.d/projects.yaml as I see, am I right< | 09:53 |
lajoskatona | ? | 09:53 |
AJaeger | lajoskatona: yes! | 09:54 |
lajoskatona | AJaeger: thanks | 09:54 |
*** rcernin has quit IRC | 09:56 | |
*** yamamoto has quit IRC | 09:58 | |
*** openstackgerrit has joined #openstack-infra | 09:59 | |
openstackgerrit | Lajos Katona proposed openstack/project-config master: Add publish-to-pypi template to networking-l2gw https://review.opendev.org/760096 | 09:59 |
AJaeger | lajoskatona: only publish-to-pypi, not the other template | 10:01 |
AJaeger | You have already openstack-python3-victoria-jobs-neutron in repo and don't need that | 10:01 |
openstackgerrit | Lajos Katona proposed openstack/project-config master: Add publish-to-pypi template to networking-l2gw https://review.opendev.org/760096 | 10:03 |
lajoskatona | AJaeger: ok, I updated | 10:05 |
*** yamamoto has joined #openstack-infra | 10:09 | |
*** yamamoto has quit IRC | 10:09 | |
*** psachin has quit IRC | 10:18 | |
*** psachin has joined #openstack-infra | 10:27 | |
*** ysandeep|ruck is now known as ysandeep|brb | 10:31 | |
AJaeger | LGTM now. config-core, please review ^ | 10:36 |
*** psachin has quit IRC | 10:45 | |
*** psachin has joined #openstack-infra | 10:47 | |
*** psachin has quit IRC | 10:49 | |
*** psachin has joined #openstack-infra | 10:50 | |
*** slaweq has quit IRC | 10:51 | |
*** ysandeep|brb is now known as ysandeep|ruck | 10:54 | |
*** slaweq has joined #openstack-infra | 10:55 | |
*** rcernin has joined #openstack-infra | 11:16 | |
*** lpetrut has quit IRC | 11:25 | |
*** lpetrut has joined #openstack-infra | 11:26 | |
*** lpetrut has quit IRC | 11:26 | |
*** lpetrut has joined #openstack-infra | 11:27 | |
*** another_larsks has joined #openstack-infra | 11:29 | |
*** larsks has quit IRC | 11:31 | |
*** yamamoto has joined #openstack-infra | 11:31 | |
*** jcapitao is now known as jcapitao_lunch | 11:31 | |
* kmarc is away: "Auto-away" | 11:38 | |
*** dmellado has quit IRC | 11:38 | |
*** dmellado has joined #openstack-infra | 11:39 | |
*** ykarel has quit IRC | 11:47 | |
*** ykarel has joined #openstack-infra | 11:49 | |
*** zzzeek has quit IRC | 11:49 | |
*** zzzeek has joined #openstack-infra | 11:52 | |
*** yamamoto has quit IRC | 11:56 | |
* kmarc is back (gone 00:28:21) | 12:06 | |
*** rlandy has joined #openstack-infra | 12:07 | |
* kmarc is away: "Auto-away" | 12:16 | |
*** ykarel_ has joined #openstack-infra | 12:16 | |
*** eolivare has quit IRC | 12:21 | |
*** jpena is now known as jpena|lunch | 12:25 | |
*** jcapitao_lunch is now known as jcapitao | 12:27 | |
*** yamamoto has joined #openstack-infra | 12:31 | |
*** rfolco has joined #openstack-infra | 12:34 | |
*** lajoskatona has left #openstack-infra | 12:38 | |
frickler | kmarc: could you please disable your auto-away stuff for all openstack channels? | 12:40 |
* kmarc sorry, checking... | 12:43 | |
*** rcernin has quit IRC | 12:43 | |
kmarc | frickler: disabled | 12:45 |
*** yamamoto has quit IRC | 12:47 | |
*** hashar has quit IRC | 12:50 | |
*** hashar has joined #openstack-infra | 12:56 | |
frickler | kmarc: thanks | 13:00 |
openstackgerrit | Merged openstack/project-config master: Use internal address for RAX ORD https://review.opendev.org/759972 | 13:10 |
*** thiago__ has quit IRC | 13:12 | |
*** tdasilva_ has joined #openstack-infra | 13:13 | |
*** tdasilva_ has quit IRC | 13:14 | |
*** tdasilva has joined #openstack-infra | 13:14 | |
openstackgerrit | Merged openstack/project-config master: Add publish-to-pypi template to networking-l2gw https://review.opendev.org/760096 | 13:17 |
*** lmiccini has quit IRC | 13:18 | |
*** eolivare has joined #openstack-infra | 13:24 | |
*** sshnaidm|rover has quit IRC | 13:25 | |
*** jpena|lunch is now known as jpena | 13:27 | |
*** ykarel_ has quit IRC | 13:31 | |
*** sshnaidm|rover has joined #openstack-infra | 13:39 | |
*** psachin has quit IRC | 13:40 | |
*** sshnaidm|rover is now known as sshnaidm|mtg | 13:44 | |
*** lmiccini has joined #openstack-infra | 14:02 | |
*** d34dh0r53 has quit IRC | 14:07 | |
*** d34dh0r53 has joined #openstack-infra | 14:11 | |
*** thiagop has joined #openstack-infra | 14:20 | |
*** dklyle has joined #openstack-infra | 14:24 | |
openstackgerrit | Thierry Carrez proposed openstack/ptgbot master: No longer display location https://review.opendev.org/760151 | 14:33 |
*** yamamoto has joined #openstack-infra | 14:47 | |
*** Goneri has joined #openstack-infra | 14:48 | |
*** Goneri has quit IRC | 14:52 | |
*** psachin has joined #openstack-infra | 14:54 | |
*** dklyle has quit IRC | 14:58 | |
openstackgerrit | Merged openstack/ptgbot master: No longer display location https://review.opendev.org/760151 | 15:01 |
*** hberaud has quit IRC | 15:02 | |
*** yamamoto has quit IRC | 15:06 | |
*** ykarel is now known as ykarel|away | 15:07 | |
*** dklyle has joined #openstack-infra | 15:08 | |
*** lpetrut has quit IRC | 15:19 | |
*** gyee has joined #openstack-infra | 15:24 | |
*** ykarel|away has quit IRC | 15:41 | |
*** hberaud has joined #openstack-infra | 15:45 | |
*** takamatsu has quit IRC | 15:45 | |
*** tdasilva_ has joined #openstack-infra | 15:46 | |
*** hberaud has quit IRC | 15:47 | |
*** hberaud has joined #openstack-infra | 15:47 | |
*** tdasilva has quit IRC | 15:49 | |
*** takamatsu has joined #openstack-infra | 15:56 | |
*** sauloasilva1 has joined #openstack-infra | 16:05 | |
*** sauloasilva1 has quit IRC | 16:05 | |
*** sauloasilva1 has joined #openstack-infra | 16:06 | |
*** chandankumar is now known as raukadah | 16:23 | |
*** ysandeep|ruck is now known as ysandeep|away | 16:29 | |
dtantsur | seeing plenty of retry limits because of mirror resolution problems. is it known/temporary? | 16:31 |
dtantsur | Could not resolve 'mirror.ord-int.rax.opendev.org' | 16:32 |
dtantsur | example: https://d777cc90efd99de28a0e-63e0619ac9734be8bebe39a119169a2b.ssl.cf2.rackcdn.com/744434/23/check/bifrost-integration-redfish-uefi-ubuntu-focal/fbfd63e/job-output.txt | 16:32 |
clarkb | that isnt a known issue but a bug in our deployment if using the internal IP | 16:33 |
frickler | na, that's a bug | 16:33 |
clarkb | should be mirror-int.ord.rax.opendev.org I think | 16:33 |
*** lmiccini has quit IRC | 16:33 | |
clarkb | frickler: do you know if there is a fix for that yet? | 16:33 |
frickler | clarkb: there is no fix, I'll put something up | 16:33 |
clarkb | thanks | 16:33 |
openstackgerrit | Jens Harbott (frickler) proposed openstack/project-config master: Fix the internal rax mirror name https://review.opendev.org/760183 | 16:36 |
frickler | infra-root: ^^ I'm off now, feel free to amend if it turns out I did something wrong. maybe someone wants to deploy this before it merges, too | 16:38 |
clarkb | hrm digging that name doesn't return a record either | 16:40 |
clarkb | fungi: any idea what the record is? | 16:40 |
*** lucasagomes has quit IRC | 16:41 | |
clarkb | frickler: fungi if I lookup the names against ns1 and ns2 they resolve. However, the cname points to the public ip not private ip which https://review.opendev.org/#/c/759974/ should've fixed | 16:44 |
clarkb | it seems we're still having problems syncing the zone/ | 16:45 |
fungi | mirror-int.ord.rax.opendev.org is an alias for mirror01-int.ord.rax.opendev.org. | 16:45 |
fungi | mirror01-int.ord.rax.opendev.org has address 10.209.128.57 | 16:45 |
fungi | that looks right to me | 16:45 |
fungi | result of running `host mirror-int.ord.rax.opendev.org` | 16:45 |
clarkb | ugh ya I'm tired I dug the public name and it gave me the public ip back :/ | 16:46 |
clarkb | still not sure why it isn't resolving against my local dns though | 16:47 |
clarkb | oh I wonder if I'm filtering 10 net addresses | 16:47 |
clarkb | that would be the most amazingly awesome self fail win if so | 16:47 |
fungi | granted that's going to take a few minutes to land and roll out... should we manually turn down rax-ord for a bit? | 16:48 |
clarkb | wfm if you want to do that | 16:49 |
*** hamalq has joined #openstack-infra | 16:51 | |
fungi | just did | 16:52 |
fungi | do i need to reload nodepool after editing the config or will it reread it? i want to say it rereads between operations | 16:52 |
clarkb | it rereads it between passes thorugh its operating loop | 16:52 |
fungi | i also temporarily put nl01 in the emergency disable list | 16:53 |
openstackgerrit | Merged openstack/project-config master: Fix the internal rax mirror name https://review.opendev.org/760183 | 16:55 |
clarkb | there is another issue with the ord mirror. We haven't managed to issue a new cert with the new alt name | 16:55 |
AJaeger | clarkb: didn't https://review.opendev.org/#/c/759971/ issued the new certs? | 16:56 |
fungi | it raced on dns replication seemed like | 16:56 |
clarkb | ya it failed and we think https://review.opendev.org/#/c/759988/ is the fix | 16:56 |
clarkb | I thin kwe may need to rerun the LE playbook and it will correct itself? | 16:56 |
fungi | and i guess it doesn't get retried unless the cert is at risk of expiring | 16:56 |
AJaeger | clarkb, fungi, please double check https://review.opendev.org/#/c/759971/1/inventory/service/host_vars/mirror01.ord.rax.opendev.org.yaml - I think there's an error in it | 16:57 |
clarkb | oh ya lets land a fix for that then it should go through normal processing | 16:58 |
clarkb | we want mirror-int.org there not a duplicate | 16:58 |
clarkb | I'll write that change | 16:58 |
fungi | also we were already down inap-mtl01, so we're going to be struggling on capacity with our largest rax region out too. anybody have bandwidth to try to run down the disconnects in inap, or just want to turn it back on and hope for the best? | 16:59 |
clarkb | I don't think there is much we can do to debug that on our side, iirc we've seen that before in inap and its a neutron problem with arp fights | 17:01 |
clarkb | we can turn it on and hope that neutron is happier there now and if it isn't something something dogfooding | 17:01 |
fungi | yeah, was more wondering if anybody had logstash queries we could use to determine if the problem was recurring, but i guess with the current state of the logstash cluster that's probably not going to get us timely feedback | 17:02 |
clarkb | we could restart everything on the logstash side then we'd get data until it degraded | 17:02 |
clarkb | which may be good enough for that particular use case | 17:03 |
*** ociuhandu has quit IRC | 17:03 | |
fungi | to find it last time i basically had to pull up inventories for builds i saw in retry_limit state to determine where they ran | 17:03 |
fungi | and it seemed to be 100% inap based on a sample of ~10 failed builds | 17:03 |
fungi | but it was hardly scientific | 17:04 |
*** yamamoto has joined #openstack-infra | 17:05 | |
*** rpittau is now known as rpittau|afk | 17:09 | |
*** dtantsur is now known as dtantsur|afk | 17:10 | |
openstackgerrit | Matthias Runge proposed openstack/project-config master: Create telemetry group and include https://review.opendev.org/760190 | 17:16 |
*** tosky has quit IRC | 17:20 | |
*** yamamoto has quit IRC | 17:22 | |
*** eolivare has quit IRC | 17:25 | |
*** jcapitao has quit IRC | 17:31 | |
*** hberaud has quit IRC | 17:43 | |
*** sshnaidm|mtg is now known as sshnaidm|rover | 17:46 | |
*** ykarel|away has joined #openstack-infra | 17:47 | |
*** thiagop has quit IRC | 17:47 | |
*** thiagop has joined #openstack-infra | 17:50 | |
*** andrewbonney has quit IRC | 17:57 | |
*** ykarel|away has quit IRC | 17:59 | |
*** ralonsoh has quit IRC | 18:00 | |
*** jamesmcarthur has joined #openstack-infra | 18:01 | |
*** jpena is now known as jpena|off | 18:05 | |
*** psachin has quit IRC | 18:22 | |
*** hashar has quit IRC | 18:28 | |
*** jamesmcarthur has quit IRC | 18:29 | |
*** gfidente is now known as gfidente|afk | 18:31 | |
*** psyton has quit IRC | 18:47 | |
openstackgerrit | Matthias Runge proposed openstack/project-config master: Create telemetry group and include https://review.opendev.org/760190 | 18:52 |
*** sshnaidm_ has joined #openstack-infra | 18:57 | |
*** sshnaidm|rover has quit IRC | 19:00 | |
*** sshnaidm_ is now known as sshnaidm|rover | 19:06 | |
*** kwazar has quit IRC | 19:17 | |
*** ianychoi__ has joined #openstack-infra | 19:17 | |
*** mtreinish has quit IRC | 19:19 | |
*** mtreinish has joined #openstack-infra | 19:20 | |
*** ianychoi_ has quit IRC | 19:21 | |
*** yamamoto has joined #openstack-infra | 19:22 | |
*** sshnaidm|rover is now known as sshnaidm|afk | 19:28 | |
*** mtreinish has quit IRC | 19:29 | |
*** mtreinish has joined #openstack-infra | 19:29 | |
*** hashar has joined #openstack-infra | 19:39 | |
*** jamesmcarthur has joined #openstack-infra | 19:40 | |
*** hberaud has joined #openstack-infra | 19:46 | |
*** yamamoto has quit IRC | 19:46 | |
openstackgerrit | Jeremy Stanley proposed openstack/project-config master: Revert "Temporarily stop booting nodes in inap-mtl01" https://review.opendev.org/760220 | 19:55 |
*** vesper has quit IRC | 20:02 | |
openstackgerrit | Donny Davis proposed openstack/project-config master: Disable OE, edge router is about to buy the farm https://review.opendev.org/760227 | 20:12 |
*** vesper11 has joined #openstack-infra | 20:21 | |
*** piotrowskim has quit IRC | 20:23 | |
*** yolanda has quit IRC | 20:24 | |
*** yolanda has joined #openstack-infra | 20:25 | |
*** vesper has joined #openstack-infra | 20:27 | |
*** another_larsks is now known as larsks | 20:27 | |
*** vesper11 has quit IRC | 20:30 | |
*** tosky has joined #openstack-infra | 20:39 | |
*** vesper11 has joined #openstack-infra | 20:48 | |
*** vesper has quit IRC | 20:48 | |
openstackgerrit | Merged openstack/project-config master: Disable OE, edge router is about to buy the farm https://review.opendev.org/760227 | 20:56 |
*** gfidente|afk is now known as gfidente | 21:04 | |
*** rfolco has quit IRC | 21:06 | |
*** jamesmcarthur has quit IRC | 21:26 | |
*** yamamoto has joined #openstack-infra | 21:44 | |
*** slaweq has quit IRC | 21:48 | |
*** rfolco has joined #openstack-infra | 21:57 | |
*** dansmith has quit IRC | 21:59 | |
*** rm_work has quit IRC | 21:59 | |
*** jrosser has quit IRC | 21:59 | |
*** zaro has quit IRC | 21:59 | |
*** zer0c00l has quit IRC | 21:59 | |
*** zer0c00l has joined #openstack-infra | 21:59 | |
*** rm_work has joined #openstack-infra | 21:59 | |
*** jrosser has joined #openstack-infra | 21:59 | |
*** zaro has joined #openstack-infra | 21:59 | |
*** dansmith has joined #openstack-infra | 21:59 | |
*** yamamoto has quit IRC | 22:01 | |
*** rfolco has quit IRC | 22:03 | |
*** slaweq has joined #openstack-infra | 22:04 | |
*** dychen has joined #openstack-infra | 22:04 | |
*** dchen has quit IRC | 22:06 | |
*** slaweq has quit IRC | 22:14 | |
*** matt_kosut has quit IRC | 22:14 | |
*** yamamoto has joined #openstack-infra | 22:14 | |
*** matt_kosut has joined #openstack-infra | 22:14 | |
*** matt_kosut has quit IRC | 22:19 | |
*** hberaud has quit IRC | 22:26 | |
*** rfolco has joined #openstack-infra | 22:30 | |
*** rlandy is now known as rlandy|bbl | 22:33 | |
*** rfolco has quit IRC | 22:35 | |
*** rcernin has joined #openstack-infra | 22:46 | |
*** gfidente has quit IRC | 22:48 | |
*** thiagop has quit IRC | 22:59 | |
*** ociuhandu has joined #openstack-infra | 23:05 | |
*** ociuhandu has quit IRC | 23:09 | |
*** sboyron has quit IRC | 23:10 | |
*** hashar has quit IRC | 23:28 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!