| *** rlandy|rover|biab is now known as rlandy|rover | 00:33 | |
| *** rlandy|rover is now known as rlandy|out | 01:08 | |
| *** mkatari is now known as mkatari_ | 02:29 | |
| pojadhav | rlandy|out, Tengu, ack | 02:57 |
|---|---|---|
| *** yadnesh|away is now known as yadnesh | 04:03 | |
| *** ysandeep|out is now known as ysandeep | 04:49 | |
| *** ysandeep is now known as ysandeep|ruck | 04:49 | |
| *** pojadhav- is now known as pojadhav | 05:03 | |
| *** pojadhav- is now known as pojadhav | 05:57 | |
| marios | o/ | 06:05 |
| ysandeep | good morning o/ | 06:08 |
| ysandeep__ | folks o/ fyi.. my irc is bouncing today maybe network issue | 06:52 |
| *** ysandeep__ is now known as ysandeep|ruck | 06:53 | |
| marios | akahat: o/ morning let's catch up on the rdo decomission a bit this morning? | 06:59 |
| marios | akahat: sent invite please check inbox | 07:27 |
| marios | akahat: do you already have a patch for https://opendev.org/openstack/tripleo-quickstart/src/commit/0b7f925d24a4dcbc1957f1ccba7e01967c19bd87/config/release/tripleo-ci/CentOS-9/promotion-testing-hash-wallaby.yml#L7 ? | 07:42 |
| akahat | marios, o/ accepted invite. | 07:52 |
| * bhagyashris lunch | 07:53 | |
| marios | akahat: \o/ | 07:54 |
| marios | ysandeep|ruck: ack 08:52 < ysandeep__> folks o/ fyi.. my irc is bouncing today maybe network issue | 07:55 |
| * pojadhav is also facing issues to join internal redhat channels. | 07:56 | |
| * pojadhav lunch | 07:56 | |
| *** yadnesh is now known as yadnesh|afk | 08:20 | |
| *** jpena|off is now known as jpena | 08:22 | |
| *** amoralej|off is now known as amoralej | 08:26 | |
| akahat | marios, ceph containers are not in the quay.rdoproject.org, may be we need to add it https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/865241/comments/babdd5ca_b99f0d42 | 08:27 |
| akahat | and rhel too! | 08:28 |
| marios | akahat: no lets not add anything more to quay.rdoproject.org we are decommissioning that | 08:34 |
| marios | akahat: we can talk in a bit | 08:34 |
| akahat | quay.rdoproject.org ? | 08:35 |
| marios | ysandeep|ruck: fyi | 08:35 |
| marios | ysandeep|ruck: https://review.opendev.org/c/openstack/tripleo-quickstart/+/864690 | 08:35 |
| marios | ysandeep|ruck: going to merge https://review.opendev.org/c/openstack/tripleo-quickstart/+/864690/6#message-63d1318d8a6073cb30828500c5b6e425139caa97 | 08:36 |
| ysandeep|ruck | merge it, I already read your comment | 08:36 |
| marios | ysandeep|ruck: ack :) | 08:36 |
| ysandeep|ruck | :D | 08:36 |
| *** ysandeep|ruck is now known as ysandeep|ruck|brb | 08:37 | |
| *** yadnesh|afk is now known as yadnesh | 08:51 | |
| *** jpena is now known as jpena|off | 08:56 | |
| *** jpena|off is now known as jpena | 08:57 | |
| jm1 | o/ | 09:23 |
| *** ysandeep|ruck|brb is now known as ysandeep|ruck | 09:24 | |
| marios | rlandy|out: ysandeep: dviroel|afk: bhagyashris: please add to your reviews https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/435848 https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/435847 | 10:11 |
| bhagyashris | ack | 10:19 |
| jm1 | frenzy_friday: nginx patch works as expected, verified in staging env :) https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46159 | 10:28 |
| jm1 | frenzy_friday: incockpit now also works in staging env :D http://10.0.11.177/d/p2lXRDO4k/rhel9-rhos17-full-component-pipeline?orgId=1 | 10:29 |
| frenzy_friday | jm1, sorry one more comment on the patch :D (It loogs good to me and works, but still got a question :D) | 10:32 |
| jm1 | frenzy_friday: answered ;) | 10:34 |
| marios | rlandy|out: please add to your review list https://review.rdoproject.org/r/c/rdo-jobs/+/46119 (depends-on are ready but blocked until we are good to go with 46119) | 10:35 |
| frenzy_friday | jm1, thanks! | 10:35 |
| marios | food biab | 10:38 |
| *** ysandeep|ruck is now known as ysandeep|ruck|brb | 10:53 | |
| jpodivin | I've been thinking about the jammy update to our nodes. | 11:06 |
| jpodivin | How many of openstack projects are compatible with python 3.10 ? | 11:08 |
| jpodivin | Because that's on what the unit tests will run now. | 11:09 |
| *** ysandeep|ruck|brb is now known as ysandeep|ruck | 11:09 | |
| jpodivin | It's backwards compatible yes ... but won't we expose ourselves to unknowingly introducing new features into code base? | 11:11 |
| *** dviroel|afk is now known as dviroel | 11:20 | |
| *** rlandy|out is now known as rlandy|rover | 11:23 | |
| rlandy|rover | marios: hi - will look in a bit | 11:24 |
| rlandy|rover | ysandeep|ruck: hello - reviewing hackmd | 11:24 |
| frenzy_friday | marios, rlandy|rover, hey, good morning. Pls add to your review lists when you get some time: https://code.engineering.redhat.com/gerrit/c/openstack/sf-config/+/435898 (nodeset label 9.1) - I am not sure if this is correct | 11:25 |
| rlandy|rover | frenzy_friday; sure - will look after chat with security folks | 11:26 |
| frenzy_friday | thanks | 11:26 |
| rlandy|rover | ysandeep|ruck: may be worth promoting one master hash at this point | 11:28 |
| ysandeep|ruck | rlandy|rover, I already pinged on #sec-interops twice since morning:) | 11:28 |
| rlandy|rover | ysandeep|ruck: there was a hash from sunday where fs064 failed | 11:28 |
| rlandy|rover | we have seen that one pass since | 11:29 |
| rlandy|rover | maybe that is the best hash | 11:29 |
| rlandy|rover | I can't get fs039 past overcloud deploy | 11:29 |
| rlandy|rover | chandankumar: hi - welcome back | 11:29 |
| ysandeep|ruck | rlandy|rover, want to meet? | 11:30 |
| rlandy|rover | ysandeep|ruck: sure | 11:31 |
| ysandeep|ruck | meet.google.com/rip-zjhs-okd | 11:31 |
| ysandeep|ruck | rlandy|rover, ^^ | 11:32 |
| rlandy|rover | ysandeep|ruck: sec - just leaving ads the info he requested | 11:32 |
| ysandeep|ruck | sure | 11:32 |
| marios | will do frenzy_friday | 11:37 |
| *** dviroel_ is now known as dviroel | 11:38 | |
| jm1 | frenzy_friday: any idea who submitted this change? https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46047 | 11:47 |
| frenzy_friday | jm1, It was kkula. I am not surwe from which team but I can see the username on rhos-ops | 11:49 |
| frenzy_friday | They wanted to set up a puppets dashboard. This was another related patch: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45919 (probably because there was missing data) | 11:50 |
| jm1 | frenzy_friday: is he here on our chat? | 11:51 |
| frenzy_friday | nope | 11:51 |
| jm1 | frenzy_friday: she/he should better join :D | 11:52 |
| jm1 | marios, rlandy|rover, dasm|off: to be picked up in one of the next sprints https://issues.redhat.com/browse/TRIPLEOCI-1319 | 12:07 |
| marios | jm1: thanks | 12:08 |
| *** dviroel_ is now known as dviroel | 12:16 | |
| * akahat afk | 12:17 | |
| ysandeep|ruck | rlandy|rover, marios https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46167 fs064 skip for master promotion. | 12:21 |
| rlandy|rover | ysandeep|ruck: thanks - merging - wil revert | 12:25 |
| rlandy|rover | marios: https://review.rdoproject.org/r/c/rdo-jobs/+/46119 - left comment there | 12:27 |
| rlandy|rover | idk that we want to run one job a line in ibm cloud | 12:28 |
| rlandy|rover | rather keep the line together in vexx - just my $0.02 | 12:28 |
| jpodivin | rlandy|rover: I know it's not related to what you are dealing with atm. But I really feel like I need to ask about the Jammy situation. | 12:36 |
| marios | rlandy|rover: thanks I had a look and replied... not just one job all of those 8 jobs have ibmcloud nodeset i just carried what we currently do. we can update but is there an advantage to haveing it all on vexx? | 12:37 |
| jpodivin | for now it's fine when we are running unit tests and such on python3.10 but is it going to be fine in the future? | 12:37 |
| rlandy|rover | marios: ibm cloud 2 i sgoing away | 12:37 |
| marios | rlandy|rover: yup that's a reason ;) | 12:37 |
| marios | rlandy|rover: k lets update | 12:37 |
| rlandy|rover | marios: and 3 is not ready | 12:37 |
| rlandy|rover | so you don;t want to block you change on this | 12:37 |
| marios | so you mean we'll need new nodesets for the ibm3 cloud node? | 12:37 |
| rlandy|rover | besides it's easier for debug on one cloud | 12:37 |
| *** amoralej is now known as amoralej|lunch | 12:38 | |
| rlandy|rover | marios: yep - dviroel has them in patches | 12:38 |
| marios | rlandy|rover: otherwise that isn't an issue... but then i'm confused are you saying ultimately we can run them as is with ibmcloud nodeset for the 8 jobs? | 12:38 |
| rlandy|rover | but I would be against splitting lines | 12:38 |
| rlandy|rover | why not run on vexx? | 12:38 |
| marios | k | 12:38 |
| dviroel | rlandy|rover: marios: nodesets merged already | 12:38 |
| marios | well we started running in ibmcloud to ease the burden on vexx right and stability issues at the time (I guess this one isn't an issue any more?) | 12:38 |
| marios | rlandy|rover: but anyway for now will remove since it will be affected by ibm2 nodesets going away | 12:40 |
| rlandy|rover | marios: mostly the load | 12:40 |
| rlandy|rover | but one job is neither here nor there | 12:41 |
| marios | ysandeep: rlandy|rover: bhagyashris: dviroel: please revisit in your own time https://review.rdoproject.org/r/c/rdo-jobs/+/46119/5#message-5c6878cb894a89db0ad55886b5f86f6e71bbfab2 | 12:43 |
| dviroel | rlandy|rover: so, the issue with bmc node: | 12:50 |
| dviroel | [ 84.931437] os-net-config[7915]: [2022/11/22 12:45:09 PM] [ERROR] stdout: ERROR : [/etc/sysconfig/network-scripts/ifup-eth] Error, some other host (FA:16:3E:93:63:91) already uses address 10.0.1.234. | 12:50 |
| dviroel | another instance is getting the same ip, don't know why yet | 12:51 |
| rlandy|rover | dviroel: are there stray nodes left? | 12:51 |
| dviroel | no, from same stack creation, always | 12:52 |
| rlandy|rover | can you tell what host has that address? | 12:52 |
| arxcruz | hey guys, i'm not feeling well, i'll be a little bit away, i think i got flu from my daugther | 12:53 |
| ysandeep|ruck | arxcruz, take care! | 12:55 |
| rlandy|rover | arxcruz: feel better! | 12:55 |
| dviroel | rlandy|rover: in a previous run, was one of the overcloud nodes | 12:57 |
| dviroel | node 0 | 12:57 |
| rlandy|rover | is it always? | 12:58 |
| rlandy|rover | the only time we saw that error before was with nodes left over | 12:58 |
| rlandy|rover | not the same node in a stack getting the same ip | 12:59 |
| rlandy|rover | dpawlik: hi - you around? | 12:59 |
| ysandeep|ruck | rlandy|rover, I think dpawlik is on 2 weeks pto | 13:00 |
| rlandy|rover | dviroel: so those nodes are created in one shot by the stack | 13:01 |
| rlandy|rover | dviroel: can you share the logs? | 13:01 |
| rlandy|rover | marios: revoted - thanks for update | 13:04 |
| dviroel | rlandy|rover: http://pastebin.test.redhat.com/1082304 | 13:04 |
| ysandeep|ruck | marios, +wed | 13:04 |
| rlandy|rover | meeting - will look in a few | 13:04 |
| *** ysandeep|ruck is now known as ysandeep|ruck|afk | 13:07 | |
| marios | ysandeep|ruck|afk: thanks i'll go unblock the depends-on | 13:09 |
| marios | rlandy|rover: ysandeep|ruck|afk: please that first https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46148/1#message-766404b5b02ab9cacd78cd50f3a05ff8f5fc7f84 when you next have a minue NOT fire thanks | 13:10 |
| marios | bhagyashris: please sanity check? https://review.opendev.org/c/openstack/tripleo-quickstart/+/864726 | 13:11 |
| bhagyashris | marios, ack | 13:13 |
| rlandy|rover | ysandeep|ruck|afk: woohoo - zed should promote | 13:37 |
| jm1 | pojadhav, marios, rlandy|rover: i might be late for ci community call due to mtg conflict, but dasm|off has all the info as well | 13:49 |
| pojadhav | jm1, ack | 13:49 |
| rlandy|rover | jm1; Cedric is coming and we need to chat bout DNS | 13:51 |
| rlandy|rover | so that will happen first | 13:51 |
| jm1 | rlandy|rover: oh wow i just had a look at todays topics, thats a lot to discuss :D | 13:52 |
| *** ysandeep|ruck|afk is now known as ysandeep|ruck | 13:53 | |
| ysandeep|ruck | rlandy|rover, yeah looks like one of my rerun passed :) ipa-deploy failure seems intermittent | 13:53 |
| marios | jm1: ack | 13:54 |
| *** dasm|off is now known as dasm | 13:55 | |
| dasm | o/ | 13:55 |
| rlandy|rover | ysandeep|ruck: think we missed the fs064 hash | 13:55 |
| rlandy|rover | http://promoter.rdoproject.org/promoter_logs/centos9_master.log | 13:55 |
| rlandy|rover | missing jobs all include fs039 | 13:55 |
| ysandeep|ruck | don't we check last 50 hashes? | 13:56 |
| ysandeep|ruck | I find it hard to believe that the hash we are tracking is older than last 50 hashes | 13:57 |
| rlandy|rover | ysandeep|ruck: 16 hashes per agg hash | 13:58 |
| ysandeep|ruck | ohh, I thought we check last 50 agg hashes.. but looks like that is not the case | 13:59 |
| rlandy|rover | ysandeep|ruck: we can move it to 100 hashes | 13:59 |
| ysandeep|ruck | that seems reasonable considering the fact that master is 1 week behind now | 14:01 |
| marios | ysandeep|ruck: dviroel: you joining podified sync? | 14:01 |
| ysandeep|ruck | marios, yes i will | 14:01 |
| ysandeep|ruck | rlandy|rover, https://review.rdoproject.org/zuul/status#39420 | 14:06 |
| ysandeep|ruck | wallaby will promote soon, in tempest | 14:07 |
| ysandeep|ruck | rlandy|rover, what does it take to increase the promoter hashes to 100? | 14:07 |
| * ysandeep|ruck looking at promoter code | 14:07 | |
| rlandy|rover | ysandeep|ruck: it is 100 ... https://github.com/rdo-infra/ci-config/blob/0569d3ac182d583341ccca296f759ff817df839c/ci-scripts/dlrnapi_promoter/config_environments/rdo/CentOS-9/master.yaml#L13 | 14:08 |
| rlandy|rover | weird | 14:08 |
| rlandy|rover | http://promoter.rdoproject.org/promoter_logs/centos9_master.log | 14:09 |
| rlandy|rover | ysandeep|ruck: so we either revert the fs064 or accept fs039 | 14:09 |
| rlandy|rover | I am working on suppl node increase | 14:09 |
| ysandeep|ruck | Can we increase that number to 200? | 14:10 |
| ysandeep|ruck | or promote this particular hash manually | 14:11 |
| ysandeep|ruck | the hash we want https://trunk.rdoproject.org/centos9-master/tripleo-ci-testing/1d/8e/1d8e37b0de13dabf2789047ad17e4cea/ - just 4 days old | 14:11 |
| dasm | marios: o/ can we talk about upgrades/updates for zed? I see your comments wrt patches. I'm not sure what I'm missing there. | 14:16 |
| marios | dasm: in call right now... missing undercloud-upgrade job? | 14:19 |
| dasm | marios: we can type. this? https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/upgrades-jobs-templates.yaml#L57 | 14:22 |
| dasm | ok, i see it missing. i thought i added it here: https://review.opendev.org/c/openstack/tripleo-ci/+/865050/2/zuul.d/periodic.yaml | 14:23 |
| marios | dasm: yeah... we discussed 'minor update and undercloud-upgrade' your patch is adding the minor update | 14:23 |
| dasm | ok. 3rd time is a charm? | 14:23 |
| rlandy|rover | ysandeep|ruck: increase to 200 | 14:26 |
| rlandy|rover | rather than manual promo | 14:26 |
| rlandy|rover | I am working on ade's suggestion of a larger node | 14:26 |
| ysandeep|ruck | rlandy|rover, ack, let me push a patch. | 14:26 |
| ysandeep|ruck | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46172 is up | 14:29 |
| ysandeep|ruck | bhagyashris, ^^ fyi.. | 14:30 |
| bhagyashris | ack | 14:30 |
| ysandeep|ruck | bhagyashris, I hope its fine with promoter to increase latest_hashes_count temporarily from 100 to 200 | 14:30 |
| *** amoralej|lunch is now known as amoralej | 14:38 | |
| bhagyashris | ysandeep|ruck, hope so. but will need to revert once promotion will done | 14:40 |
| rcastillo | rlandy|rover: ack on the 1-1 resched | 14:41 |
| *** frenzy_friday is now known as frenzy_friday|doc | 14:43 | |
| ysandeep|ruck | rlandy|rover, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46172 is up and currently waiting for zuul | 14:45 |
| ysandeep|ruck | errr, rate limit again.. https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46172 | 14:45 |
| dasm | marios: i pushed an update. lmk if that's what you're looking for: https://review.opendev.org/c/openstack/tripleo-ci/+/865050 | 14:48 |
| marios | dasm: ack will revisit thanks | 14:49 |
| dasm | k, thx | 14:50 |
| pojadhav | Community call in 8 mins : arxcruz, rlandy|rover , marios, ysandeep|ruck , bhagyashris, svyas, soniya29, pojadhav, akahat, chandankumar, frenzy_friday, anbanerj, dviroel, rcastillo, dasm, jm1 | 14:52 |
| pojadhav | Please add your agenda if any : https://hackmd.io/MMg4WDbYSqOQUhU2Kj8zNg | 14:53 |
| ysandeep|ruck | rlandy|rover, community call | 15:01 |
| *** pojadhav is now known as pojadhav|afk | 15:32 | |
| Tengu | :) | 15:32 |
| ysandeep|ruck | Tengu++ thanks! | 15:32 |
| Tengu | ysandeep|ruck: fixing unbound/networkmanager: where would that take place? I'd say it should take place in the configure-unbound role directly, but in tripleo case, it's probably in tripleo-ci and/or oooq-extras? | 15:33 |
| Tengu | (though, imho, we should on the contrary go for dnsmasq instead, even if we "just" need to disable unbound.service, install dnsmasq, and configure networkmanager) | 15:33 |
| ysandeep|ruck | imho, Ideally I would say in configure-unbound role they should make sure they configure NM knows that it should not touch resolv.conf | 15:33 |
| Tengu | I'm surprised it's not done actually.. | 15:34 |
| Tengu | probably overlooked. | 15:34 |
| Tengu | hmmm.... where's that role defined actually? | 15:35 |
| ysandeep|ruck | Tengu, fetching | 15:35 |
| ysandeep|ruck | Tengu, https://opendev.org/opendev/base-jobs/src/branch/master/roles/configure-unbound/tasks/main.yaml#L2 | 15:35 |
| Tengu | https://opendev.org/opendev/base-jobs/src/branch/master/roles/configure-unbound/tasks ahh | 15:35 |
| Tengu | fun.... | 15:37 |
| Tengu | so the forwarders are actually passed over by zuul. | 15:37 |
| Tengu | roles/configure-unbound/README.rst:.. zuul:rolevar:: unbound_primary_nameserver_v4 | 15:37 |
| Tengu | and the defaults are... | 15:38 |
| Tengu | rlandy|rover: actually, unbound doesn't take the instance provider DNS as forwarder. | 15:38 |
| Tengu | it's taking, by default, googld and cloudflare. | 15:38 |
| Tengu | ysandeep|ruck: -^ | 15:38 |
| Tengu | so it's "wrong" imho. it should take the one configured by the DHCP server :). | 15:39 |
| Tengu | wasn't vexxhost creating issues with external DNS servers ? | 15:39 |
| ysandeep|ruck | Tengu, we only have unbound running on upstream images/jobs.. rdo images(vexx) don't have unbound installed | 15:41 |
| Tengu | ysandeep|ruck: hmm ok. I'm pretty sure I've seen issues related to that though. | 15:41 |
| ysandeep|ruck | but +1 that it should use instance provider DNS as forwarder | 15:42 |
| Tengu | ysandeep|ruck: so using instance provider DNS is... well, we can't get it just like that, if we're decoupling from networkmanager ^^ | 15:42 |
| Tengu | and this is why the configure-unbound role pushes google/cloudflare by default :). | 15:43 |
| Tengu | because it can't do otherwise. | 15:43 |
| Tengu | or, at least, not easily. | 15:43 |
| ysandeep|ruck | ahh, okay | 15:44 |
| Tengu | ~> this is why I'd really, really go the dnsmasq path directly. | 15:44 |
| Tengu | ysandeep|ruck: I can propose a quick oooq-extras + tripleo-ci patch for that if you want. | 15:44 |
| Tengu | just "an example" of how to handle it, while disabling unbound. | 15:45 |
| ysandeep|ruck | Tengu, thanks that will help | 15:45 |
| ysandeep|ruck | yes, we can disable unbound/ configure dnsmasq in tripleo-ci pre-playbooks level but ideally it should go in base/pre-playbooks and dib but we can do that as a follow-up. | 15:47 |
| * jm1 bbl | 15:50 | |
| Tengu | of course. | 15:50 |
| ysandeep|ruck | Tengu, Its getting late for me but we can talk tomorrow. We need something similiar to https://review.opendev.org/c/openstack/tripleo-ci/+/865290 and add that pre-playbook in pre-run | 15:50 |
| Tengu | ysandeep|ruck: sure - I'm going to the all-hand, and maybe will push a WIP against tripleo-ci | 15:51 |
| ysandeep|ruck | ack.. just use https://review.opendev.org/c/openstack/tripleo-ci/+/865290/3/zuul.d/layout.yaml#12 pre-run: instead of run: , I will also replace that soon after some tests | 15:52 |
| ysandeep|ruck | Tengu, thanks, I will catch up with you tomorrow's morning | 15:52 |
| Tengu | ++ | 15:52 |
| ysandeep|ruck | rlandy|rover, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46172 ci reports back, If you want to try increase latest_hashes_count to 200 | 15:53 |
| rlandy|rover | ysandeep|ruck: looking | 15:54 |
| rlandy|rover | let's try it | 15:54 |
| ysandeep|ruck | thanks! | 15:55 |
| rlandy|rover | Tengu: sorry - revolving meetings ... will read back in a few | 15:59 |
| Tengu | rlandy|rover: np - I'm also doing 10 things in // :) | 15:59 |
| ysandeep|ruck | folks o/ All hands mtg time if you are around. | 16:02 |
| Tengu | ysandeep|ruck: something like that? https://review.opendev.org/c/openstack/tripleo-ci/+/865305 | 16:04 |
| ysandeep|ruck | Tengu, yes that will do for a test | 16:05 |
| Tengu | :) | 16:05 |
| Tengu | took me.... 5 minutes | 16:05 |
| *** yadnesh is now known as yadnesh|away | 16:12 | |
| *** dviroel is now known as dviroel|lunch | 16:19 | |
| * dasm => afk, doc's appt | 16:23 | |
| dasm | rlandy|rover: dviroel|lunch rcastillo i might be offline during review meeting. | 16:23 |
| *** dasm is now known as dasm|off | 16:23 | |
| rlandy|rover | hmmm ... ysandeep|ruck: 200 hashes didn;t take | 16:38 |
| rlandy|rover | http://promoter.rdoproject.org/promoter_logs/centos9_master.log | 16:38 |
| ysandeep|ruck | rlandy|rover, I wonder if promoter have pulled the latest content before the above ^^ run for master | 16:39 |
| rlandy|rover | ysandeep|ruck: we can wait another 10 mins | 16:40 |
| rlandy|rover | to see if the merge happened in time | 16:40 |
| ysandeep|ruck | merged happened in time | 16:43 |
| ysandeep|ruck | -rw-r--r--. 1 promoter promoter 3434 Nov 22 16:17 master.yaml | 16:43 |
| Tengu | rlandy|rover: do you want to track the dnsmasq thing in some launchpad or other means? | 16:43 |
| ysandeep|ruck | http://promoter.rdoproject.org/promoter_logs/centos9_master.log - 2022-11-22 16:35:04,846 717250 INFO promoter Validation Successful | 16:43 |
| ysandeep|ruck | looks like master.yaml was changed 18 mins before promoter kicked for master | 16:44 |
| rlandy|rover | Tengu: maybe JIRA card? | 16:52 |
| rlandy|rover | depending on how much work it is | 16:52 |
| Tengu | rlandy|rover: maybe? though it's "upstream"... as for work, the patch I proposed may do the trick - at least partially. | 16:52 |
| ysandeep|ruck | rlandy|rover, latest run also didn't take the increase in hash in account | 16:53 |
| ysandeep|ruck | http://promoter.rdoproject.org/promoter_logs/centos9_master.log | 16:53 |
| Tengu | rlandy|rover: I'll sync tomorrow with ysandeep|ruck - we should get a clearer vision of the task. | 16:53 |
| rlandy|rover | Tengu: ysandeep|ruck: sounds good | 16:53 |
| rlandy|rover | let's scope it tomorrow | 16:53 |
| rlandy|rover | ysandeep|ruck: alternative is to accept fs039 failure | 16:54 |
| rlandy|rover | which maybe a bigger problem | 16:54 |
| ysandeep|ruck | I have proposed reverts: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45892 and https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45891 | 16:54 |
| ysandeep|ruck | revert 45892 goes first | 16:54 |
| rlandy|rover | ysandeep|ruck: I have the test patch running with the increased extra node | 16:55 |
| rlandy|rover | there is a hash missing fs039 and fs064 | 16:55 |
| ysandeep|ruck | yes if ^^ works, we probably wont need the skips | 16:56 |
| rlandy|rover | idk if it will fix the overcloud deployment failure | 16:56 |
| ysandeep|ruck | rlandy|rover, we don't run fs039 in internal? | 16:57 |
| rlandy|rover | didn't merge that yet | 16:57 |
| rlandy|rover | I can try it | 16:57 |
| ysandeep|ruck | I suspect the deployment failures are just vexx resource crunch issues | 16:58 |
| ysandeep|ruck | so internal pass would be great | 16:58 |
| rlandy|rover | kicking | 16:59 |
| ysandeep|ruck | Tengu, https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_ba0/865290/5/check/tripleo-ci-centos-9-content-provider/ba02d9d/job-output.txt | 16:59 |
| *** marios is now known as marios|out | 17:00 | |
| *** dviroel|lunch is now known as dviroel | 17:00 | |
| ysandeep|ruck | unbound works with my test | 17:00 |
| dviroel | dasm|off 0 x 0 rcastillo | 17:00 |
| ysandeep|ruck | first dif take 20ms , second take 0ms - https://review.opendev.org/c/openstack/tripleo-ci/+/865290/5/playbooks/tripleo-ci/test.yml#48 | 17:00 |
| ysandeep|ruck | dig* | 17:00 |
| Tengu | ysandeep|ruck: 'k - though it will use google + cloudflare servers | 17:01 |
| Tengu | fun - my job is stuck at "configure-swap: Copy old /opt" task. | 17:01 |
| Tengu | not sure what it's supposed to do at this point. | 17:01 |
| ysandeep|ruck | yes.. but if it caches it won't have to go to google + cloudflare servers everytime | 17:01 |
| ysandeep|ruck | Tengu, yes my job stuck on that task too for long.. didn't get chance to look what causing the delay | 17:02 |
| Tengu | ysandeep|ruck: it's more about resources that may be only on the provider's DNS | 17:02 |
| Tengu | trying to find where's that task defined. | 17:02 |
| ysandeep|ruck | rlandy|rover, I am out now.. please merge the reverts when you get a chance: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45892 and https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/45891 | 17:03 |
| rlandy|rover | will do | 17:03 |
| Tengu | ysandeep|ruck: see you tomorrow! | 17:03 |
| * Tengu is out as well | 17:03 | |
| Tengu | I'll check my dnsmasq switch tomorrow. | 17:03 |
| ysandeep|ruck | rlandy|rover, Tengu see you tomorrow o/ | 17:04 |
| rlandy|rover | have a goo dnight | 17:04 |
| *** ysandeep|ruck is now known as ysandeep|out | 17:04 | |
| rlandy|rover | lunch - brb | 17:07 |
| *** jpena is now known as jpena|off | 17:33 | |
| *** frenzy_friday|doc is now known as frenzy_friday | 17:36 | |
| *** amoralej is now known as amoralej|off | 18:08 | |
| * dviroel coffee | 19:31 | |
| * jm1 out for today | 20:10 | |
| *** dasm|off is now known as dasm | 20:31 | |
| dasm | dviroel: ? | 20:31 |
| dviroel | dasm: poland 0 x 0 mexico | 20:32 |
| dviroel | :) | 20:32 |
| dasm | ah. i'm not into football :) | 20:33 |
| dviroel | i know :) | 20:33 |
| dasm | :) | 20:35 |
| * dviroel going afk | 20:37 | |
| *** dviroel is now known as dviroel|afk | 20:37 | |
| dasm | dviroel|afk: o/ | 20:38 |
| rlandy|rover | lol | 21:13 |
| * dasm => offline | 22:25 | |
| dasm | o/ | 22:25 |
| *** dasm is now known as dasm|off | 22:25 | |
| *** rlandy|rover is now known as rlandy|out | 23:09 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!