*** rlandy is now known as rlandy|out | 00:25 | |
*** yadnesh|away is now known as yadnesh | 04:10 | |
*** ysandeep|out is now known as ysandeep | 04:59 | |
*** ysandeep is now known as ysandeep|ruck | 04:59 | |
marios | o/ | 06:07 |
---|---|---|
ysandeep|ruck | marios, good morning o/ | 06:10 |
marios | \o | 06:11 |
*** yadnesh is now known as yadnesh|afk | 07:43 | |
*** amoralej|off is now known as amoralej | 07:59 | |
marios | ysandeep|ruck: o/ did you already post tests for that https://review.opendev.org/c/openstack/tripleo-quickstart/+/864690/6#message-0b153481a5b43c7ad6dfa9c052a9a55b5f5f60da (can we please check if we didn't already? like 1 master 1 zed job?) | 08:07 |
ysandeep|ruck | marios, hey o/ will check back shortly | 08:09 |
marios | ysandeep|ruck: thx | 08:12 |
ysandeep|ruck | marios: hey o/ Container build are busted for all the releases currently(which I am debugging currently), but I can trigger tests using last known good hash using above tq patch as depends-on, Reading https://bugs.launchpad.net/tripleo/+bug/1996482 looks like container-multinode was one of the affected job, Is it okay to trigger that as a test? | 08:28 |
marios | ysandeep|ruck: ah ok... well it can also wait i mean obv the container build issue you are debugging now has priority (and maybe testing with old hash isn't ideal anyway )( | 08:30 |
ysandeep|ruck | container-multinode job is already tested in check for both zed/master against the above tq patch, But I think you want to be sure that all okay with periodic ones too. | 08:30 |
marios | ysandeep|ruck: yea the issue was seen in periodic first (see bug description) so would be good to test before we unpin | 08:31 |
ysandeep|ruck | marios, ack, will rerun container-multinode periodic version for master/zed once container-build job is back. | 08:32 |
*** yadnesh|afk is now known as yadnesh | 08:34 | |
jm1 | o/ | 08:35 |
*** jpena|off is now known as jpena | 08:36 | |
marios | ysandeep|ruck: fyi https://review.rdoproject.org/r/c/testproject/+/46157 posted it there | 08:47 |
ysandeep|ruck | marios, thanks! It will fail currently due to missing containers | 08:48 |
marios | ysandeep|ruck: ok (standalones should do added comment there) we can recheck once you resolve that | 08:49 |
ysandeep|ruck | ack, sounds good | 08:49 |
marios | ysandeep|ruck: want to talk about container? Or rather let me know if you do | 08:50 |
ysandeep|ruck | marios, yes we can talk about container build, let me grab by earphones | 08:51 |
ysandeep|ruck | my* | 08:51 |
marios | 10:50 < marios> ysandeep|ruck: want to talk about container? Or rather let me know if you do | 08:52 |
marios | 10:51 < ysandeep|ruck> marios, yes we can talk about container build, let me grab by earphones | 08:52 |
marios | sry bad paste | 08:52 |
marios | https://meet.google.com/tak-gakg-eqr ysandeep|ruck | 08:53 |
frenzy_friday | jm1, hey. If we do not face the nginx issue anymore I am marking the nginx patch as dnm and moving it to abandoned later. Maybe it was a temporary issue? I didnt see it anywhere except our dev env | 09:05 |
jm1 | frenzy_friday: we still have issues with nginx, so maybe we both see different issues in our envs? | 09:06 |
jm1 | frenzy_friday: for example, if you open our staging env rrcockpit, then it will show you a default nginx page, not our grafana dashboards | 09:07 |
jm1 | frenzy_friday: so i am wondering what might be different between your instance and my staging env | 09:08 |
frenzy_friday | oh, so you are not getting any errors related to volume mount? Then you dont need this fix. /me Checking | 09:09 |
frenzy_friday | could you pls ping me the IP of the staging cockpit once again? | 09:10 |
frenzy_friday | jm1, I think you are faing this issue: https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/nginx.conf.local#L36 here it defines a specific servername (which is the domain name of the prod cockpit) So the requests to :80 on the server are not routed to 8080 by nginx because the servername does not match (or something like that) | 09:18 |
frenzy_friday | In the dev vm we changed https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/infra-setup/roles/rrcockpit/files/nginx.conf.local#L36 server_name <IP_of_dev_server> as a work around. Ideally We should maybe inject the domain name into the .conf file for each of the env. | 09:20 |
jm1 | frenzy_friday: ah right, server_name! so lets add default_server parameter to listen and then it should work. want to test it? | 09:24 |
jm1 | frenzy_friday: https://nginx.org/en/docs/http/ngx_http_core_module.html#listen | 09:24 |
* jm1 brb | 09:25 | |
frenzy_friday | like this: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46158 ? /me testing on the dev vm | 09:28 |
*** ysandeep|ruck is now known as ysandeep|ruck|lunch | 09:46 | |
jm1 | frenzy_friday: we need those server_name directives to be able to redirect users. default_server has to be added to the listen directive: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46159 | 09:57 |
frenzy_friday | jm1, ah, got it now! | 10:05 |
frenzy_friday | jm1, I did not get the todo part. Your patch looks complete to me. Adding default server and setting server name as a jinja variable it should be all we need, right? | 10:07 |
jm1 | frenzy_friday: i tried to address your question in the latest comment here: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46159 | 10:12 |
* pojadhav afk for half hour | 10:22 | |
*** pojadhav is now known as pojadhav|afk | 10:22 | |
marios | chandankumar: ysandeep|ruck|lunch: dviroel|out: bhagyashris: rlandy|out: please add to your review queue https://review.rdoproject.org/r/c/rdo-jobs/+/46119 | 10:23 |
*** ysandeep|ruck|lunch is now known as ysandeep|ruck | 10:26 | |
ysandeep|ruck | jm1 marios rlandy|out Is tool box accessible? | 10:39 |
jm1 | ysandeep|ruck: looks like no vm on vexxhost is accessible | 10:44 |
jm1 | ysandeep|ruck: all machines up, but cannot connect to them. no route to host | 10:46 |
marios | ysandeep|ruck: cant get onto promoter as jm1 said ^^^ didn't try toolbox but seems general issue | 10:47 |
* marios food biab | 10:47 | |
ysandeep|ruck | jm1, marios thanks for checking, I will report to vexx | 10:48 |
ysandeep|ruck | frenzy_friday, hey o/ Is tripleo-health-temp accessible, otherwise I will include that in my ticket as well | 10:55 |
frenzy_friday | ysandeep|ruck, nope, same with the health vm connect to host 38.102.83.141 port 22: No route to host | 10:57 |
ysandeep|ruck | frenzy_friday, ack thanks for checking | 10:57 |
*** gthiemon1e is now known as gthiemonge | 11:00 | |
* ysandeep|ruck filed a vexxhost ticket | 11:04 | |
*** rlandy|out is now known as rlandy|rover | 11:06 | |
rlandy|rover | ysandeep|ruck: hi ... | 11:08 |
rlandy|rover | can't access any vexx infra | 11:08 |
rlandy|rover | ysandeep|ruck: downstream works for me | 11:08 |
ysandeep|ruck | rlandy|rover, thanks! | 11:08 |
ysandeep|ruck | I have filed a vexx ticket | 11:08 |
rlandy|rover | ysandeep|ruck: I pinged guilhermesp on vexx - pls ping him with the ticket number | 11:09 |
rlandy|rover | ysandeep|ruck: have time to chat? | 11:10 |
ysandeep|ruck | rlandy|rover, I have already pinged the ticket number on #vexxhost | 11:10 |
ysandeep|ruck | rlandy|rover, sure | 11:10 |
rlandy|rover | https://meet.google.com/vkh-yhid-smp?pli=1&authuser=0 | 11:10 |
ysandeep|ruck | rlandy|rover, cat build.log | grep -i "Exit code: 1" | 11:22 |
*** dviroel|out is now known as dviroel | 11:23 | |
* dviroel o/ | 11:23 | |
ysandeep|ruck | marios, https://review.rdoproject.org/r/c/testproject/+/36859/6#message-25303029ca90e97de4b613e62867ca2bdda376e7 | 11:30 |
marios | ysandeep|ruck: thx | 11:30 |
*** pojadhav- is now known as pojadhav | 11:44 | |
ysandeep|ruck | rlandy|rover, https://be08be4bca8d9efed097-90b48a3106a793a661c7495bcec7bb56.ssl.cf2.rackcdn.com/periodic/opendev.org/openstack/tripleo-heat-templates/stable/zed/tripleo-ci-centos-9-content-provider/2250069/logs/container-builds/eec9cd34-ebfd-4135-b418-bdd9331afc9d/base/ovn-bgp-agent/ovn-bgp-agent-build.log | 11:45 |
ysandeep|ruck | https://c6e907431413b276a63b-23a7172f5dc1e58445390ec61883d218.ssl.cf2.rackcdn.com/864994/8/gate/tripleo-ci-centos-9-content-provider/9d99392/logs/container-builds/522fec05-8e3f-4cc7-8901-45f0ca049eed/base/os/horizon/horizon-build.log | 11:46 |
rlandy|rover | ysandeep|ruck: marios; ibm cloud node job kicked | 11:59 |
marios | thx rlandy|rover link/testproject? | 11:59 |
rlandy|rover | https://review.rdoproject.org/r/c/testproject/+/45359 | 11:59 |
marios | thanks | 11:59 |
*** ysandeep|ruck is now known as ysandeep|ruck|brb | 12:00 | |
rlandy|rover | marios: ysandeep|ruck: we didn;t raise anything to openstack-discuss yet, right? | 12:00 |
rlandy|rover | I can email out about that - intermittent gate failures | 12:00 |
rlandy|rover | done | 12:06 |
marios | rlandy|rover: ack | 12:07 |
*** dviroel_ is now known as dviroel | 12:12 | |
dviroel | chandankumar: around? | 12:12 |
*** ysandeep|ruck|brb is now known as ysandeep|ruck | 12:12 | |
pojadhav | dviroel, chandankumar is on PTO today | 12:12 |
pojadhav | dviroel, today and tomorrow | 12:13 |
rlandy|rover | dviroel: something I can help with? | 12:13 |
dviroel | pojadhav: ack, thanks | 12:14 |
dviroel | rlandy|rover: i was about to ask some help with ovb on bm3 | 12:14 |
dviroel | got a cert error | 12:15 |
dviroel | actually, cert not found, but i was expecting it there, since it follows the same tasks in ibm bm2 | 12:16 |
dviroel | rlandy|rover: i will continue to investigate | 12:17 |
rlandy|rover | dviroel: ok - if you are still having issues, we can look at it in the afternoon | 12:17 |
dviroel | rlandy|rover: ack, tks | 12:18 |
* bhagyashris stepping out for bit | 12:19 | |
rlandy|rover | ysandeep|ruck; scrum and CIX clash ... | 12:20 |
rlandy|rover | looking at CIX cards now | 12:20 |
rlandy|rover | ysandeep|ruck: can you comment on whether we should keep or close: https://trello.com/c/pWE18lEp/2787-cixlp1996874tripleociproa-buld-containers-quay-push-libselinux-python-arent-installed | 12:20 |
ysandeep|ruck | rlandy|rover, updated and moved to done | 12:21 |
rlandy|rover | ysandeep|ruck: thanks - I ma updating the card in triage | 12:22 |
rlandy|rover | ysandeep|ruck: pojadhav is going to be out - so I need to run scrum (until dasm|off is in). Pls will you cover CIX call - thank you | 12:27 |
ysandeep|ruck | rlandy|rover, sure | 12:29 |
rlandy|rover | frenzy_friday: hello ... can you update the cards for 9.1? | 12:35 |
rlandy|rover | on jira board | 12:35 |
rlandy|rover | bhagyashris: hi - pls ping when you are back | 12:36 |
rlandy|rover | ysandeep|ruck: since master is 6 days out, I am going to do a internal zuul run of fs064 from the hash we were chasing | 12:45 |
rlandy|rover | if it passes we can use that in criteria | 12:45 |
ysandeep|ruck | rlandy|rover: ack, also should I file a bug for fs064? | 12:48 |
rlandy|rover | ysandeep|ruck: I think we can rev=move auto-reverse | 12:48 |
rlandy|rover | I removed it for ds | 12:48 |
rlandy|rover | I'll have to test that out when vexxhost comes back | 12:49 |
rlandy|rover | right now, DNS is hard to debug | 12:49 |
ysandeep|ruck | yeah .. | 12:49 |
rlandy|rover | dviroel: can I borrow your yaml experise? | 12:54 |
dviroel | rlandy|rover: how can I help? | 12:56 |
rlandy|rover | dviroel: I need to use if /else yaml condition but have the result interpreted as a list - not string ... | 12:58 |
rlandy|rover | dviroel: not do this mess up again ... https://code.engineering.redhat.com/gerrit/c/tripleo-environments/+/435560 | 12:59 |
rlandy|rover | I can think of two options | 12:59 |
rlandy|rover | will adding [] work? | 12:59 |
rlandy|rover | ie: get that interpreted as a list? | 12:59 |
rlandy|rover | otherwise I can define the list in another var | 13:00 |
rlandy|rover | but that seems clunky | 13:00 |
* dviroel looking | 13:01 | |
marios | grumble... cant post to rdo/gerrit now ysandeep|ruck must still be upgrading | 13:04 |
marios | Please make sure you have the correct access rights | 13:04 |
marios | and the repository exists. | 13:04 |
marios | error: could not fetch gerrit | 13:04 |
* marios fetches coffee | 13:04 | |
rlandy|rover | marios: make it a large cup | 13:04 |
marios | ;) | 13:04 |
rlandy|rover | dviroel: looking into using | | 13:07 |
rlandy|rover | to retain spacing | 13:07 |
rlandy|rover | but that may still get interpreted as a string | 13:07 |
dviroel | rlandy|rover: freeipa_internal_ip is always a string? | 13:09 |
bhagyashris | rlandy|rover, hey i am back | 13:09 |
rlandy|rover | dviroel: yeah - one value | 13:09 |
ysandeep|ruck | marios, rlandy|rover fyi.. I am chatting with infra folks on #opendev to discuss upstream issue. | 13:09 |
rlandy|rover | bhagyashris: sec | 13:09 |
dviroel | rlandy|rover: maybe "|list" solves that, let me try here | 13:09 |
rlandy|rover | dviroel: hmmm ... interesting idea | 13:10 |
rlandy|rover | ysandeep|ruck: not to jinx it, but gate looks cleaner now | 13:10 |
*** amoralej is now known as amoralej|lunch | 13:10 | |
rlandy|rover | at least from content provider issues | 13:10 |
ysandeep|ruck | rlandy|rover, fungi is of opinion that we should use local resolver, Tengu was of same opinion as well. | 13:12 |
rlandy|rover | ysandeep|ruck: that makes sense | 13:12 |
bhagyashris | ack | 13:13 |
rlandy|rover | dviroel: going with other var w/o atm - but still need a resolution for this | 13:23 |
dviroel | rlandy|rover: ack, trying that locally in a test file | 13:24 |
rlandy|rover | thanks | 13:24 |
rlandy|rover | http://promoter.rdoproject.org/promoter_logs/centos9_wallaby.log | 13:29 |
rlandy|rover | promoter error | 13:29 |
rlandy|rover | The server encountered an internal error and was unable to complete your request. Either the server is overloaded or there is an error in the application. | 13:29 |
rlandy|rover | ysandeep|ruck: ^^ | 13:29 |
rlandy|rover | fyi | 13:30 |
rlandy|rover | bhagyashris: ^^ can you help put here? | 13:30 |
rlandy|rover | on the promoter now | 13:30 |
rlandy|rover | service restart? | 13:31 |
rlandy|rover | Exception while fetching promotions from API endpoint | 13:31 |
bhagyashris | rlandy|rover, ack | 13:32 |
rlandy|rover | idk - maybe looking for gerrit | 13:32 |
rlandy|rover | that is still down | 13:32 |
Tengu | ysandeep|ruck, rlandy|rover note that I'll come tomorrow in the CI meeting (time changed apparently) with some proposal for caching. | 13:32 |
Tengu | I've already pushed content to the agenda | 13:33 |
rlandy|rover | pojadhav: ^^ pls schedule Tengu's topic | 13:33 |
rlandy|rover | thanks | 13:33 |
rlandy|rover | ok | 13:33 |
Tengu | there's a handy solution with networkmanager + dnsmasq - unbound support in networkmanager is deprecated. | 13:33 |
Tengu | so basically, install one package, add 2 lines in the nm config, reload, and you're done. | 13:34 |
bhagyashris | looks like after restart promoter is working fine | 13:39 |
rlandy|rover | bhagyashris: yep - we're good now | 13:40 |
rlandy|rover | ysandeep|ruck: master line is rekicked | 13:41 |
rlandy|rover | let's see how that goes | 13:41 |
rlandy|rover | wallaby c8 is promoting now | 13:41 |
rlandy|rover | hopefull c9 goes after that | 13:41 |
rlandy|rover | I'll try fs064 master w/o auto-reverse | 13:42 |
ysandeep|ruck | Tengu, unbound support is deprecated - Oh that's a news for me | 13:43 |
Tengu | ysandeep|ruck: its direct from NetworkManager.conf manpage | 13:43 |
Tengu | ok. nm+dnsmasq: checked. Have to dig into squid+TLS | 13:44 |
rlandy|rover | akahat: arxcruz: bhagyashris: pojadhav: dasm|off: rcastillo: dviroel: marios: chandankumar: soniya: ysandeep|ruck: frenzy_friday: jm1: reminder: scrum in 4 mins | 13:56 |
soniya | rlandy|rover, ack | 13:57 |
ysandeep|ruck | Tengu, you are checking NetworkManager.conf on RHEL9/ latest fedora? I am on a RHEL9 machine and don't see any deprecation msg. | 13:58 |
*** amoralej|lunch is now known as amoralej | 13:58 | |
Tengu | ysandeep|ruck: manpage on cs9 | 13:59 |
Tengu | and latest fedora | 13:59 |
Tengu | not in the file itself | 13:59 |
ysandeep|ruck | yes `man NetworkManager.conf` | 14:00 |
Tengu | oh, fun. | 14:00 |
ysandeep|ruck | probably version difference | 14:00 |
ysandeep|ruck | $ NetworkManager --version | 14:00 |
ysandeep|ruck | 1.41.4-2.el9 | 14:00 |
Tengu | so. fc-35 mentions "deprecated" - cs9 doesn't even talk about unbound anymore | 14:01 |
marios | rdo gerrit back now btw | 14:01 |
ysandeep|ruck | Tengu, yes no mention of ubound in my version as well | 14:01 |
rlandy|rover | soniya: scrum time | 14:01 |
Tengu | (df checkpoint, sorry) | 14:02 |
jm1 | frenzy_friday: did you test this patch? i had no time yet 🙈 https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/46159 | 14:19 |
Tengu | pojadhav: I don't know how long my topic will take, but I expect to get some interesting discussions. | 14:24 |
Tengu | pojadhav: if there are other topics, we can maybe split mine, and do "dns" today, and "non-rpm content" tomorrow. | 14:25 |
Tengu | erro. next week | 14:25 |
frenzy_friday | jm1, commenting on the patch | 14:25 |
Tengu | ... s/today/tomorrow/ s/tomorrow/next week/ :) | 14:25 |
jm1 | frenzy_friday: ok cool :) | 14:26 |
frenzy_friday | jm1, added a long comment :D | 14:31 |
rlandy|rover | ysandeep|ruck: woohoo wallaby c9 is promoting | 14:31 |
ysandeep|ruck | rlandy|rover, wohoo and container build is looking faster this time on the master line | 14:31 |
rlandy|rover | ysandeep|ruck: wallaby c8 promoted | 14:32 |
rlandy|rover | train should as well | 14:32 |
rlandy|rover | running master fs064 | 14:32 |
rlandy|rover | ysandeep|ruck: rekicking zed when master container build completes | 14:33 |
jm1 | frenzy_friday: thanks for testing this out! actually it should work the other way around?!?! lets talk later, need a break now :D | 14:34 |
ysandeep|ruck | rlandy|rover, sounds good | 14:34 |
rlandy|rover | dasm|off: hello | 14:44 |
rlandy|rover | dasm|off: you're here? | 14:44 |
rlandy|rover | dasm|off: can you give https://trello.com/c/IryyjbGs/2344-cixlp1960355tripleociproa-tempest-tests-testoauth1tokensoauth1tokenstest-are-failing-on-tripleo-ci-centos-9-ovb-3ctlr1comp-featu a try now | 14:44 |
rlandy|rover | skip list revert | 14:44 |
marios | rlandy|rover: dasm|off: we spoke a bit about this on friday .... dasm fix should be available now in 'regular' stream repos see apevec last comment... just need to rebase the skiplist revert and retry the testproject | 14:48 |
*** dasm|off is now known as dasm | 14:48 | |
rlandy|rover | yep - what marios says | 14:48 |
jm1 | frenzy_friday: do you play with rhos_dev_stage_2 or is it free to be changed? | 14:48 |
dasm | rlandy|rover marios i can respin revert | 14:48 |
dasm | i'll give it a try in a bit | 14:49 |
rlandy|rover | dasm++ thanks for keeping that alive | 14:50 |
rlandy|rover | woohoo container build success | 14:58 |
rlandy|rover | marios: ysandeep|ruck: ^^ | 14:59 |
marios | great thx rlandy|rover | 14:59 |
rlandy|rover | rekciking zed | 14:59 |
dasm | marios: rlandy|rover fyi, OAUTHToken job: https://review.rdoproject.org/r/c/testproject/+/39955 | 15:00 |
ysandeep|ruck | rlandy|rover, other one is still running, 1.15 mtg already.. but lets seee | 15:00 |
ysandeep|ruck | mins* | 15:00 |
marios | dasm: thanks | 15:00 |
ysandeep|ruck | rlandy|rover, something just happened with zuul | 15:01 |
ysandeep|ruck | 503 service unavailable | 15:01 |
rlandy|rover | yep | 15:01 |
rlandy|rover | just saw that | 15:01 |
rlandy|rover | rekick bailed | 15:01 |
rlandy|rover | manager meeting time | 15:02 |
dasm | marios: i must've missed that during our Friday's conversation: https://review.opendev.org/c/openstack/tripleo-heat-templates/+/865052/1/zuul.d/layout.yaml#12 | 15:03 |
dasm | but yes, we need to have periodic as wel | 15:03 |
dasm | well | 15:04 |
marios | dasm: also undercloud-upgrade or will you do that in different patch? | 15:04 |
dasm | marios: i thought that what i did was everything :/ lemme check that one more time | 15:05 |
dasm | marios: probably i'm gonna add undercloud-upgrade to the patch i started work on | 15:05 |
marios | dasm: yeah need to add undercloud-upgrade here https://review.opendev.org/c/openstack/tripleo-ci/+/865050/1/zuul.d/upgrades-jobs-templates.yaml | 15:06 |
dasm | marios: similar to https://review.opendev.org/c/openstack/tripleo-ci/+/865050/1/zuul.d/upgrades-jobs-templates.yaml#57 i presume? | 15:06 |
ysandeep|ruck | rlandy|rover, hey o/ container build latest green run took 1hr 14 min | 15:09 |
ysandeep|ruck | https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-build-containers-ubi-9-quay-push-master&skip=0 | 15:09 |
ysandeep|ruck | earlier it was faster ~ 40 - 50 mins on average | 15:10 |
ysandeep|ruck | but lets monitor more runs for a day or two | 15:10 |
*** ysandeep|ruck is now known as ysandeep|ruck|dinner | 15:11 | |
rlandy|rover | ysandeep|ruck|dinner: ack - zed kicked now | 15:13 |
rlandy|rover | so we can see the results | 15:14 |
rlandy|rover | there | 15:14 |
* dviroel lunch | 15:14 | |
*** dviroel is now known as dviroel|lunch | 15:14 | |
*** yadnesh is now known as yadnesh|away | 15:18 | |
marios | dasm: yeah | 15:21 |
frenzy_friday | jm1, yeah you can change it. I am not using it | 15:26 |
rlandy|rover | jpodivin_: hello ... pls see gate failures on tripleo-validations - thank you | 15:30 |
jpodivin_ | rlandy|rover: ok, is there a bug filed? | 15:31 |
rlandy|rover | jpodivin_: not yet - I will if it's consistent | 15:32 |
jpodivin_ | rlandy|rover: do you have a link? | 15:34 |
jpodivin_ | to logs I mean | 15:34 |
*** jpodivin_ is now known as jpodivin | 15:34 | |
rlandy|rover | ah | 15:34 |
rlandy|rover | https://fd0004da6e060ff5fe10-49f052783357ad0fd943fff0bdadddcf.ssl.cf2.rackcdn.com/864854/4/gate/openstack-tox-docs/d2228c8/ | 15:34 |
rlandy|rover | https://zuul.opendev.org/t/openstack/build/30d347112d1e4dec895c4a4d6bcd0e52 | 15:35 |
jpodivin | rlandy|rover: thank you | 15:35 |
rlandy|rover | jpodivin; if it's a once off - np - just wanted to alert your team | 15:35 |
dasm | marios: ack. i'll update the initial patch | 15:35 |
jpodivin | rlandy|rover: this may have something to do with the node update to new ubuntu | 15:36 |
rlandy|rover | jpodivin: ok - want a LP bug for it? | 15:36 |
jpodivin | rlandy|rover: I'm goint to retry with one of my patches, this should happen in both check and gate if I'm right? | 15:37 |
jpodivin | and if so I'll file the bug | 15:37 |
rlandy|rover | yep | 15:38 |
rlandy|rover | it should | 15:38 |
rlandy|rover | we just don;t track all check job as closely as gate | 15:38 |
dasm | marios: fyi, i'm moving CI: Zed branching to done, but I added outstanding task for "upstream upgrade jobs" to OSP board. This way ours task is going to be closed, but the original one will stay active | 15:43 |
marios | dasm: but why are you moving CI:Zed brancing to done? why not use it to track the ugprades work as we currently have it? | 15:46 |
marios | dasm: oh other way around, you're closign the OSP one | 15:47 |
marios | dasm: k | 15:47 |
jpodivin | bug confirmed and filed https://bugs.launchpad.net/tripleo/+bug/1997256 | 15:47 |
marios | bhagyashris: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/435848 https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-config/+/435847 - what i mentioned earlier for cleanup please add to your review list? | 15:49 |
jpodivin | rlandy|rover: fix proposed, we'll see how it works in a minute | 15:49 |
rlandy|rover | jpodivin++ | 15:50 |
rlandy|rover | great | 15:50 |
dasm | marios: i closed TripleO-CI but kept OSP for our overloards for proper tracking | 15:54 |
marios | dasm: but why close our one then | 15:54 |
dasm | marios: i added missing upgrades task to osp board. | 15:54 |
dasm | similar to what dviroel|lunch did with podified task | 15:55 |
marios | dasm: ok i saw it | 15:55 |
marios | dasm: ack | 15:55 |
dasm | the task is still there, just under different umbrella | 15:55 |
dasm | s/overloards/overlords | 15:56 |
dasm | heh | 15:56 |
*** ysandeep|ruck|dinner is now known as ysandeep|ruck | 16:13 | |
ysandeep|ruck | rlandy|rover: I am out soon, We only had that container build and fs064 issue issue today | 16:16 |
*** dviroel|lunch is now known as dviroel | 16:18 | |
ysandeep|ruck | Looks like container build is still longer than usual | 16:19 |
ysandeep|ruck | https://review.rdoproject.org/zuul/stream/af5a8d9e0a3a44858ab6365cbde82817?logfile=console.log running for 1hr 18 min already | 16:20 |
ysandeep|ruck | I will check further on local dns resolver tomorrow, Need to do some reading about unbound, and more recent networkmanager + dnsmasq | 16:22 |
marios | :/ | 16:22 |
ysandeep|ruck | rlandy|rover, need anything before I leave? | 16:22 |
rlandy|rover | ysandeep|ruck: not really | 16:22 |
rlandy|rover | will follow promotions | 16:23 |
rlandy|rover | for master and zed | 16:23 |
rlandy|rover | will leave you notes | 16:23 |
ysandeep|ruck | thanks, see you tomorrow o/ | 16:23 |
rlandy|rover | see you then | 16:23 |
*** ysandeep|ruck is now known as ysandeep|out | 16:23 | |
marios | rlandy|rover: o/ need something before i go? | 16:50 |
*** marios is now known as marios|out | 16:57 | |
rlandy|rover | marios|out: shoudl be fine | 16:59 |
rlandy|rover | have a good night | 16:59 |
rlandy|rover | thanks | 16:59 |
marios|out | \o | 16:59 |
marios|out | https://www.theregister.com/2022/11/18/openstack_thriving_survey/ | 17:22 |
*** jpena is now known as jpena|off | 17:36 | |
*** amoralej is now known as amoralej|off | 18:01 | |
rlandy|rover | rcastillo: hi - you around? | 18:37 |
rlandy|rover | moved you 1-1 | 18:37 |
rlandy|rover | holiday here in USA on friday | 18:37 |
dviroel | rlandy|rover: hey, so now, bmc is hitting this error: https://logserver.rdoproject.org/46/46046/6/check/periodic-tripleo-ci-centos-8-ovb-3ctlr_1comp-featureset001-train-bm3/b485f34/logs/bmc_6_36697-console.log | 19:23 |
dviroel | rlandy|rover: don't know what it is yet | 19:23 |
* rlandy|rover looks | 19:23 | |
rlandy|rover | dviroel: let's chat | 19:30 |
rlandy|rover | dviroel: https://meet.google.com/amp-ewqb-wvb?pli=1&authuser=0 | 19:31 |
dviroel | rlandy|rover: one sec | 19:33 |
* jm1 out for today, have a nice evening UTC<0 folks :D | 20:45 | |
dasm | jm1[m]: o/ | 21:07 |
rlandy|rover | dviroel: any luck with ibm 3? | 21:15 |
dviroel | rlandy|rover: no, i was looking stack resources, private-network resource is ok | 21:32 |
rlandy|rover | dviroel: can you shh to the undercloud node | 21:33 |
rlandy|rover | ssh | 21:33 |
dviroel | rlandy|rover: i can hold a node and ssh to the instance, but I can't avoid stack deletion | 21:36 |
dviroel | or at least, I don't know how to avoid stack delete | 21:36 |
rlandy|rover | dviroel: getting | 21:37 |
rlandy|rover | dviroel: remove_ovb_after_job | 21:42 |
rlandy|rover | https://github.com/rdo-infra/review.rdoproject.org-config/blob/fe9f93c33596a1423571dbcba4a3ed4a6cf909ca/playbooks/tripleo-rdo-base/post-ovb-cleanup.yaml#L17 | 21:42 |
rlandy|rover | set that to false | 21:42 |
dviroel | rlandy|rover: ack, tks | 21:43 |
rlandy|rover | dviroel: clean up script might still get you | 21:43 |
rlandy|rover | if that runs on ibm cloud | 21:44 |
rlandy|rover | guessing not on node 3 yet | 21:44 |
dviroel | rlandy|rover: didn't merge yet - cleanup script updates | 21:44 |
* dasm => offline | 22:01 | |
dasm | take care Team! | 22:01 |
*** dasm is now known as dasm|off | 22:01 | |
rlandy|rover | good night | 22:03 |
*** rlandy|rover is now known as rlandy|rover|biab | 22:07 | |
dviroel | rlandy|rover|biab: FYI, we can set "remove_ovb_after_job" or hold the node, that will avoid stack deletion, but we can avoid stack deletion when we have a CREATE_FAILED stack | 22:11 |
dviroel | https://github.com/rdo-infra/review.rdoproject.org-config/blob/fe9f93c33596a1423571dbcba4a3ed4a6cf909ca/roles/ovb-manage/tasks/ovb-create-stack.yml#L151-L156 | 22:11 |
* dviroel going afk | 22:45 | |
*** dviroel is now known as dviroel|afk | 22:45 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!