| *** rlandy|bbl is now known as rlandy | 01:33 | |
| rlandy | jm1[m]: akahat:pls check hackmd - and work with fmount to get the following merged: | 01:39 |
|---|---|---|
| rlandy | https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/846231 | 01:39 |
| rlandy | https://review.opendev.org/q/I137e335abeedccad801cdc03feee654c3e42a0e2 | 01:40 |
| *** rlandy is now known as rlandy|out | 01:40 | |
| *** ysandeep|out is now known as ysandeep | 01:59 | |
| ysandeep | Good morning team o/ | 01:59 |
| *** undefined_ is now known as Guest3112 | 04:09 | |
| *** akahat is now known as akahat|ruck | 04:39 | |
| chandankumar | ysandeep: good morning \o | 04:56 |
| akahat|ruck | chandankumar, ysandeep o/ | 05:19 |
| akahat|ruck | chandankumar, ysandeep could you please vote on this: | 05:19 |
| akahat|ruck | <frenzyfriday|PTO> yeah :D just came back to check the promoter patch | 05:19 |
| akahat|ruck | https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43708 | 05:19 |
| akahat|ruck | this ^^ | 05:19 |
| akahat|ruck | so i can start promoter again. | 05:19 |
| * ysandeep looking | 05:26 | |
| ysandeep | akahat|ruck: +wed | 05:28 |
| akahat|ruck | ysandeep, thanks! | 05:29 |
| ysandeep | akahat|ruck, jm1[m] fyi.. new bug https://bugs.launchpad.net/tripleo/+bug/1979707 , Rabi have already proposed a fix. | 05:33 |
| ysandeep | feel free to add promotion-blocker flag incase this is blocking check/gate | 05:33 |
| akahat|ruck | ysandeep, ack | 05:34 |
| *** undefined_ is now known as Guest3115 | 05:51 | |
| akahat|ruck | chandankumar, ysandeep ping about registry: quay registry is compatible to work with docker-py? | 06:34 |
| chandankumar | akahat|ruck: donot know, never tried that | 06:34 |
| akahat|ruck | I'm trying to login to registry using docker-py but it's throwing error. | 06:35 |
| ysandeep | akahat|ruck, I don't have idea about that. | 06:35 |
| chandankumar | akahat|ruck: what is the error? | 06:35 |
| akahat|ruck | It is the case for the registry login.. docker is not able to connect quay.. | 06:35 |
| akahat|ruck | promoter blocker | 06:35 |
| akahat|ruck | chandankumar, docker.errors.APIError: 500 Server Error for http+docker://localhost/v1.41/auth: Internal Server Error ("Get "https://quay.rdoproject.org/v2/": unauthorized: Could not find robot with specified username") | 06:36 |
| akahat|ruck | it always taking /v2/ | 06:36 |
| ysandeep | marios, fyi.. replied to your query here: https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/403826/18..20#message-dd72d77b589f23c8b85b188b34dc3ad4acfc36b0 | 06:37 |
| akahat|ruck | registry are getting logged in using docker login but not using docker-py | 06:37 |
| ysandeep | bhagyashris, could you please check https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/403826/18..20#message-21c9393813564cccf515a731e9e8a88f44044dd3 | 06:37 |
| chandankumar | akahat|ruck: "https://index.{{ registry_host }}/v1/" | 06:39 |
| bhagyashris | ysandeep, yup checking | 06:39 |
| chandankumar | akahat|ruck: check the container-push.yml playbook? | 06:39 |
| chandankumar | akahat|ruck: can you change it from v2 to v1 | 06:41 |
| akahat|ruck | chandankumar, tried.. but not working.. | 06:44 |
| marios | o/ ysandeep thanks will check | 06:48 |
| marios | ysandeep: ack thanks ok then | 06:48 |
| *** arxcruz|rover is now known as arxcruz | 06:55 | |
| *** jm1|ruck is now known as jm1|rover | 06:56 | |
| jm1 | good morning, ci :) | 06:58 |
| jm1 | akahat|ruck: what is going on with ci? what should i have a look at? 👀 | 06:58 |
| akahat|ruck | jm1, o/ morning.. will have call in few mins.. chasing with promoter.. | 06:59 |
| akahat|ruck | jm1, meanwhile can you take look at downstream? | 07:00 |
| jm1 | akahat|ruck: never worked on downstream before 🙈 let me google that.. | 07:01 |
| jm1 | btw nice rr doc | 07:02 |
| *** amoralej|off is now known as amoralej | 07:03 | |
| *** jpena|off is now known as jpena | 07:06 | |
| *** ysandeep is now known as ysandeep|afk | 07:11 | |
| akahat|ruck | jm1, https://meet.google.com/ius-qipc-odj | 07:47 |
| akahat|ruck | jm1, joning? | 07:48 |
| jm1 | akahat|ruck: yep | 07:49 |
| amoralej | chandankumar, how is the issue with redis? | 07:50 |
| amoralej | still failing? | 07:50 |
| akahat|ruck | jm1, https://hackmd.io/9hv3vTNlST2rw014LSDqcg | 07:51 |
| chandankumar | amoralej: we workaroud by downgrading pacemake and resourceagent https://review.opendev.org/c/openstack/tripleo-common/+/846287 | 07:53 |
| amoralej | it's still failing in rdo jobs | 07:53 |
| amoralej | lemme check why | 07:53 |
| chandankumar | ok | 07:55 |
| chandankumar | jm1: akahat|ruck's place has power cut right now, so he might went offline | 08:05 |
| chandankumar | he just informed me | 08:05 |
| jm1 | chandankumar: thanks for the heads up! are power cuts usual in india? | 08:06 |
| chandankumar | jm1: nope | 08:06 |
| chandankumar | jm1: sometimes bad weather and hot summer might cause it | 08:07 |
| jm1 | chandankumar: was just wondering because it is not the first time that happens while we are in a call ^^ | 08:07 |
| chandankumar | it depends on place to place, each places have different infrastructure and backup situations | 08:08 |
| jm1 | chandankumar: you have backups? (we dont, causing a blackout for several days last year 🙈) | 08:11 |
| chandankumar | jm1: I have backups which will run for a 1 day or 2 | 08:11 |
| jm1 | chandankumar: wow ok | 08:12 |
| chandankumar | sometimes infra issues or coal shortage brought power cut across india and also seen in neighbouring countries | 08:12 |
| chandankumar | Now i think it is fixed | 08:12 |
| amoralej | chandankumar, i see new builds in repos so the downgrade is installing the bad version? | 08:50 |
| amoralej | haven't you seen that in your jobs? | 08:50 |
| *** ysandeep|afk is now known as ysandeep | 09:00 | |
| ysandeep | marios, just to confirm have we left deprecated-jobs.yaml on purpose? https://review.opendev.org/c/openstack/tripleo-ci/+/847241/1#message-b338e0f6909c98417495c74561500ba4cbe7f28e | 09:02 |
| ysandeep | I wonder when zuul will remove declaring queue at pipeline level.. will it complain because we didn't update deprecated-jobs.yaml | 09:03 |
| marios | ysandeep: looking | 09:07 |
| marios | ysandeep: thanks replied... its a good point but i think its fine to leave it those templates more likely need removing altogether | 09:11 |
| marios | ysandeep: there should not be any zuul explosions or other complaints ;) according to the mails about it it would mean jobs aren't run in the layouts that use the queue in the 'old' way | 09:11 |
| ysandeep | marios: ack | 09:16 |
| jm1 | reviewbot: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43714 | 09:16 |
| jm1 | akahat|ruck: still no power? 😳 | 10:16 |
| akahat|ruck | jm1, hey.. | 10:17 |
| akahat|ruck | i'm back a while ago. | 10:17 |
| akahat|ruck | chasing some wired issues on promoter. | 10:17 |
| jm1 | akahat|ruck: ah, thought we had something to discuss?! anyway, rr doc is updated | 10:18 |
| jm1 | akahat|ruck: went through all bugs and checked whether they are still open or not. havent added new bugs yet | 10:19 |
| akahat|ruck | jm1, okay.. | 10:19 |
| *** rlandy|out is now known as rlandy | 10:21 | |
| rlandy | akahat|ruck: jm1: hello | 10:22 |
| akahat|ruck | rlandy, hello | 10:22 |
| rlandy | akahat|ruck; jm1|rover:let's sync | 10:22 |
| akahat|ruck | rlandy, okay | 10:22 |
| rlandy | https://meet.google.com/ots-qfcp-uzf?pli=1&authuser=0 | 10:23 |
| chandankumar | amoralej: checking | 10:30 |
| ysandeep | akahat|ruck, jm1 many jobs in post failure: https://zuul.opendev.org/t/openstack/builds?result=POST_FAILURE&skip=0 | 10:38 |
| ysandeep | jm1|rover, ^^ | 10:38 |
| ysandeep | you have so many nicks :) | 10:38 |
| akahat|ruck | ysandeep, yes. saw that.. but it do not shows th elogs | 10:38 |
| akahat|ruck | the logs * | 10:38 |
| jm1|rover | ysandeep: just choose whatever nick you want ^^ | 10:39 |
| chandankumar | amoralej: you are correct, now it is installing pacemaker.x86_64 2.1.4-1.el9 @quickstart-centos-highavailability and resource agent version have not got changed | 10:41 |
| ysandeep | akahat|ruck, ack.. looks like noonedeadpunk was taking about that issue on #opendev few mins back. | 10:41 |
| chandankumar | amoralej: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_d75/847329/2/check/tripleo-ci-centos-9-scenario001-standalone/d75fb7c/logs/undercloud/var/log/extra/podman/containers/redis-bundle-podman-0/podman_info.log | 10:42 |
| amoralej | chandankumar, so jobs are not failing? | 10:43 |
| chandankumar | amoralej: for wallaby it is failing | 10:43 |
| amoralej | mmm and why not in master? | 10:43 |
| chandankumar | amoralej: since resource-agent version does not got changed https://review.opendev.org/c/openstack/tripleo-common/+/847437 | 10:43 |
| amoralej | no, i don't understand | 10:44 |
| amoralej | mmm | 10:44 |
| amoralej | what i'm hitting in rdo | 10:44 |
| amoralej | is that | 10:44 |
| chandankumar | and it is downgraded in master so master is working fine | 10:44 |
| amoralej | jobs keep failing with downgrade | 10:44 |
| amoralej | that's what i see in my env | 10:44 |
| chandankumar | and for wallaby https://review.opendev.org/c/openstack/tripleo-common/+/847437 downgrade patch is not merged that's why it is failing | 10:45 |
| chandankumar | amoralej: https://bugs.launchpad.net/tripleo/+bug/1978997/comments/10 | 10:46 |
| amoralej | chandankumar, https://logserver.rdoproject.org/73/42273/10/check/rdoinfo-tripleo-master-testing-centos-9-scenario001-standalone/f96bad2/logs/ | 10:46 |
| amoralej | that's from yesterday, with the downgrade | 10:46 |
| amoralej | yes i get that | 10:47 |
| amoralej | https://logserver.rdoproject.org/73/42273/10/check/rdoinfo-tripleo-master-testing-centos-9-scenario001-standalone/f96bad2/logs/undercloud/home/zuul/container-builds/302ade5d-3634-4635-987c-a03ff94a7a5d/base/redis/redis-build.log.txt.gz | 10:47 |
| amoralej | see the downgrade there installed the bad versions | 10:48 |
| amoralej | pacemaker x86_64 2.1.3-2.el9 | 10:48 |
| amoralej | as there is a more recent one | 10:48 |
| amoralej | pacemaker-2.1.4-1.el9.x86_64 | 10:49 |
| amoralej | i'm not sure why you are not hitting that | 10:49 |
| chandankumar | let me check the logs from periodic line also to confirm | 10:50 |
| chandankumar | amoralej: reason we are not seeing it in periodic line https://review.rdoproject.org/zuul/builds?job_name=periodic-tripleo-ci-centos-9-scenario001-standalone-master&project=openstack/tripleo-ci - sc01 is busted already due to ceph failure https://review.opendev.org/c/openstack/tripleo-ansible/+/847323 | 10:54 |
| chandankumar | it has not reached to standalone deployment | 10:54 |
| amoralej | and in check pipeline with provider jobs? | 10:54 |
| amoralej | you rebuild the redis container, right? | 10:54 |
| amoralej | or use redis from last promoted? | 10:55 |
| chandankumar | amoralej: https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-scenario001-standalone&branch=master&skip=0 | 10:56 |
| chandankumar | amoralej: we rebuild the redis container | 10:57 |
| amoralej | let me check there | 10:57 |
| amoralej | thanks | 10:57 |
| chandankumar | one of the passing job from today https://b82ba900a06c8c7cbdc7-ff1e6572e024e404a82f69f5d976dc9d.ssl.cf5.rackcdn.com/846231/10/gate/tripleo-ci-centos-9-scenario001-standalone/a5dcf51/logs/undercloud/var/log/extra/podman/containers/redis-bundle-podman-0/podman_info.log | 10:58 |
| chandankumar | pacemaker.x86_64 2.1.2-4.el9 @quickstart-centos-highavailability | 10:58 |
| chandankumar | pacemaker-cli.x86_64 2.1.2-4.el9 @quickstart-centos-highavailability | 10:58 |
| chandankumar | pacemaker-cluster-libs.x86_64 2.1.2-4.el9 @quickstart-centos-highavailability | 10:58 |
| chandankumar | pacemaker-libs.x86_64 2.1.2-4.el9 @quickstart-centos-highavailability | 10:58 |
| chandankumar | pacemaker-remote.x86_64 2.1.2-4.el9 @quickstart-centos-highavailability | 10:58 |
| chandankumar | pacemaker-schemas.noarch 2.1.2-4.el9 @quickstart-centos-highavailability | 10:58 |
| chandankumar | and | 10:58 |
| chandankumar | resource-agents.x86_64 4.10.0-17.el9 @quickstart-centos-highavailability | 10:58 |
| amoralej | where are the container build logs? | 10:59 |
| *** ysandeep is now known as ysandeep|brb | 11:01 | |
| chandankumar | buildset history https://zuul.opendev.org/t/openstack/buildset/e34cbeae93694af88b4fe64d2257398d and https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_6ef/846231/10/gate/tripleo-ci-centos-9-content-provider/6efa83c/logs/container-builds/4dfa92a4-c0a3-4404-b684-450781385526/base/redis/redis-build.log | 11:01 |
| amoralej | i got it | 11:02 |
| amoralej | chandankumar, there is specific nvr there | 11:03 |
| amoralej | dnf -y downgrade pacemaker-2.1.2-4.el9 pacemaker-remote-1.2-4.el9 resource-agents-4.10.0-17.el9 | 11:04 |
| amoralej | that's what is missing in my patch ... | 11:04 |
| chandankumar | amoralej: i think downgrading resource-agents is enough | 11:04 |
| amoralej | maybe | 11:04 |
| amoralej | but the problem is not specifying the version | 11:05 |
| amoralej | https://review.opendev.org/c/openstack/tripleo-common/+/847222 | 11:05 |
| chandankumar | amoralej: will i update the workaround with nvr to avoid further issue? | 11:05 |
| amoralej | i didn't have that when i ran the jobs | 11:05 |
| amoralej | should be fine now | 11:05 |
| amoralej | rechecking ... | 11:05 |
| chandankumar | ok | 11:06 |
| amoralej | chandankumar, https://review.opendev.org/c/openstack/tripleo-common/+/847222 you need that in wallaby | 11:06 |
| amoralej | make sure you include exact nvr | 11:06 |
| amoralej | unless the latest release in centos is fixed ... | 11:06 |
| amoralej | actually, see the commit message | 11:07 |
| amoralej | So the problem resurfaced when | 11:07 |
| amoralej | these rpms upgraded yet again. | 11:07 |
| chandankumar | amoralej: https://review.opendev.org/c/openstack/tripleo-common/+/847437 for wallaby backport | 11:08 |
| chandankumar | let me fix it | 11:08 |
| amoralej | actually that looks fine | 11:09 |
| * jm1 lunch | 11:14 | |
| *** ysandeep|brb is now known as ysandeep | 11:18 | |
| ysandeep | anyone want to join review time? | 11:19 |
| marios | ysandeep: i was alone and dropped | 11:19 |
| marios | ysandeep: after couple mins | 11:19 |
| *** dviroel|out is now known as dviroel | 11:19 | |
| marios | ysandeep: you have something to discuss? otherwise i think you and me have already reviewed so we can skip looks like? | 11:19 |
| ysandeep | marios, rlandy and dviroel joined if you want to join back | 11:20 |
| marios | ysandeep: k rejoining | 11:20 |
| rlandy | akahat|ruck: jm1: https://zuul.opendev.org/t/openstack/builds?result=POST_FAILURE&skip=0 - pls follow #opendev on that | 11:26 |
| akahat|ruck | rlandy, ack | 11:27 |
| ysandeep | reviewbot, please add in review list: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43714 | 11:39 |
| reviewbot | I have added your review to the Review list | 11:39 |
| ysandeep | dviroel, hey o/ | 11:40 |
| ysandeep | dviroel, do you have few mins to sync? | 11:40 |
| dviroel | ysandeep: yep | 11:40 |
| ysandeep | dviroel, https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43714 | 11:41 |
| ysandeep | dviroel, oops https://meet.google.com/vzm-nrah-qqf?authuser=0 | 11:41 |
| dviroel | ysandeep: trying to join, it is slow to me | 11:42 |
| ysandeep | okay.. no worries | 11:43 |
| *** rlandy is now known as rlandy|dr_appt | 11:48 | |
| ysandeep | dviroel, https://github.com/scality/openstack-actions-runner | 11:49 |
| chandankumar | #oooq, anyone seen this issue: https://9220ef844f68ff46b4db-cd7f53ffbb0b86c69deae453da021fe8.ssl.cf1.rackcdn.com/839688/82/check/tripleo-ansible-centos-stream-molecule-tripleo_collectd/3cabfb4/job-output.txt | 11:58 |
| chandankumar | The task includes an option with an undefined variable. The error was: 'nslookup_target' is undefined\ | 11:58 |
| chandankumar | the job is failing with retry_limit | 11:58 |
| dviroel | chandankumar: yes | 12:02 |
| chandankumar | dviroel: how to fix it? | 12:02 |
| dviroel | chandankumar: actually, I think that this job is running with fips enabled | 12:03 |
| dviroel | chandankumar: this is something that ade_lee added in fips role | 12:04 |
| chandankumar | dviroel: is there a way to disable it? | 12:04 |
| dviroel | TASK [include_role : enable-fips] | 12:04 |
| chandankumar | it is a molecule job and only collectd one is failing | 12:04 |
| dviroel | chandankumar: fips mode only runs if you parent of multinode-fips | 12:05 |
| dviroel | you should parent from multinode only | 12:05 |
| dviroel | chandankumar: pre-run: zuul.d/playbooks/enable-fips.yml | 12:06 |
| dviroel | in job definition, don't know why | 12:06 |
| dviroel | not related to parent job | 12:06 |
| chandankumar | adding enable_fips: false in the job var to disable it | 12:07 |
| dviroel | if the idea is to run with fips enabled, you can set 'nslookup_target' vat to opendev.org | 12:07 |
| dviroel | nslookup_target: 'opendev.org' | 12:08 |
| chandankumar | dviroel: currently it is not needed | 12:09 |
| dviroel | chandankumar: ok, remove the pre-run then | 12:09 |
| chandankumar | dviroel: thank you for the tip, i hope this time it will work | 12:09 |
| dviroel | chandankumar: np o/ | 12:10 |
| chandankumar | dviroel: the job is inherited from base | 12:11 |
| chandankumar | https://opendev.org/zuul/zuul-jobs/src/branch/master/playbooks/enable-fips/pre.yaml#L9 | 12:11 |
| chandankumar | enable_fips | default(true) is causing that | 12:11 |
| *** ysandeep is now known as ysandeep|afk | 12:12 | |
| *** amoralej is now known as amoralej|lunch | 12:19 | |
| dviroel | chandankumar: yeah, just remove the pre-run playbook | 12:31 |
| dviroel | chandankumar: doesn't make sense to keep and have it disabled | 12:31 |
| akahat|ruck | reviewbot, please add in review list: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43719 | 12:42 |
| reviewbot | I have added your review to the Review list | 12:42 |
| chandankumar | dviroel: ok | 12:43 |
| akahat|ruck | jm1, chandankumar dviroel ysandeep|afk ^^ please take a look when you free. | 12:43 |
| *** rlandy|dr_appt is now known as rlandy | 12:51 | |
| jm1 | akahat|ruck, rlandy: updated rr doc with rerun testprojects and info for c9 wallaby and rhel9 osp17 | 12:52 |
| rlandy | jm1'; great - thank you | 12:52 |
| * jm1 mtg | 12:57 | |
| *** ysandeep|afk is now known as ysandeep | 12:58 | |
| *** undefined__ is now known as rcastillo | 13:08 | |
| *** undefined_ is now known as rcastillo | 13:09 | |
| rlandy | akahat|ruck; thanks for fixing promoter | 13:13 |
| *** amoralej|lunch is now known as amroalej | 13:16 | |
| *** amroalej is now known as amoralej | 13:16 | |
| amoralej | rlandy, i'm updating the versions of puppet and facter in master https://review.rdoproject.org/r/c/rdoinfo/+/42273 | 13:16 |
| amoralej | i expect it will just work fine | 13:16 |
| rlandy | chandankumar: dviroel: operator meeting | 13:16 |
| amoralej | just in case, you prefer me to do it on monday? | 13:16 |
| rlandy | amoralej: probably | 13:17 |
| rlandy | we're very behind promoting mater | 13:17 |
| rlandy | master | 13:17 |
| amoralej | ok, i'll do in on monday | 13:17 |
| amoralej | np | 13:17 |
| rlandy | so monday should be better | 13:17 |
| rlandy | thanks | 13:17 |
| *** dasm|off is now known as dasm | 13:33 | |
| akahat|ruck | C8 train promoted | 13:39 |
| rlandy | akahat|ruck++ | 13:40 |
| rlandy | jm1: hey - where are your pictures??? | 14:03 |
| jm1 | rlandy: mtg, joining later | 14:03 |
| ysandeep | Have a superb weekend everyone! See you on Monday o/ | 15:00 |
| *** ysandeep is now known as ysandeep|out | 15:00 | |
| chandankumar | see ya! | 15:17 |
| *** dviroel is now known as dviroel|lunch | 15:19 | |
| rlandy | jm1: network jobs are still failing wallaby c8 and c9 | 15:27 |
| rlandy | https://logserver.rdoproject.org/openstack-component-network/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-centos-9-standalone-network-wallaby/eb551b6/job-output.txt | 15:27 |
| rlandy | we should have ykarel's fix merged | 15:28 |
| rlandy | jm1: hey can we also get a testproject downstream for periodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset035-rhos-16.2 | 15:42 |
| jm1 | rlandy: so we wait until periodic job runs again or should we tricger it again? | 15:42 |
| jm1 | rlandy: ack | 15:42 |
| rlandy | - periodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset035-rhos-16.2: | 15:42 |
| rlandy | vars: | 15:42 |
| rlandy | force_periodic: true | 15:42 |
| rlandy | featureset_override: | 15:42 |
| rlandy | dlrn_hash_tag: e944f162e1f8a310431480d222279a99 | 15:42 |
| rlandy | trigger it now pls | 15:43 |
| rlandy | promoted last on 06/20 | 15:43 |
| jm1 | rlandy: ack, then i will be eod | 15:43 |
| rlandy | sure | 15:44 |
| jm1 | rlandy: first one https://code.engineering.redhat.com/gerrit/c/testproject/+/416778 | 15:45 |
| jm1 | rlandy: c9 wallaby network component https://review.rdoproject.org/r/c/testproject/+/43727 | 15:47 |
| akahat|ruck | rlandy, jm1 https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43719 | 15:47 |
| rlandy | jm1: thank you | 15:48 |
| jm1 | rlandy: added it to rr notes in section "Investigations and Reruns" | 15:49 |
| jm1 | rlandy, akahat|ruck: have an appointment with mother-in-law now, eod 🙈 | 15:51 |
| jm1 | have a nice weekend, oooci team :) | 15:52 |
| rlandy | jm1[m]: thanks - have a good weekend | 15:53 |
| *** jpena is now known as jpena|off | 16:02 | |
| *** amoralej is now known as amoralej|off | 16:09 | |
| *** dviroel|lunch is now known as dviroel | 16:18 | |
| akahat|ruck | rlandy, about POST_FAILURE https://zuul.opendev.org/t/openstack/builds?result=POST_FAILURE&skip=0 | 18:02 |
| akahat|ruck | rlandy, uploading logs to the fileserver taking too much time.. | 18:03 |
| akahat|ruck | it is causing timeout in some jobs. | 18:03 |
| akahat|ruck | As per discussion with fungi on #opendev he suggested few points: | 18:04 |
| akahat|ruck | - Uploading too much logs to the fileserver causing timeout. | 18:04 |
| akahat|ruck | - Each dir/nested dir is treated as swift object.. if possible remove nested logs | 18:04 |
| akahat|ruck | - Lot's of duplicate dirs like: https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_614/842073/10/gate/tripleo-ci-centos-9-undercloud-upgrade/6142441/logs/undercloud/home/zuul/src/opendev.org/openstack/tripleo-quickstart-extras/roles/validate-tempest/files/tempestmail/tests/fixtures/index.html | 18:05 |
| akahat|ruck | https://storage.bhs.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_614/842073/10/gate/tripleo-ci-centos-9-undercloud-upgrade/6142441/logs/undercloud/home/zuul/workspace/.quickstart/usr/local/share/ansible/roles/validate-tempest/files/tempestmail/tests/fixtures/index.html | 18:05 |
| akahat|ruck | We need to take a look around what files we really need. So we can remove unnecessary files. | 18:06 |
| rlandy | akahat|ruck: ahok | 18:24 |
| rlandy | ah ok | 18:24 |
| * akahat|ruck off | 18:58 | |
| rlandy | ysandeep|out: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?job_name=periodic-tripleo-ci-rhel-8-bm_envD-3ctlr_1comp-featureset035-rhos-16.2&skip=0 - think we broke bm with your review | 19:07 |
| rlandy | getting there | 20:25 |
| rlandy | 4 jobs away from promoting master | 20:26 |
| dasm | neverending story :) | 20:26 |
| dasm | i already hear Lamal in my head ^^ | 20:26 |
| dasm | *Limahl | 20:26 |
| dviroel | have a great weekend team - enjoy o/ | 20:48 |
| dasm | dviroel: o/ | 20:48 |
| *** dviroel is now known as dviroel|out | 20:50 | |
| * dasm leaves for the week. | 21:49 | |
| dasm | happy weekend y'all | 21:49 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!