| *** rlandy|bbl is now known as rlandy | 01:23 | |
| rlandy | frenzyfriday|ruck: ysandeep|out: master is trying to promote | 01:26 |
|---|---|---|
| rlandy | but promoter is broken | 01:26 |
| rlandy | trying to read containers from old rdo reg | 01:26 |
| rlandy | http://promoter.rdoproject.org/promoter_logs/container-push/20220526-010141.log | 01:26 |
| rlandy | akahat: ^^ if you get there first - pls | 01:27 |
| *** ysandeep|out is now known as ysandeep | 01:27 | |
| ysandeep | rlandy, ack will check with bhagyashri or amol | 01:28 |
| rlandy | ysandeep: hey | 01:28 |
| rlandy | ysandeep: train is out by fs035 and fs001 | 01:28 |
| ysandeep | rlandy, thanks for keeping an eye on master :D | 01:28 |
| rlandy | starting a rerun | 01:28 |
| rlandy | ysandeep: it's tried to promote three times | 01:29 |
| rlandy | says missing containers | 01:29 |
| rlandy | atal: [localhost]: FAILED! => {"changed": false, "msg": "There are missing containers"} | 01:29 |
| rlandy | ysandeep: https://review.rdoproject.org/r/c/testproject/+/39960 - rerurn for two missing train jobs - then can promo that | 01:30 |
| ysandeep | not verbose enough - There are missing containers"} | 01:30 |
| ysandeep | rlandy, I will keep an eye | 01:30 |
| rlandy | ysandeep: lastly ... https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/builds?pipeline=openstack-periodic-integration-rhos-17+&skip=0 | 01:31 |
| rlandy | is out by fs020 and scenario | 01:31 |
| rlandy | so we can promo if that bug is addressed | 01:31 |
| rlandy | ysandeep: ok - I'm out - see you later | 01:31 |
| ysandeep | okay that neutron bug | 01:31 |
| *** rlandy is now known as rlandy|out | 01:31 | |
| rlandy|out | yep | 01:31 |
| ysandeep | i will check with yatin | 01:31 |
| ysandeep | gd nyt o/ | 01:31 |
| rlandy|out | ysandeep: is you are still short of nodes on vexx ... | 01:32 |
| rlandy|out | drop the number of times component promote runs | 01:32 |
| rlandy|out | it kicks every two hours | 01:32 |
| rlandy|out | now I'm out | 01:32 |
| ysandeep | okay | 01:32 |
| * ysandeep . only trunk.registry.rdoproject.org/tripleomastercentos9/openstack-novajoin-notifier:6ccf4d4d6feae4a7ddeb7d15d2769b57 pull is failing, i tried other containers which works | 01:38 | |
| ysandeep | okay.. only these 2 containers are missing | 01:40 |
| ysandeep | $ cat /var/tmp/promoter_logs/missing_parsed_containers-centos-9-master.txt | 01:40 |
| ysandeep | openstack-novajoin-notifier | 01:40 |
| ysandeep | openstack-novajoin-server | 01:40 |
| ysandeep | checking with happened with those | 01:40 |
| ysandeep | so we are not building novajoin at all as per https://logserver.rdoproject.org/openstack-periodic-integration-main/opendev.org/openstack/tripleo-ci/master/periodic-tripleo-ci-build-containers-centos-9-quay-push-master/a6f4f5f/logs/containers-built.log | 01:42 |
| ysandeep | https://review.opendev.org/c/openstack/tripleo-common/+/839459 - novajoin is dropped | 01:43 |
| ysandeep | rlandy|out, basically another issue of using delorean-current | 02:11 |
| ysandeep | https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/repo_client.py#L95-L96 | 02:11 |
| ysandeep | we try to gets tripleo containers template file from a specific commit which is in tripleo-ci-testing | 02:12 |
| ysandeep | https://trunk.rdoproject.org/centos9-master/component/tripleo/90/70/907010c0a695a2f43112ab8ea391b0bb17a60899_59a030c8/ - openstack-tripleo-common-16.4.1-0.20220516192214.cc9d858.el9.src.rpm | 02:12 |
| ysandeep | https://github.com/openstack/tripleo-common/commits/master - but because we are using delorean-current we stopped building that container even earlier | 02:13 |
| ysandeep | so when https://github.com/openstack/tripleo-common/commit/0a4ca78500a30e80a1746ac65188350d597a32bc will promote - this will be autofixed | 02:13 |
| ysandeep | or we change our promoter code to always use latest code instead of particular commit (tripleo-common) | 02:14 |
| ysandeep | rlandy|out, dropped an email to you/amol/bhagyashri on why this is happening and to ignore novajoin containers and promote. | 02:49 |
| *** ysandeep is now known as ysandeep|afk | 02:50 | |
| bhagyashris | ysandeep|rover, hey | 05:34 |
| bhagyashris | i saw your mail | 05:34 |
| bhagyashris | regarding master promotion | 05:34 |
| bhagyashris | so we can exclude those containers from here https://github.com/openstack/tripleo-ci/blob/master/roles/build-containers/vars/main.yaml#L16 | 05:35 |
| ysandeep|rover | bhagyashris, hi good morning | 05:37 |
| ysandeep|rover | bhagyashris, where we set value for this var: containers_list ?- https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/container-push/roles/containers-promote/templates/generate_list.sh.j2#L2 | 05:37 |
| ysandeep|rover | bhagyashris, hmmm.. https://github.com/rdo-infra/ci-config/blob/master/ci-scripts/dlrnapi_promoter/repo_client.py#L182-L185 | 05:39 |
| ysandeep|rover | I am not exactly familiar with promoter code but looks like exclude will work | 05:40 |
| ysandeep|rover | bhagyashris, Is there no other way apart from adding in exclude list.. because in next promotion this will be solved by itself. | 05:41 |
| ysandeep|rover | bhagyashris, we don't use novajoin containers anymore.. infact they are removed.. to solve this quickly I am thinking about just pushing nova-join old hash container with new hash.. that way promoter will be happy | 05:46 |
| ysandeep|rover | and when tripleo-common promotes this will be autosolved. | 05:46 |
| ysandeep|rover | bhagyashris, do you have few mins for a quick call | 05:50 |
| bhagyashris | ysandeep|rover, sure | 06:05 |
| bhagyashris | ysandeep|rover, https://meet.google.com/sjx-vnwk-zqu?authuser=0 | 06:06 |
| marios | ysandeep|rover: o/ can you update that when you get a sec (link to current hackmd) https://hackmd.io/2hB-P772SqyqDs0KKZzZEQ?view | 06:10 |
| ysandeep|rover | will do | 06:12 |
| ysandeep|rover | done | 06:18 |
| bhagyashris | http://promoter.rdoproject.org/promoter_logs/container-push/20220526-061927.log | 06:21 |
| bhagyashris | http://promoter.rdoproject.org/promoter_logs/centos9_master.log | 06:21 |
| ysandeep|rover | frenzyfriday, rlandy|out wohoo master promoted :D | 07:01 |
| akahat | ysandeep|rover, those two containers also got promoted with that hash. If that containers are not built then from where we got those two containers? | 07:12 |
| ysandeep|rover | akahat, hey o/ check my reply on that email thread | 07:12 |
| akahat | ysandeep|rover, okay.. got it. Thanks!! | 07:13 |
| jm1 | ysandeep|rover: hey ho :) is downstream already broken with new openstacksdk? i see some mails on rhos-dev about infrared. wondering whether you see these type of errors in 16.2 as well | 07:22 |
| ysandeep|rover | jm1, all okay here: https://sf.hosted.upshift.rdu2.redhat.com/zuul/t/tripleo-ci-internal/status#openstack-periodic-integration-rhos-16.2%20 | 07:23 |
| ysandeep|rover | fs020 and tempest failure is known | 07:23 |
| ysandeep|rover | neutron related issues | 07:23 |
| jm1 | ysandeep|rover: ack, okay thanks! | 07:24 |
| ysandeep|rover | may be infrared is broken but in our jobs we use quickstart | 07:24 |
| ykarel_ | ysandeep|rover, jm1 yes infrared was broken but now it's fixed after pinning openstacksdk version | 07:33 |
| *** ykarel_ is now known as ykarel | 07:33 | |
| ysandeep|rover | ykarel: okay, thanks! | 07:33 |
| jm1 | ykarel: ah, great, thanks for clarifying! | 07:34 |
| *** ysandeep|rover is now known as ysandeep|rover|lunch | 07:35 | |
| jm1[m] | test | 08:58 |
| jm1 | jm1[m]: test | 08:59 |
| kopecmartin | arxcruz: chandankumar any idea what to do with this? https://bugzilla.redhat.com/show_bug.cgi?id=1844084 | 09:11 |
| jlarriba1 | hi guys, I am having an issue on the gate with python-tripleoclient, openstack-tox-py310 is failing on some code that has been there forever and that has nothing to do with my patch. You can see the error in https://zuul.opendev.org/t/openstack/build/f810f5f7ce9047358e4225fe4ff90c16 | 09:16 |
| jlarriba1 | is this known? | 09:17 |
| frenzyfriday|ruck | looks like the job has been failing in openstack/freezer for a long time. Checking | 09:21 |
| jlarriba1 | frenzyfriday|ruck thanks | 09:23 |
| *** ysandeep|rover|lunch is now known as ysandeep|rover | 09:23 | |
| ysandeep|rover | that's a non-voting job and never passed https://zuul.opendev.org/t/openstack/builds?job_name=openstack-tox-py310&project=openstack/python-tripleoclient | 09:24 |
| jlarriba1 | ooops | 09:24 |
| jlarriba1 | didnt realize it was non-voting | 09:25 |
| frenzyfriday|ruck | failing allover pythontripleoclient with 'autospect' might be a typo; since forever | 09:25 |
| frenzyfriday|ruck | yeah, it should not block the patch | 09:25 |
| jlarriba1 | then the failure is in openstack-tox-docs: https://zuul.opendev.org/t/openstack/build/0e68678c70f14227850a22c3d7485daf | 09:25 |
| jlarriba1 | but that is indeed in my code | 09:26 |
| jlarriba1 | thank you for your support! | 09:26 |
| ysandeep|rover | frenzyfriday|ruck, hey o/ want to sync now? | 09:33 |
| frenzyfriday|ruck | ysandeep|rover, yep sure | 09:33 |
| ysandeep|rover | frenzyfriday|ruck, https://meet.google.com/uaq-thvd-rzp?authuser=0&hl=en | 09:34 |
| ysandeep|rover | #folks o/ fyi.. please don't run multiple job in testprojects, To get better performance in each node vexx have reduced the cpu overcommit and we had to reduce the max_servers as well.. So if you run multiple jobs via testprojects that will affect our scheduled runs. | 10:07 |
| *** rlandy|out is now known as rlandy | 10:27 | |
| rlandy | frenzyfriday|ruck: ysandeep|rover: hello | 10:29 |
| ysandeep|rover | o/ | 10:30 |
| frenzyfriday|ruck | rlandy, 0/ | 10:30 |
| rlandy | frenzyfriday|ruck: ysandeep|rover: let's chat about getting train promo'ed | 10:30 |
| rlandy | and what's left on downstream | 10:30 |
| *** carloss_ is now known as carloss | 10:31 | |
| ysandeep|rover | meet.google.com/kkh-akjc-ecw | 10:31 |
| rlandy | PSA pls be careful when emailing ysandeep|rover ... he now has a twin at RH - there are two Sandeep Yadav's here | 11:04 |
| ysandeep|rover | fun fact.. on the day i joined RH i met my twin at the reception.. He was signing attendance register before me .. I was like - hey dude why are you signing for me :D | 11:08 |
| jm1 | ysandeep|rover: Whuat?😱 😂 | 11:08 |
| ysandeep|rover | jm1: :D yeah | 11:11 |
| jm1 | ysandeep|rover: is he in rhosp or somewhere else? might be an easy way to switch your workspace for a month 😉 | 11:11 |
| ysandeep|rover | jm1: not at all... I have taken enough call on his behalf for more than 2 years.. everyone used to redirect other sandeep Y customer calls to me all the time :) | 11:13 |
| ysandeep|rover | jm1: luckily he is not in OSP :) | 11:14 |
| ysandeep|rover | jm1, On an average 3/4 call per week.. 5 ping from different person because of confusion | 11:15 |
| jm1 | ysandeep|rover: 😂 how did it stop? or are they still calling you? | 11:16 |
| ysandeep|rover | jm1, I stopped using genesis when I moved to engineering , benefits of being in this team :D | 11:17 |
| *** dviroel_ is now known as dviroel | 11:17 | |
| ysandeep|rover | but I still get random pings sometime | 11:17 |
| jm1 | ysandeep|rover: whatever genesis is.. 😅 but still a very good anecdote 😂 | 11:19 |
| dviroel | lol - fun fact indeed | 11:19 |
| ysandeep|rover | :D | 11:20 |
| jm1 | ysandeep|rover: my first name had been so rare in the first 25-30 years that when it was used in public i would answer immediately and get confused when people were not speaking to me. that has changed in recent years though.. | 11:20 |
| jm1 | btw anyone using elemental/matrix with irc bridge to oftc? | 11:22 |
| ysandeep|rover | jakob... I have heard that name before in movies :D | 11:24 |
| ysandeep|rover | fast and furious - Jakob Toretto (john cena) | 11:25 |
| jm1 | ysandeep|rover: well.. that came out last year iirc 😂 | 11:26 |
| jm1 | ysandeep|rover: fast furious 9.. bro, i saw ff1 in the cinema.. getting old 😱 | 11:27 |
| ysandeep|rover | jm1 :) https://www.youtube.com/watch?v=o8UCI7r1Aqw | 11:30 |
| ysandeep|rover | rlandy, criteria patch: https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43171 | 11:36 |
| *** ysandeep|rover is now known as ysandeep|rover|break | 11:44 | |
| jm1 | rlandy: #openstack-ansible-sig | 11:46 |
| rlandy | jm1: https://review.opendev.org/c/openstack/tripleo-ci/+/843220 | 11:56 |
| *** ysandeep|rover|break is now known as ysandeep|rover | 12:36 | |
| ysandeep|rover | rlandy: when you get a chance could you please +w https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43171 | 12:36 |
| jm1 | rlandy: "ansible-collections-openstack" / "openstack.cloud." is what i searched for | 12:37 |
| rlandy | ysandeep|rover: done | 12:37 |
| ysandeep|rover | rlandy, thanks! | 12:37 |
| dviroel | tenho 150 pra mandar | 13:00 |
| dviroel | ^ gah, just ignore it | 13:01 |
| bhagyashris | arxcruz, chandankumar rlandy rcastillo jm1 dalvarez dviroel | 13:01 |
| rlandy | dviroel: :) | 13:01 |
| bhagyashris | scrum time | 13:01 |
| bhagyashris | dalvarez, plz ignore | 13:01 |
| bhagyashris | dasm|off, ^ | 13:01 |
| dviroel | 1. https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/43126 | 13:05 |
| dviroel | 2. https://review.rdoproject.org/r/c/rdo-jobs/+/42956 | 13:05 |
| bhagyashris | https://review.rdoproject.org/r/c/rdo-jobs/+/40791 | 13:08 |
| jm1 | marios: will have a look at quickstart.sh before our meeting again of course. what i tried to say is i am missing experience with this thingy and really want to make sure we dont break tripleo again | 13:19 |
| ysandeep|rover | reviewbot, please add in review list: https://review.rdoproject.org/r/c/config/+/43147 | 13:24 |
| reviewbot | I have added your review to the Review list | 13:24 |
| dasm | marios: i just realized i used "heated" twice. wrt srbac akd bmc ;) | 13:45 |
| dasm | it must be morning, because i'm lacking otner words | 13:45 |
| dasm | *other (even) | 13:45 |
| bhagyashris | rlandy, https://code.engineering.redhat.com/gerrit/c/openstack/tripleo-ci-internal-jobs/+/411458 | 13:48 |
| frenzyfriday|ruck | ysandeep|rover, after rerunning the master components: overcloud and undercloud deployments are failing with AttributeError: 'Service' object has no attribute 'enabled' in master clients component. | 13:54 |
| frenzyfriday|ruck | and -featureset001-tripleo-master still fails with ntp synch error | 13:55 |
| *** bhagyashris is now known as bhagyashris|ruck | 14:22 | |
| ysandeep|rover | marios, fyi.. train was blocked on this bug earlier: https://bugs.launchpad.net/tripleo/+bug/1975462 | 14:24 |
| ysandeep|rover | that's fixed now | 14:24 |
| *** ysandeep|rover is now known as ysandeep|dinner | 14:27 | |
| *** ysandeep|dinner is now known as ysandeep | 14:50 | |
| rlandy | tripleowallaby promoting now | 14:55 |
| rlandy | ysandeep: frenzyfriday|ruck: ^^ | 14:56 |
| rlandy | hopefully train will be next | 14:56 |
| marios | thanks ysandeep | 14:57 |
| ysandeep | rlandy, df call | 15:01 |
| *** marios is now known as marios|out | 15:44 | |
| ysandeep | rlandy, wallaby/c8 promoted | 15:45 |
| rlandy | nice | 15:46 |
| rlandy | marios|out: bhagyashris|ruck: I have an outage tomorrow | 15:46 |
| rlandy | will be in and out | 15:46 |
| *** frenzyfriday|ruck is now known as frenzy_friday | 15:54 | |
| marios|out | ack rlandy np | 15:54 |
| rlandy | jm1: ysandeep: rcastillo: dasm: dviroel: akahat: pojadhav: frenzy_friday: chandankumar: soniya: just fyi ... as above ... I have an unexpected outage tomorrow morning my time | 15:56 |
| rlandy | I'll be in and out | 15:56 |
| rcastillo | rlandy: ack | 15:56 |
| frenzy_friday | ack | 15:56 |
| rlandy | will be back 7:30pm UTC | 15:56 |
| rlandy | bhagyashris|ruck: pls leave note of what you want me to watch in the afternoon hours | 15:57 |
| rlandy | will reschedule 1-1's | 15:57 |
| rlandy | will be at podified meeting | 15:57 |
| dviroel | rlandy: ok, np | 15:57 |
| rlandy | will be at monday's scrum call | 15:59 |
| dasm | rlandy: no worries. take care! | 16:01 |
| *** ysandeep is now known as ysandeep|out | 16:06 | |
| pojadhav | rlandy, ack | 16:52 |
| dasm | periodic-tripleo-ci-rhel-9-ovb-1ctlr_2comp-featureset020-internal-rhos-17 | 17:33 |
| rcastillo | dasm: dviroel review time? | 19:02 |
| dviroel | joinning | 19:04 |
| rlandy | dasm; ugh - rhel-9 common component blocked on neutron bug | 20:03 |
| rlandy | I think I may force promo it | 20:04 |
| *** dviroel is now known as dviroel|out | 21:00 | |
| *** rlandy is now known as rlandy|biab | 21:23 | |
| dasm | dviroel|out: good catch wrt review. I haven't considered that. | 21:32 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!