Monday, 2022-06-27

*** ysandeep|out is now known as ysandeep02:04
*** ysandeep is now known as ysandeep|afk05:15
*** ysandeep|afk is now known as ysandeep05:56
rdogerritMerged rdoinfo master: Promote CBS tags update for xena-8s-testing  https://review.rdoproject.org/r/c/rdoinfo/+/4374006:45
rdogerritMerged rdoinfo master: Bump rdoinfo wallaby tags to latest upper-constraints  https://review.rdoproject.org/r/c/rdoinfo/+/4373606:47
rdogerritMerged rdoinfo master: Bump rdoinfo victoria tags to latest upper-constraints  https://review.rdoproject.org/r/c/rdoinfo/+/4373506:48
rdogerritMerged rdoinfo master: Bump rdoinfo ussuri tags to latest upper-constraints  https://review.rdoproject.org/r/c/rdoinfo/+/4373406:48
rdogerritrdo-trunk created openstack/gnocchiclient-distgit wallaby-rdo: python-gnocchiclient-7.0.6-1  https://review.rdoproject.org/r/c/openstack/gnocchiclient-distgit/+/4374506:49
rdogerritMerged rdoinfo master: Promote CBS tags update for xena-8s-release  https://review.rdoproject.org/r/c/rdoinfo/+/4374306:49
rdogerritrdo-trunk created openstack/gnocchiclient-distgit ussuri-rdo: python-gnocchiclient-7.0.6-1  https://review.rdoproject.org/r/c/openstack/gnocchiclient-distgit/+/4374606:50
rdogerritrdo-trunk created openstack/gnocchiclient-distgit victoria-rdo: python-gnocchiclient-7.0.6-1  https://review.rdoproject.org/r/c/openstack/gnocchiclient-distgit/+/4374706:50
rdogerritMerged rdoinfo master: Promote CBS tags update for wallaby-8s-release  https://review.rdoproject.org/r/c/rdoinfo/+/4374406:50
rdogerritMerged nfvinfo master: Promote CBS tags update for nfvsig-2.16-testing  https://review.rdoproject.org/r/c/nfvinfo/+/4373306:53
rdogerritMerged rdoinfo master: Bump rdoinfo xena tags to latest upper-constraints  https://review.rdoproject.org/r/c/rdoinfo/+/4373706:54
rdogerritrdo-trunk created openstack/gnocchiclient-distgit xena-rdo: python-gnocchiclient-7.0.6-1  https://review.rdoproject.org/r/c/openstack/gnocchiclient-distgit/+/4374806:56
rdogerritrdo-trunk created openstack/oslo-messaging-distgit xena-rdo: python-oslo-messaging-12.9.4-1  https://review.rdoproject.org/r/c/openstack/oslo-messaging-distgit/+/4374906:56
*** amoralej|off is now known as amoralej07:05
*** frenzyfriday|PTO is now known as frenzy_friday07:13
*** jpena|off is now known as jpena07:43
rdogerritMatthias Runge created openstack/gnocchiclient-distgit wallaby-rdo: python-gnocchiclient-7.0.7-1  https://review.rdoproject.org/r/c/openstack/gnocchiclient-distgit/+/4367607:43
rdogerritJoel Capitao proposed openstack/cinderlib-distgit rpm-master: Fix ambiguous shebang  https://review.rdoproject.org/r/c/openstack/cinderlib-distgit/+/4373007:50
rdogerritUser bshewale proposed rdo-jobs master: Reparenting sc010 jobs using -options job  https://review.rdoproject.org/r/c/rdo-jobs/+/4314608:03
rdogerritMerged openstack/gnocchiclient-distgit wallaby-rdo: python-gnocchiclient-7.0.7-1  https://review.rdoproject.org/r/c/openstack/gnocchiclient-distgit/+/4367608:13
rdogerritMerged openstack/octavia-distgit rpm-master: Add octavia-driver-agent package  https://review.rdoproject.org/r/c/openstack/octavia-distgit/+/3277908:37
rdogerritMerged openstack/oslo-messaging-distgit xena-rdo: python-oslo-messaging-12.9.4-1  https://review.rdoproject.org/r/c/openstack/oslo-messaging-distgit/+/4374908:45
rdogerritTakashi Kajinami created openstack/octavia-distgit yoga-rdo: Add octavia-driver-agent package  https://review.rdoproject.org/r/c/openstack/octavia-distgit/+/4375008:47
rdogerritrdo-trunk created openstack/cinderlib-distgit yoga-rdo: python-cinderlib-4.2.0-1  https://review.rdoproject.org/r/c/openstack/cinderlib-distgit/+/4375109:01
*** vkmc_ is now known as vkmc09:10
rdogerritJakob Meng proposed rdo-infra/ci-config master: Added new ShellCheck job  https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4270109:19
rdogerritUser pojadhav proposed rdo-jobs master: Remove train c7 jobs  https://review.rdoproject.org/r/c/rdo-jobs/+/4317209:22
rdogerritUser pojadhav proposed rdo-jobs master: Remove train c7 jobs  https://review.rdoproject.org/r/c/rdo-jobs/+/4317209:26
rdogerritUser pojadhav proposed rdo-jobs master: Remove train c7 jobs  https://review.rdoproject.org/r/c/rdo-jobs/+/4317209:28
*** rlandy|out is now known as rlandy09:29
rdogerritUser pojadhav proposed config master: Remove train c7 jobs  https://review.rdoproject.org/r/c/config/+/4358509:29
*** ysandeep is now known as ysandeep|afk09:50
amoralejykarel, https://review.rdoproject.org/r/c/rdoinfo/+/4372810:03
amoralejwhat would be needed to test the weird issue?10:03
rdogerritMerged rdoinfo master: Update puppet and facter to last versions for CS9 in Zed  https://review.rdoproject.org/r/c/rdoinfo/+/4227310:05
amoralejrlandy, ^ also for your, i've started testing update to 2.1710:06
jcapitao[m]amoralej: https://review.rdoproject.org/r/q/topic:remove-mox3 when you have a chance 10:14
rdogerritJakob Meng proposed rdo-infra/ci-config master: Added new ShellCheck job  https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4270110:18
rdogerritMerged openstack/oslo-messaging-distgit rpm-master: Remove mox3  https://review.rdoproject.org/r/c/openstack/oslo-messaging-distgit/+/4369710:23
rdogerritMerged openstack/ironic-ui-distgit rpm-master: Remove mox3  https://review.rdoproject.org/r/c/openstack/ironic-ui-distgit/+/4369310:23
rdogerritMerged openstack/placement-distgit rpm-master: Remove mox3  https://review.rdoproject.org/r/c/openstack/placement-distgit/+/4369910:27
rdogerritMerged openstack/horizon-distgit rpm-master: Remove mox3  https://review.rdoproject.org/r/c/openstack/horizon-distgit/+/4369410:28
rdogerritMerged openstack/heat-distgit rpm-master: Remove mox3  https://review.rdoproject.org/r/c/openstack/heat-distgit/+/4367210:29
*** ysandeep|afk is now known as ysandeep10:38
rdogerritSandeep Yadav proposed rdo-jobs master: Remove train c7 jobs  https://review.rdoproject.org/r/c/rdo-jobs/+/4317210:41
rdogerritSandeep Yadav proposed config master: Remove train c7 jobs  https://review.rdoproject.org/r/c/config/+/4358510:41
rdogerritrdo-trunk created openstack/cinderlib-distgit xena-rdo: python-cinderlib: failed to build 4fc56c8  https://review.rdoproject.org/r/c/openstack/cinderlib-distgit/+/4375210:46
rdogerritrdo-trunk created openstack/cinderlib-distgit xena-rdo: python-cinderlib: failed to build 4fc56c8  https://review.rdoproject.org/r/c/openstack/cinderlib-distgit/+/4375310:47
rdogerritChandan Kumar created rdo-jobs master: Rename centos-9-quay job to ubi-9-quay job  https://review.rdoproject.org/r/c/rdo-jobs/+/4375410:54
ykarelamoralej, that day i also tested ovn22.03 and that's also impacted with cpu issue11:06
ykarelso we need the fix to be included before updating11:06
amoralejykarel, did you get any feedback from ovn team?11:07
ykarelamoralej, yes they have pushed a patch for review in ovs master11:08
amoralejgood11:08
ykareli did some test too with that, and looked good to me11:08
amoralejapevec, ^ fyi11:10
amoralejykarel, you have the link to the upstream patch somewhere?11:17
ykarelamoralej, https://patchwork.ozlabs.org/project/openvswitch/patch/20220624072959.240183-1-david.marchand@redhat.com/11:17
amoralejjcapitao[m], it seems we have old tackerclient in fedora11:38
amoralejfrom wallaby, didn't we include it in the update to yoga?11:38
jcapitao[m]hmm11:38
jcapitao[m]I see it's listed in result of https://github.com/rdo-infra/releng/blob/master/scripts/fedora_sync/list_openstack_packages.sh script11:44
kkulajcapitao, we have 1.6 version and now missing patch to fix from 1.8 11:44
rdogerritMerged rdo-infra/ci-config master: Enable usage of a user-provided CA bundle for downstream access  https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4371411:48
jcapitao[m]kkula: I'm rerunning https://github.com/rdo-infra/releng/blob/master/scripts/fedora_sync/sync_fedora_from_rdo.sh with tackerckient 11:49
jcapitao[m]to find out the issue11:49
kkulaack11:50
jcapitao[m]no specific issue12:00
*** dviroel|out is now known as dviroel12:01
jcapitao[m]my guess is that I got network issues when updating it during script execution12:01
jcapitao[m]kkula: I'm gonna push commit12:02
kkulajcapitao, thanks!12:02
*** amoralej is now known as amoralej|lunch12:06
rlandyjcapitao[m]: amoralej|lunch: fyi - new gate blocker https://bugs.launchpad.net/tripleo/+bug/1979985 12:29
rlandyfrom https://review.rdoproject.org/r/c/rdoinfo/+/4227312:29
*** arxcruz is now known as arxcruz|brb12:42
rdogerritYatin Karel proposed openstack/neutron-distgit rpm-master: Requirement Sync  https://review.rdoproject.org/r/c/openstack/neutron-distgit/+/4223512:55
*** amoralej|lunch is now known as amoralej13:04
amoralejrlandy, damn, i ran gate jobs13:05
amoralejlemme check13:05
rdogerritAlfredo Moralejo created rdoinfo master: Revert "Update puppet and facter to last versions for CS9 in Zed"  https://review.rdoproject.org/r/c/rdoinfo/+/4367713:07
amoralejrlandy, ^ reverting it13:07
tkajinamamoralej, rlandy maybe we can try this https://review.opendev.org/c/openstack/puppet-openstacklib/+/84778313:08
rlandychecking what runs on that13:08
amoralejtkajinam, where do you install facter from in upstream puppet jobs?13:09
rlandylet's kick some multinode jobs with that13:09
rlandyso we know we're not breaking anything13:09
amoralejrlandy, i ran https://review.rdoproject.org/r/c/rdoinfo/+/4227313:09
amoraleji didn't include tripleo-ci-centos-9-containers-multinode13:10
amoralejwhat's different in containers-multinode to the other jobs?13:10
rdogerritJoel Capitao proposed rdoinfo master: Retire mox3 package  https://review.rdoproject.org/r/c/rdoinfo/+/4370013:12
tkajinamamoralej, we install puppet/facter from rdo. our script supports usage of rpms by puppetlabs but we are not using it integration jobs13:12
tkajinam* in integration job13:12
amoralejok13:12
amoralejrlandy, you prefer me to do the revert or test with tkajinam patch? 13:13
rlandyamoralej: if tkajinam patch works and can be merged - it's ok13:13
rlandyif not, we can revert13:13
amoralejok13:13
rlandylet me try testproject13:13
tkajinamit's still strange that the issue was not caught in the tripleo jobs we tested before merging the bump13:18
rlandysorry - following multiple failures here13:20
rlandyback to testproject13:20
rlandyhttps://review.rdoproject.org/r/c/testproject/+/3996013:25
rlandyamoralej: tkajinam: we need to decide before you both are EoD 13:35
rlandygate is at risk for wallaby13:35
amoralejsure13:35
amoralejrlandy, note my patch only updated it in master13:35
amoralejnot wallaby13:36
rlandyatm- yeah13:38
tkajinamrlandy, I can merge that puppet change once we get result of ci13:41
tkajinamin 1 ~ 2 hours13:41
rlandyok  - let's see if it gives us a clean undercloud install13:41
tkajinamrlandy, is there any way to check packages installed in each containers ?13:41
rlandytkajinam: yes ... 13:42
rlandyon the provider jobs13:42
tkajinamstrange thing is that puppet did not fail when being executed at host13:42
rlandyyou should see the bild logs13:42
tkajinamwhile it failed when it was executed inside containers13:42
rlandybuild13:42
tkajinamhttps://review.opendev.org/c/openstack/tripleo-heat-templates/+/841609/13:44
tkajinamhttps://zuul.opendev.org/t/openstack/build/d19022021a4543a18ecbbaa3ccf8b66013:44
tkajinam facter                                    x86_64  1:3.14.19-1.el9s                    delorean-master-testing       517 k13:47
tkajinambingo13:47
tkajinamamoralej, rlandy, I see the old facter was pulled while building container images13:48
*** arxcruz|brb is now known as arxcruz13:48
amoralejwhat time was that?13:49
amoralejmaybe before the package was in the afs mirror?13:49
tkajinamwhile the host has the new version installed facter-4.2.10-1.el9s.noarch13:49
tkajinam2022-06-27 11:25:58.677449 13:50
tkajinamthis is when the job failed13:50
amoralejso, different version in containers and in host?13:50
amoralejthat's weird13:50
tkajinam3 in container and 4 in host13:50
tkajinamwe use facter in host while generating cache, while the cache is parsed by facter in container during container puppet tasks13:51
amoraleji see 3 in the host too13:51
amoralejhttps://d42defc27bbe357868ac-cbda4aa1c62aa706d6caf520e6cec7d3.ssl.cf2.rackcdn.com/841609/8/check/tripleo-ci-centos-9-content-provider/d190220/logs/undercloud/var/log/extra/rpm-list.txt13:51
tkajinamthat's content provider job13:51
tkajinamif you look at the build log of multi node job, which is pulling container images built by that content provider job, the node has facter 413:51
amoralejah, so the content provider built with 313:51
tkajinamyeah13:51
amoralejbut nested jobs with 4?13:51
tkajinamyes13:51
amoralejah, so it was synced in the middle13:52
amoralejtkajinam, but that's causing the issue?13:52
tkajinamfact cache was generated using facter 413:52
amoralejahhhhhhhh13:52
amoralejdamn13:52
amoralejthat's tricky13:52
tkajinamand facter 3 in containers can't parse the cache correctly13:52
amoralejso current jobs should go fine?13:52
tkajinamlet me chec13:52
tkajinamcheck13:52
tkajinamthat observation would explain why we didn't hit the issue in rdo13:53
tkajinamwe did(or do) not use separate content provider there13:53
amoralejyep13:54
tkajinamhttps://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-content-provider&project=openstack/tripleo-heat-templates13:54
tkajinamhmm.. we don't the job passed recently but I confirmed facter 3 is pulled in recent 3 successful run13:55
tkajinamhttps://zuul.opendev.org/t/openstack/build/7143bead7f2944fb98ffed70ac14716413:56
tkajinamthus standalone job just passed an I see facter 4 is pulled13:56
tkajinamin host as well as in container13:57
tkajinamso likely the mirror issue and old version was present during content provider job13:57
tkajinamrlandy, https://bugs.launchpad.net/tripleo/+bug/1979985/comments/514:00
rlandyhttps://review.rdoproject.org/zuul/stream/e36e2e15f53744e590c981287da3a3f1?logfile=console.log - failed14:03
rdogerritUser karolinku created rdoinfo master: Pin tap-as-a-service  https://review.rdoproject.org/r/c/rdoinfo/+/4375614:15
rdogerritrdo-trunk created openstack/cinderlib-distgit wallaby-rdo: python-cinderlib: failed to build 1b58a5f  https://review.rdoproject.org/r/c/openstack/cinderlib-distgit/+/4375714:21
rdogerritMerged rdoinfo master: Pin tap-as-a-service  https://review.rdoproject.org/r/c/rdoinfo/+/4375614:41
*** pojadhav is now known as pojadhav|afk15:04
tkajinamamoralej, do you care to force-merge this ? https://review.rdoproject.org/r/c/openstack/octavia-distgit/+/3780415:20
rdogerritMerged openstack/octavia-distgit rpm-master: Fix content of dist.conf  https://review.rdoproject.org/r/c/openstack/octavia-distgit/+/3780415:21
amoralejtkajinam, done, i guess we should remove cs8 job from rpm-master already15:21
tkajinamamoralej, thanks !15:22
tkajinamamoralej, yeah, we no longer need c9s packages now15:22
amoralejyou mean c8s15:22
tkajinamat least from TripleO's PoV and Puppet's PoV15:22
amoralejright? :)15:22
tkajinamyeas15:22
tkajinamyes15:22
tkajinamc8s packages15:22
amoralejin tripleo there are certain jobs on cs8, iiuc15:22
amoralejthe molecule ones15:23
amoralejthat's what i'm working for15:23
tkajinamhttps://review.opendev.org/c/openstack/tripleo-ansible/+/839688/15:23
tkajinammaybe we need this in master15:24
amoralejyep, that one15:24
tkajinamohk15:25
rdogerritMerged openstack/neutron-distgit rpm-master: Remove [DEFAULT] allow_overlapping_ips  https://review.rdoproject.org/r/c/openstack/neutron-distgit/+/3902415:26
*** dviroel is now known as dviroel|lunch15:27
tkajinamor we can put all cs8 jobs non-voting15:27
tkajinamthough it might hide actual problems15:27
amoralejtkajinam, you mean the molecule ones?15:28
tkajinamI mean the jobs in rdo15:28
tkajinamwe can wait for that tripleo-ansible patch for now. but we are likely to face the same problem more often15:28
tkajinamsince more and more projects are dropping py36/7 support during this cycle15:28
amoralejthat's the other option15:29
amoralejmaking non-voting the cs8 ones in rpm-master15:29
amoralejbut given that we are about to remove it15:29
amoraleji'm not sure if it's worthy15:29
amoralejlet me check how are created the templates15:30
tkajinamyeah, as I said it's not urgent, as long as we are on track to remove c8s things15:33
*** marios is now known as marios|out15:39
*** ysandeep is now known as ysandeep|PTO16:09
rdogerritMerged openstack/neutron-distgit rpm-master: Requirement Sync  https://review.rdoproject.org/r/c/openstack/neutron-distgit/+/4223516:13
*** jlibosva is now known as Guest343016:17
*** jlibosva is now known as Guest343116:23
*** dviroel|lunch is now known as dviroel16:37
*** amoralej is now known as amoralej|off16:51
rdogerritDariusz proposed rdo-infra/ci-config master: Added new ShellCheck job  https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4270117:12
*** Guest3279 is now known as rcastillo17:20
rdogerritDariusz created rdo-infra/ci-config master: Rename centos-9-quay job to ubi-9-quay job  https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/4375817:21
*** pojadhav|afk is now known as pojadhav17:36
*** rlandy is now known as rlandy|afk18:40
*** jpena is now known as jpena|off19:06
*** rlandy|afk is now known as rlandy19:23
*** dviroel is now known as dviroel|out21:40
*** dasm is now known as dasm|off22:16
rdogerritrdo-trunk created openstack/gnocchi-distgit rpm-master: gnocchi: failed to build a07d82e3  https://review.rdoproject.org/r/c/openstack/gnocchi-distgit/+/4375922:34

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!