Monday, 2022-03-28

opendevreviewBrendan Shephard proposed openstack/tripleo-upgrade stable/ussuri: Make the network_data search more inclusive  https://review.opendev.org/c/openstack/tripleo-upgrade/+/83540000:13
opendevreviewBrendan Shephard proposed openstack/tripleo-upgrade stable/train: Make the network_data search more inclusive  https://review.opendev.org/c/openstack/tripleo-upgrade/+/83540100:13
opendevreviewSteve Baker proposed openstack/openstack-virtual-baremetal master: Add bmc host support for centos-8 and centos-9-stream  https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/83461200:29
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Use node UUID for bridge_mapping agent check  https://review.opendev.org/c/openstack/tripleo-ansible/+/83492600:41
opendevreviewSteve Baker proposed openstack/openstack-virtual-baremetal master: Add bmc host support for centos-8 and centos-9-stream  https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/83461200:49
*** pmannidi|Away is now known as pmannidi03:27
opendevreviewSteve Baker proposed openstack/openstack-virtual-baremetal master: Add bmc host support for centos-8 and centos-9-stream  https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/83461203:33
opendevreviewSteve Baker proposed openstack/openstack-virtual-baremetal master: Add bmc host support for centos-8 and centos-9-stream  https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/83461204:09
opendevreviewSteve Baker proposed openstack/openstack-virtual-baremetal master: DNM disable bmc wait condition  https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/83540804:09
*** pojadhav- is now known as pojadhav04:55
*** marios is now known as marios|ruck04:57
opendevreviewBrendan Shephard proposed openstack/tripleo-upgrade master: Disable auto discovery as a workaround  https://review.opendev.org/c/openstack/tripleo-upgrade/+/83540905:24
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Disable auto discovery as a workaround  https://review.opendev.org/c/openstack/tripleo-ansible/+/83541005:27
marios|ruckbshephar: o/ hey are you still seeing https://launchpad.net/bugs/1966382 (^^^^_05:29
marios|rucki see.. it wil lbe needed anywhere we have a package built by setuptools i.e. all the places basically 05:31
marios|ruckbshephar: so i think the setuptools thing was reverted and that is why it no longer blocks us /we don't see it hitting anymore05:34
marios|ruckbshephar: but the workaround can still go in thanks for posting those ^^ 05:34
bshepharmarios|ruck: Hey, yeah. https://zuul.opendev.org/t/openstack/build/ef9a93c3d0774093b3adefa55416c64505:35
*** soniya29 is now known as soniya29|ruck05:35
bshepharAnd also: https://zuul.opendev.org/t/openstack/build/e339d35f008f45f1a62f6c1153cafb5c05:36
*** soniya29|ruck is now known as soniya29|rover05:37
marios|ruckbshephar: ah i see.. i was only looking at content provider which looks ok https://zuul.opendev.org/t/openstack/builds?job_name=tripleo-ci-centos-9-content-provider&project=openstack%2Ftripleo-ansible&skip=0 05:39
marios|ruckbshephar: but i thought it was reverted on friday perhaps not05:39
marios|ruckbshephar: 'it' i mean the braeking change05:39
marios|ruckbshephar:++ thanks05:39
bshepharmarios++ No worries. I guess it would just be a matter of time before all of the jobs stopped throwing the error if the breaking change has been reverted? We could probably skip the workarounds if we wanted to then?05:41
marios|ruckbshephar: nah i think its ok to go in 05:42
bshepharramishra_: Being discussed here ^05:43
marios|ruckbshephar: ramishra_: yeah just replied on your comment ramishra_ 05:47
marios|rucksoniya29|rover: o/ fyi https://review.rdoproject.org/r/c/rdo-infra/ci-config/+/41024/1#message-a6ffe398483005b02087e57c4c616546f35bc500 (we should revert that once u promotes can you please help me not forget later ;)) 05:50
soniya29|rovermarios|ruck, sure05:51
*** ysandeep|out is now known as ysandeep06:23
*** pmannidi is now known as pmannidi|Away06:30
ysandeepbshephar, ramishra_ marios|ruck I tried latest setuptools 61.2.0 locally for tripleo-upgrade repo, I still hit that issue without workaround06:46
ysandeephttp://pastebin.test.redhat.com/104014306:46
marios|ruckysandeep: thanks so we can go with those 06:50
marios|ruck(workaround i mean ) 06:50
ysandeep+106:50
ysandeepGoing through https://github.com/pypa/setuptools/pull/3211/files 06:54
ysandeep~~~06:54
ysandeep.. note::06:54
ysandeep   Users that don't set ``packages``, ``py_modules``, or ``configuration`` are06:54
ysandeep   still likely to observe the auto-discovery behavior, which may halt the06:54
ysandeep   build if the project contains multiple directories and/or multiple Python06:54
ysandeep   files directly under the project root.06:54
ysandeep~~~06:54
ysandeepbshephar: ^^ looks like we need your fixes.06:54
ramishra_ysandeep: ack06:57
ramishra_This is what the fix mentions "**Note** - Users that don't set ``packages``, ``py_modules``, or06:57
ramishra_``configuration`` are still likely to observe the auto-discovery behavior06:57
ysandeepyes, correct - we we are disabling auto-discovery with py_modules=[] 06:58
ramishra_that setuptools bug was closed without any details which is confusing06:59
ramishra_someone has to look at the fix to understand that they just changed it for 'configuration' in setup.py07:00
ysandeeplooks like the fix is for projects created with ``numpy.distutils.misc_util.Configuration` only.07:03
ysandeephttps://github.com/pypa/setuptools/pull/3211/files#diff-11a1a75d3bcabc0eb4270217920ef6c7a896d3daece7cc207d07dcfde09a5055R34407:03
-opendevstatus- NOTICE: zuul isn't executing check jobs at the moment, investigation is ongoing, please be patient07:19
*** jpena|off is now known as jpena07:39
*** soniya29|rover is now known as soniya29|rover|lunch07:41
*** ysandeep is now known as ysandeep|lunch07:49
*** ysandeep|lunch is now known as ysandeep08:45
bshepharI'll update those commit messages for tripleo-ansible and tripleo-upgrade08:47
ysandeephttps://review.opendev.org/c/openstack/tripleo-upgrade/+/835409/1#message-979e53a95249af917d784d91586ce4b8d0c657ca08:54
ysandeepUnable to freeze job graph: Job tripleo-ci-centos-9-scenario000-multinode-oooq-container-updates depends on tripleo-ci-centos-9-content-provider which was not run.08:54
ysandeepwe need to add ^setup.*$ here as well https://github.com/openstack/tripleo-upgrade/blob/master/zuul.d/layout.yaml#L27  because content-provider have that https://opendev.org/openstack/tripleo-ci/src/branch/master/zuul.d/base-upstream.yaml#L92  under irrelevant-files08:56
ysandeepcontent-provider parent*08:56
ysandeepwe have to do similiar for other job, ref: https://review.opendev.org/c/openstack/tripleo-ci/+/835193 08:57
ysandeepbshephar, marios|ruck ^^ 08:58
ysandeepbshephar: could you please update your tripleo-upgrade patch to include  ^setup.*$ under irrelevant-files list as well -  https://github.com/openstack/tripleo-upgrade/blob/master/zuul.d/layout.yaml#L27 08:59
marios|ruckysandeep: thanks09:03
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Merge nova_statedir_owner and libvirt containers  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83542109:09
*** soniya29|rover|lunch is now known as soniya29|rover09:18
ysandeeplooks like bshephar is away, I will update those patches so that we can clear check/gate blocker early09:19
opendevreviewSandeep Yadav proposed openstack/tripleo-upgrade master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-upgrade/+/83540909:31
ysandeepbshephar, I think we can keep tripleo-ansible commit as it is, as we already have two +2 to clear check early..09:36
opendevreviewSandeep Yadav proposed openstack/tripleo-heat-templates master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83542509:40
opendevreviewSandeep Yadav proposed openstack/tripleo-image-elements master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-image-elements/+/83542709:53
opendevreviewSandeep Yadav proposed openstack/tripleo-ha-utils master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-ha-utils/+/83542810:05
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Merge nova_statedir_owner and libvirt containers  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83542110:56
opendevreviewMerged openstack/tripleo-ha-utils master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-ha-utils/+/83542811:21
opendevreviewRajesh Tailor proposed openstack/tripleo-heat-templates master: Expose new paramter `NovaMDEVTypes`  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83543911:23
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Call container-registry role at required job level  https://review.opendev.org/c/openstack/tripleo-ci/+/83510111:30
opendevreviewRajesh Tailor proposed openstack/tripleo-heat-templates master: Deprecate `NovaVGPUTypesDeviceAddressesMapping parameter  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83544011:32
rlandyhjensas: hello - could we get your review on https://review.opendev.org/c/openstack/openstack-virtual-baremetal/+/83481311:40
rlandythis will need to backport to stable 2.0 for wallaby11:40
rlandythanks11:40
bshepharAh you guys already did it. Nice ysandeep++ rlandy++11:46
hjensasrlandy: oh, cool!11:49
opendevreviewBrendan Shephard proposed openstack/tripleo-ansible master: Use node UUID for bridge_mapping agent check  https://review.opendev.org/c/openstack/tripleo-ansible/+/83492611:51
ysandeepbshephar++ 11:51
*** dviroel|pto is now known as dviroel11:52
*** pojadhav is now known as pojadhav|afk11:59
opendevreviewDouglas Viroel proposed openstack/tripleo-docs master: Add initial doc for compose pinning dependency jobs  https://review.opendev.org/c/openstack/tripleo-docs/+/83495712:13
opendevreviewJohn Fulton proposed openstack/tripleo-quickstart-extras master: Add ceph-install playbook to install ceph before overcloud  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83435212:16
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Merge nova_statedir_owner and libvirt containers  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83542112:16
*** ysandeep is now known as ysandeep|afk12:25
*** dviroel is now known as dviroel|brb12:43
opendevreviewMerged openstack/tripleo-ansible master: Disable auto discovery as a workaround  https://review.opendev.org/c/openstack/tripleo-ansible/+/83541012:44
opendevreviewMerged openstack/tripleo-image-elements master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-image-elements/+/83542712:44
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: Allow user to override Ceph cluster name  https://review.opendev.org/c/openstack/python-tripleoclient/+/83537612:45
opendevreviewMerged openstack/tripleo-heat-templates master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83542512:45
opendevreviewHarald JensÃ¥s proposed openstack/tripleo-heat-templates master: Deprecate DnsServers THT parameter  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83524712:45
opendevreviewCedric Jeanneret proposed openstack/puppet-tripleo master: Correct typo on hieradata key  https://review.opendev.org/c/openstack/puppet-tripleo/+/83544612:55
opendevreviewBogdan Dobrelya proposed openstack/puppet-tripleo master: W/a broken target param for ssh config  https://review.opendev.org/c/openstack/puppet-tripleo/+/83544812:59
opendevreviewRajesh Tailor proposed openstack/tripleo-heat-templates master: Expose new paramter `NovaMDEVTypes`  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83543913:07
*** ysandeep|afk is now known as ysandeep13:14
*** dviroel|brb is now known as dviroel13:27
opendevreviewBogdan Dobrelya proposed openstack/puppet-tripleo master: W/a broken target param for ssh config  https://review.opendev.org/c/openstack/puppet-tripleo/+/83544813:41
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates master: Do no install ssh client packages  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83545413:47
opendevreviewDouglas Viroel proposed openstack/tripleo-docs master: Add initial doc for compose pinning dependency jobs  https://review.opendev.org/c/openstack/tripleo-docs/+/83495713:52
opendevreviewMatthias Runge proposed openstack/puppet-tripleo master: Drop support for collectd-gnocchi  https://review.opendev.org/c/openstack/puppet-tripleo/+/83433213:56
*** dasm|off is now known as dasm13:57
opendevreviewBogdan Dobrelya proposed openstack/puppet-tripleo master: Fix double declaration of ssh::server class  https://review.opendev.org/c/openstack/puppet-tripleo/+/83544814:02
*** pojadhav|afk is now known as pojadhav14:02
opendevreviewPooja Jadhav proposed openstack/tripleo-ci master: WIP : Ussuri tear down as EOL  https://review.opendev.org/c/openstack/tripleo-ci/+/83546014:06
opendevreviewKevin Carter proposed openstack/python-tripleoclient master: Move Ansible imports to correct UX Warnings  https://review.opendev.org/c/openstack/python-tripleoclient/+/83488214:17
sdanniHi folks! We deployed an overcloud controller but the DHCP service is not working properly. We get "DHCP connection timeout" during node inspection. The neutron dnsmasq container could receive a request but not submit an offer (we installed tcpdump on dnsmasq container). But if we run the same dnsmasq command on the controller itself it works. We assume it's a networking issue but have no clue to figure it out. Any suggestions?14:27
bshepharsdanni: Which version of tripleo are you running?14:44
sdannibshephar: wallaby14:44
bshepharDuring introspection, the DHCP offer comes from the ironic_inspector_dnsmasq service, during deployment it comes from the neutron dnsmasq service14:44
bshephar[stack@tripleo-director ~]$ sudo podman ps --filter name=dns --format "{{.Image}}  {{.Names}}"14:45
bshepharquay.io/tripleomaster/openstack-ironic-inspector:current-tripleo  ironic_inspector_dnsmasq14:45
bshepharquay.io/tripleomaster/openstack-neutron-dhcp-agent:current-tripleo  neutron-dnsmasq-qdhcp-12241903-36e6-4a66-aabd-832a96d56f0714:45
bshepharSo it sounds like you want to be checking the ironic dhcp logs?14:45
bshepharThe Neutron one should see the request, but not respond to it during introspection14:45
bshepharIf that container isn't running or something, that could explain your issue. Otherwise, the log file for it is: /var/log/containers/ironic-inspector/dnsmasq.log14:46
sdannibshephar: we turned off ironic_inspector and use in band inspection. It's using neutron, right?14:50
bshepharI'm not sure what in-band inspection is sorry?14:51
tzumainnbshephar, hi! in-band inspection is essentially when ironic controls inspection itself, similarly to how it does cleaning; so it ends up using a similar process of creating a neutron port, associating it with the baremetal port, etc14:52
*** amoralej|off is now known as amoralej14:53
tzumainnwe use that configuration in our standalone tripleo install14:53
tzumainnI guess what sdanni and I are confused about is why neutron dnsmasq wouldn't respond with an offer if it's run from the neutron dnsmasq container; but if we run the same dnsmasq on the contrller, it sends out an offer14:53
tzumainnand we were wondering if that pointed to any apparent networking issue14:54
bshepharI see: https://docs.openstack.org/ironic/wallaby/admin/inspection.html#in-band-inspection   14:54
bshepharI guess there is no lease being created in the Neutron dnsmasq config. But I don't have any experience using in-band inspection to know enough about it sorry14:54
tzumainnbshephar, no problem! we see entries in /var/lib/neutron/dhcp for the correct mac address and port though, so it seems like something's being created there14:57
bogdandohjensas: ^^14:57
bogdandowrt in-band inspection14:57
sdannibshephar: thank you anyway!14:57
bshepharNo worries. I'll be interested to know what the problem is. I'll have to test it out myself to see how it works14:58
*** artom__ is now known as artom15:03
ysandeepmarios|ruck, rlandy: I have discussed c8 wallaby coverage in checkpoint call today, the suggestion was to keep one job which really test overcloud (and not only undercloud) as minimum set for c8 wallaby coverage. People on call have suggestion that atleast vanilla standalone job should run for both c8 and c9 for wallaby in check/gate.15:13
ysandeepslagle: fyi ^^.. 15:14
rlandywill recheck after prodchain call15:19
*** marios|ruck is now known as marios|ruck|call15:23
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/train: Ensure cell0 database uri is correct  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83547415:52
opendevreviewBogdan Dobrelya proposed openstack/tripleo-heat-templates stable/train: Ensure cell0 database uri is correct  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83547416:00
opendevreviewArx Cruz proposed openstack/tripleo-quickstart-extras master: Override image.http_image on tempestconf  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83547516:01
*** marios|ruck|call is now known as marios|ruck16:03
hjensastzumainn: With in-band inspeciton you should see entries in /var/lib/neutron/dhcp. Do you see neutron's dnsmasq responding NO ADDR AVAILABLE ?16:10
hjensastzumainn: does other operations work, for example cleaning? (I guess not, since it is the same process.)16:11
tzumainnhjensas, we do see the entries in /var/lib/neutron/dhcp, but we don't see any response from neutron's dnsmasq16:11
tzumainntcpdump shows that it does see the request from the correct mac address however16:12
hjensastzumainn: did you tcpdump in the neutron dnsmasq namespace?16:12
tzumainnhjensas, yep!16:12
*** dviroel is now known as dviroel|lunch16:13
hjensastzumainn: ok, strange. Do you see any logs for neuton's dnsmasq? 'journalctl | grep dnsmasq-dhcp' ?16:13
*** marios|ruck is now known as marios|out16:15
tzumainnhjensas, yep, there's a bunch of stuff there, let me read through it - anything in particular I should look out for?16:19
*** ysandeep is now known as ysandeep|out16:20
*** jbadiapa is now known as jbadiapa|off16:30
opendevreviewMerged openstack/tripleo-quickstart-extras master: Set ceph container variables if defined in job  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83455616:48
opendevreviewMerged openstack/tripleo-ci master: Add Ceph standalone periodic jobs (001 and 004)  https://review.opendev.org/c/openstack/tripleo-ci/+/83467816:48
opendevreviewMerged openstack/tripleo-upgrade master: Disable auto discovery  https://review.opendev.org/c/openstack/tripleo-upgrade/+/83540916:48
*** jpena is now known as jpena|off16:52
*** dviroel|lunch is now known as dviroel16:55
opendevreviewDouglas Viroel proposed openstack/tripleo-quickstart-extras master: DNM - Set dependency vars in subnodes  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83497216:58
opendevreviewMerged openstack/tripleo-heat-templates stable/ussuri: Etcd: Update cluster membership when replacing a node  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83530517:05
*** amoralej is now known as amoralej|off17:51
opendevreviewJohn Fulton proposed openstack/tripleo-quickstart-extras master: Add ceph-install playbook to install ceph before overcloud  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83435218:11
opendevreviewMatthias Runge proposed openstack/puppet-tripleo master: Drop support for collectd-gnocchi  https://review.opendev.org/c/openstack/puppet-tripleo/+/83433218:22
opendevreviewAlan Bishop proposed openstack/tripleo-heat-templates stable/train: Etcd: Update cluster membership when replacing a node  https://review.opendev.org/c/openstack/tripleo-heat-templates/+/83548518:25
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: cephadm support for 'openstack overcloud export ceph'  https://review.opendev.org/c/openstack/python-tripleoclient/+/83551119:56
opendevreviewRafael Castillo proposed openstack/tripleo-quickstart-extras master: Upgrade pytest-metadata  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83551320:30
*** dviroel is now known as dviroel|out20:30
opendevreviewJohn Fulton proposed openstack/python-tripleoclient master: cephadm support for 'openstack overcloud export ceph'  https://review.opendev.org/c/openstack/python-tripleoclient/+/83551120:59
opendevreviewKevin Carter proposed openstack/tripleo-ansible master: Set the log_level opt  https://review.opendev.org/c/openstack/tripleo-ansible/+/83551921:13
opendevreviewJohn Fulton proposed openstack/tripleo-operator-ansible master: Add implicit --yes to tripleo_ceph_user disable role  https://review.opendev.org/c/openstack/tripleo-operator-ansible/+/83552021:20
opendevreviewJohn Fulton proposed openstack/tripleo-quickstart-extras master: Add ceph-install playbook to install ceph before overcloud  https://review.opendev.org/c/openstack/tripleo-quickstart-extras/+/83435221:21
fultonjgit log21:21
fultonjwhops21:22
opendevreviewRonelle Landy proposed openstack/tripleo-ci master: Call container-registry role at required job level  https://review.opendev.org/c/openstack/tripleo-ci/+/83510121:55
*** rlandy is now known as rlandy|out22:55
*** pmannidi|Away is now known as pmannidi23:36

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!