| rdogerrit | Bhagyashri Shewale proposed rdo-jobs master: Add periodic-edpm-container-image-quay-push job for master and antelope https://review.rdoproject.org/r/c/rdo-jobs/+/49362 | 05:56 |
|---|---|---|
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for yoga-8s-testing https://review.rdoproject.org/r/c/rdoinfo/+/49631 | 06:16 |
| rdogerrit | Merged rdoinfo master: Promote CBS tags update for yoga-9s-testing https://review.rdoproject.org/r/c/rdoinfo/+/49629 | 06:16 |
| rdogerrit | Merged nfvinfo master: Promote CBS tags update for nfvsig-openvswitch3.1-testing https://review.rdoproject.org/r/c/nfvinfo/+/49435 | 06:31 |
| rdogerrit | Merged nfvinfo master: Promote CBS tags update for nfvsig-openvswitch2.17-testing https://review.rdoproject.org/r/c/nfvinfo/+/49630 | 06:31 |
| rdogerrit | Merged openstack/ironic-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-distgit/+/49508 | 06:34 |
| rdogerrit | Karolina Kula proposed openstack/ironic-ui-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-ui-distgit/+/49626 | 07:00 |
| rdogerrit | Karolina Kula proposed openstack/ironic-inspector-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-inspector-distgit/+/49554 | 07:08 |
| rdogerrit | Merged openstack/sahara-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/sahara-distgit/+/49593 | 07:29 |
| rdogerrit | Alfredo Moralejo proposed openstack/octavia-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/octavia-tempest-plugin-distgit/+/49623 | 07:55 |
| rdogerrit | Joel Capitao proposed openstack/oslo-sphinx-distgit rpm-master: Initialize git repo during setup https://review.rdoproject.org/r/c/openstack/oslo-sphinx-distgit/+/49632 | 08:07 |
| rdogerrit | Joel Capitao proposed openstack/trove-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/trove-distgit/+/49480 | 08:09 |
| rdogerrit | Joel Capitao proposed openstack/oslo-sphinx-distgit rpm-master: Initialize git repo during setup https://review.rdoproject.org/r/c/openstack/oslo-sphinx-distgit/+/49632 | 08:17 |
| rdogerrit | Alfredo Moralejo proposed openstack/octavia-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/octavia-tempest-plugin-distgit/+/49623 | 08:27 |
| rdogerrit | Bhagyashri Shewale proposed rdo-jobs master: Add periodic-edpm-container-image-quay-push job for master and antelope https://review.rdoproject.org/r/c/rdo-jobs/+/49362 | 08:30 |
| rdogerrit | Bhagyashri Shewale proposed rdo-jobs master: Add periodic-edpm-container-image-quay-push job for master and antelope https://review.rdoproject.org/r/c/rdo-jobs/+/49362 | 08:32 |
| rdogerrit | Joel Capitao proposed openstack/os-faults-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/os-faults-distgit/+/49633 | 08:35 |
| rdogerrit | Joel Capitao proposed openstack/os-testr-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/os-testr-distgit/+/49634 | 08:40 |
| rdogerrit | Joel Capitao proposed openstack/swift-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/swift-distgit/+/49635 | 08:42 |
| rdogerrit | Alfredo Moralejo proposed openstack/octavia-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/octavia-tempest-plugin-distgit/+/49623 | 08:44 |
| rdogerrit | Merged openstack/octavia-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/octavia-tempest-plugin-distgit/+/49623 | 09:24 |
| rdogerrit | Joel Capitao proposed openstack/heat-translator-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/heat-translator-distgit/+/49636 | 09:42 |
| rdogerrit | Karolina Kula proposed openstack/heat-dashboard-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/heat-dashboard-distgit/+/49507 | 09:49 |
| rdogerrit | Joel Capitao proposed openstack/trove-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/trove-distgit/+/49480 | 09:50 |
| rdogerrit | Karolina Kula proposed openstack/ironic-ui-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-ui-distgit/+/49626 | 10:00 |
| rdogerrit | Joel Capitao proposed openstack/trove-distgit rpm-master: Remove taskmanager and conductor config files https://review.rdoproject.org/r/c/openstack/trove-distgit/+/49637 | 10:06 |
| rdogerrit | Joel Capitao proposed openstack/sahara-tests-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/sahara-tests-distgit/+/49638 | 10:15 |
| rdogerrit | Joel Capitao proposed openstack/zaqar-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/zaqar-tempest-plugin-distgit/+/49639 | 10:21 |
| rdogerrit | Joel Capitao proposed openstack/watcher-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/watcher-tempest-plugin-distgit/+/49640 | 10:24 |
| rdogerrit | Joel Capitao proposed openstack/vitrage-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/vitrage-tempest-plugin-distgit/+/49641 | 10:27 |
| rdogerrit | Karolina Kula proposed openstack/ironic-ui-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-ui-distgit/+/49626 | 10:27 |
| rdogerrit | Joel Capitao proposed openstack/sahara-tests-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/sahara-tests-distgit/+/49638 | 10:28 |
| rdogerrit | Joel Capitao proposed openstack/trove-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/trove-tempest-plugin-distgit/+/49642 | 10:30 |
| rdogerrit | rdo-trunk rdo-trunk proposed puppet/puppet-glance-distgit yoga-rdo: puppet-glance-20.4.0-1 https://review.rdoproject.org/r/c/puppet/puppet-glance-distgit/+/49643 | 10:56 |
| rdogerrit | Bhagyashri Shewale proposed rdo-jobs master: Add periodic-edpm-container-image-quay-push job for master and antelope https://review.rdoproject.org/r/c/rdo-jobs/+/49362 | 11:27 |
| rdogerrit | Karolina Kula proposed openstack/ironic-ui-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-ui-distgit/+/49626 | 11:34 |
| rdogerrit | Merged puppet/puppet-glance-distgit yoga-rdo: puppet-glance-20.4.0-1 https://review.rdoproject.org/r/c/puppet/puppet-glance-distgit/+/49643 | 11:42 |
| rdogerrit | Joel Capitao proposed openstack/trove-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/trove-tempest-plugin-distgit/+/49642 | 11:48 |
| ykarel | amoralej, you got chance to look at rdo-release 2023.1 vs antelope issue? | 11:50 |
| rdogerrit | Karolina Kula proposed openstack/heat-dashboard-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/heat-dashboard-distgit/+/49507 | 11:52 |
| amoralej | ykarel, actually not... | 11:58 |
| amoralej | jcapitao[m], where do we manage redirects for rdo-release ? | 12:09 |
| amoralej | could we create redirects for 2023.1 pointing to antelope? | 12:10 |
| amoralej | see https://review.opendev.org/c/openstack/devstack/+/890120 | 12:10 |
| jcapitao[m] | amoralej: in sf-infra | 12:14 |
| jcapitao[m] | https://github.com/softwarefactory-project/sf-infra/blob/master/roles/osci/websites/tasks/vhosts.yml | 12:14 |
| jcapitao[m] | yes we can | 12:15 |
| jcapitao[m] | lemme check | 12:15 |
| amoralej | jcapitao[m], ykarel btw i'm sending the revert of the old hack https://review.opendev.org/c/openstack/devstack/+/890644 | 12:20 |
| amoralej | i'll test it with dnm in neutron too | 12:20 |
| ykarel | amoralej, if it's just centos-9 stream test devstack-platform-centos-9-stream job runs on that patch | 12:21 |
| amoralej | yes, but i want to test it with fips | 12:22 |
| ykarel | ok got it | 12:22 |
| amoralej | which was the real issue where it failed without the fix | 12:22 |
| ykarel | fips jobs runs in periodic/experimental pipeline in neutron | 12:22 |
| amoralej | yep | 12:23 |
| amoralej | https://review.opendev.org/c/openstack/neutron/+/890645 | 12:23 |
| amoralej | i just triggered experimental | 12:23 |
| ykarel | thx | 12:24 |
| ykarel | amoralej, and for stable/2023.1 rpm how you planning to fix? | 12:24 |
| amoralej | ykarel, yes, see my previous question to jcapitao[m] | 12:25 |
| jcapitao[m] | amoralejykarel https://softwarefactory-project.io/r/c/software-factory/sf-infra/+/29060 | 12:25 |
| ykarel | amoralej, jcapitao[m] thanks | 12:26 |
| *** elvira2 is now known as elvira | 12:28 | |
| jcapitao[m] | amoralej: wrt puppet-nova latest yoga release, infra is hitting an issue while uploading the built archive to Puppet forge | 12:34 |
| amoralej | damn | 12:35 |
| amoralej | you mean upstream, right? | 12:35 |
| amoralej | there is mail in openstack-discuss ? | 12:35 |
| jcapitao[m] | yep upstream | 12:35 |
| jcapitao[m] | https://zuul.openstack.org/builds?project=openstack%2Fpuppet-nova&pipeline=release&skip=0 | 12:35 |
| jcapitao[m] | amoralej: fungi rerun the job several time but the upload fails with consistency | 12:37 |
| fungi | well, several times on the same day | 12:37 |
| amoralej | with different puppet modules? | 12:37 |
| fungi | it's possible puppetforge has fixed some problem which was breaking the upload of that specific module | 12:37 |
| fungi | amoralej: only puppet-nova seems to be affected, perhaps because of its much larger size than other modules? | 12:38 |
| amoralej | yeah, that'd make sense | 12:38 |
| amoralej | murphy's law make that it's exactly the update we need to unbreak jobs on centos9 :) | 12:38 |
| rdogerrit | Merged openstack/vitrage-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/vitrage-tempest-plugin-distgit/+/49641 | 12:38 |
| fungi | the error we get is an eof in the socket stream, so could be happening at the very start of the upload or a long time into it, hard to be sure | 12:39 |
| rdogerrit | Merged openstack/trove-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/trove-tempest-plugin-distgit/+/49642 | 12:39 |
| jcapitao[m] | yep.. | 12:40 |
| amoralej | fungi, so, iiuc, there is no fix yet in puppetforge, right? | 12:40 |
| amoralej | last attempt i see is from 3-aug | 12:40 |
| fungi | might be some byte pattern in that blob triggering a false positive for some inline security proxy they're managing, or a middlebox that has trouble with chunked encoding for very large uploads, or who knows | 12:40 |
| fungi | amoralej: right, i retried it a couple of time on the day it failed, but can try it again now | 12:41 |
| amoralej | i'd appreciate, just in case | 12:41 |
| fungi | it's been enqueued again now | 12:41 |
| amoralej | thanks! | 12:41 |
| rdogerrit | Merged openstack/sahara-tests-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/sahara-tests-distgit/+/49638 | 12:42 |
| rdogerrit | Merged openstack/watcher-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/watcher-tempest-plugin-distgit/+/49640 | 12:42 |
| rdogerrit | Merged openstack/zaqar-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/zaqar-tempest-plugin-distgit/+/49639 | 12:44 |
| rdogerrit | Merged openstack/heat-translator-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/heat-translator-distgit/+/49636 | 12:52 |
| fungi | amoralej: jcapitao[m]: no dice, same error again | 12:52 |
| amoralej | so, there is anything we can do?, are puppet guys aware of the issue? | 12:53 |
| fungi | another thing i noticed, the uploader the release job uses calls puppetforge urls with a "v2" api path, but there seems to be a "v3" api in use. no idea why that would just affect the puppet-nova upload though (probably doesn't) | 12:54 |
| fungi | amoralej: if by "puppet guys" you mean the puppet-openstack team, i expect so | 12:54 |
| amoralej | from our side, i think we may move this package to pull the tarball from github tag | 12:54 |
| amoralej | no, i meant the puppetforge team | 12:54 |
| amoralej | it may be something it their side of the cable iiuc | 12:55 |
| fungi | i don't personally have any contacts at puppetforge, but i also do nothing at all with puppet. presumable people on the puppet-openstack team have some contacts in that ecosystem | 12:55 |
| amoralej | lemme ask | 12:55 |
| fungi | i assume people who are using/developing puppet modules could test building puppet-nova 20.4.1 and uploading a copy to an account at puppetforge manually to see if they can recreate the issue | 12:56 |
| amoralej | yep, i was wondering if that is possible | 12:58 |
| rdogerrit | Merged openstack/trove-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/trove-distgit/+/49480 | 12:58 |
| amoralej | fungi, in that case we'd need to get it push it to tarballs.openstack.org too | 12:58 |
| amoralej | which is actually where we pull it from | 12:59 |
| fungi | i think the job does both of those, but only pushes a copy to tarballs.o.o if the puppetforge upload fails | 12:59 |
| fungi | er, i mean succeeds | 12:59 |
| fungi | if puppetforge upload fails, the job stops before pushing a copy to tarballs.o.o (presumably to make it easier to rerun in the event of a transient failure) | 13:00 |
| amoralej | yep, that make sense | 13:00 |
| amoralej | my doubt is how to manage that in case puppet-openstack team pushes manually to puppetforge | 13:00 |
| fungi | amoralej: the other possibly relevant factors specific to those jobs are that the upload happens from our zuul executor servers, which are currently ubuntu jammy (22.04 lts) virtual machines in rackspace's dfw region | 13:00 |
| amoralej | maybe the job is clever enough to skip the push to pupet force and push it to tarballs.o.o | 13:01 |
| fungi | amoralej: oh, i wasn't suggesting pushing manually to the official puppetforge account, just trying to upload to another account to see if the error can be recreated outside the ci system, to make bug reporting to puppetforge admins easier | 13:01 |
| amoralej | ah, ok | 13:02 |
| amoralej | i missunderstood then | 13:02 |
| fungi | thinking through what sort of information the puppetforge admins are likely to need in order to look into the problem | 13:02 |
| amoralej | yep, that may be helpful | 13:03 |
| jcapitao[m] | I'm reading puppetforge doc | 13:04 |
| jcapitao[m] | "The module package must be a compiled tar.gz package of 10MB or less." | 13:04 |
| jcapitao[m] | from https://www.puppet.com/docs/puppet/5.5/modules_publishing.html#task-4020 | 13:04 |
| jcapitao[m] | puppet-nova is ~16MB | 13:04 |
| amoralej | that's the git repo size? | 13:05 |
| amoralej | or tarball ? | 13:05 |
| jcapitao[m] | tarball | 13:05 |
| jcapitao[m] | I get it from the Zuul job | 13:05 |
| jcapitao[m] | https://ef307f020103ee2d2a1b-594e2b182145c9c989109e5862503d2d.ssl.cf5.rackcdn.com/d7598a1ef2e7b9c1fd037360f5bbe8378e9d3bab/release/release-openstack-puppet/6057ca1/job-output.txt | 13:05 |
| jcapitao[m] | "size": 15851936, | 13:06 |
| jcapitao[m] | but tarballs exceed 10MB since 20.3.0 release and it's available in puppetforge so ... | 13:08 |
| amoralej | i see recent puppet-glance, swift and ceilometer are ~3MB | 13:08 |
| amoralej | it may make sense | 13:08 |
| amoralej | tkajinam, fungi ^ | 13:09 |
| amoralej | wrt size | 13:09 |
| fungi | yeah, that seems like a good possibility. maybe their size limit is actually a bit above 10mb but they call it 10mb just to make sure people stay under the actual limit? | 13:10 |
| amoralej | looks like a good hypothesys | 13:10 |
| amoralej | 20.4.1 passed on second attempt on 17-june, but we don't have logs | 13:11 |
| rdogerrit | Merged openstack/swift-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/swift-distgit/+/49635 | 13:12 |
| rdogerrit | Merged openstack/os-testr-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/os-testr-distgit/+/49634 | 13:12 |
| fungi | amoralej: we have logs, just not build logs. i found the irc channel logs where we talked about that failure and it was something totally different | 13:13 |
| amoralej | ok | 13:13 |
| rdogerrit | Karolina Kula proposed openstack/ironic-ui-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-ui-distgit/+/49626 | 13:14 |
| fungi | amoralej: https://meetings.opendev.org/irclogs/%23openstack-release/%23openstack-release.2023-06-15.log.html#t2023-06-15T20:50:46 | 13:14 |
| rdogerrit | Karolina Kula proposed openstack/ironic-inspector-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-inspector-distgit/+/49554 | 13:16 |
| *** amoralej is now known as amoralej|lunch | 13:30 | |
| rdogerrit | Merged openstack/heat-dashboard-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/heat-dashboard-distgit/+/49507 | 13:32 |
| rdogerrit | Merged openstack/os-faults-distgit rpm-master: Get rid of pathfix https://review.rdoproject.org/r/c/openstack/os-faults-distgit/+/49633 | 13:32 |
| rdogerrit | Merged openstack/kuryr-tempest-plugin-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/kuryr-tempest-plugin-distgit/+/49614 | 13:53 |
| *** amoralej|lunch is now known as amoralej | 13:54 | |
| rdogerrit | Merged openstack/ironic-inspector-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/ironic-inspector-distgit/+/49554 | 14:04 |
| rdogerrit | Joel Capitao proposed openstack/horizon-distgit rpm-master: Switch to pyproject-rpm-macros https://review.rdoproject.org/r/c/openstack/horizon-distgit/+/49535 | 14:48 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 20:31 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 20:43 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 20:48 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 20:54 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 21:06 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 21:14 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 22:55 |
| rdogerrit | Ronelle Landy proposed rdo-jobs master: DNM - Test dlrn report https://review.rdoproject.org/r/c/rdo-jobs/+/49644 | 23:04 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!