| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-python: pull in venv package on Debuntu https://review.opendev.org/c/zuul/zuul-jobs/+/850957 | 00:19 |
|---|---|---|
| opendevreview | Ian Wienand proposed openstack/project-config master: translation updates: refactor Python 3.8 workarounds https://review.opendev.org/c/openstack/project-config/+/850962 | 01:08 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-python: pull in venv package on Debuntu https://review.opendev.org/c/zuul/zuul-jobs/+/850957 | 01:16 |
| opendevreview | Ian Wienand proposed openstack/project-config master: translation updates: refactor Python 3.8 workarounds https://review.opendev.org/c/openstack/project-config/+/850962 | 01:22 |
| *** ysandeep|out is now known as ysandeep | 01:55 | |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-python: pull in venv package on Debuntu https://review.opendev.org/c/zuul/zuul-jobs/+/850957 | 03:00 |
| opendevreview | Ian Wienand proposed openstack/project-config master: translation updates: refactor Python 3.8 workarounds https://review.opendev.org/c/openstack/project-config/+/850962 | 03:03 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-python: pull in venv package on Debuntu https://review.opendev.org/c/zuul/zuul-jobs/+/850957 | 03:13 |
| *** ysandeep is now known as ysandeep|afk | 03:21 | |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-python: pull in venv package on Debuntu https://review.opendev.org/c/zuul/zuul-jobs/+/850957 | 03:22 |
| *** Guest6022 is now known as rcastillo | 04:22 | |
| opendevreview | Ian Wienand proposed openstack/project-config master: translation updates: refactor Python 3.8 workarounds https://review.opendev.org/c/openstack/project-config/+/850962 | 04:55 |
| *** ysandeep|afk is now known as ysandeep | 05:03 | |
| *** jpena|off is now known as jpena | 07:34 | |
| *** jpena is now known as jpena|off | 07:40 | |
| *** jpena|off is now known as jpena | 07:42 | |
| *** ysandeep is now known as ysandeep|afk | 08:02 | |
| *** pojadhav is now known as pojadhav|lunch | 08:06 | |
| *** pojadhav|lunch is now known as pojadhav | 08:19 | |
| *** tosky_ is now known as tosky | 09:10 | |
| *** rlandy|out is now known as rlandy | 10:34 | |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: fix spaces between filters https://review.opendev.org/c/zuul/zuul-jobs/+/851014 | 10:51 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: add names to blocks https://review.opendev.org/c/zuul/zuul-jobs/+/851015 | 10:51 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: rename loop variable https://review.opendev.org/c/zuul/zuul-jobs/+/851016 | 10:51 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: update to ansible-lint 6 https://review.opendev.org/c/zuul/zuul-jobs/+/851017 | 10:51 |
| *** marios_ is now known as marios | 11:00 | |
| *** dviroel__ is now known as dviroel | 11:05 | |
| fungi | python 3.11.0b5 is out now. next stop: release candidates! | 12:04 |
| *** ysandeep|afk is now known as ysandeep | 12:30 | |
| *** dasm|off is now known as dasm | 13:19 | |
| opendevreview | Slawek Kaplonski proposed openstack/project-config master: Add new project "tripleo-neutron-tempest-plugin" in the x/ namespace https://review.opendev.org/c/openstack/project-config/+/851031 | 13:39 |
| opendevreview | Slawek Kaplonski proposed openstack/project-config master: Add new project "tripleo-neutron-tempest-plugin" in the x/ namespace https://review.opendev.org/c/openstack/project-config/+/851031 | 14:07 |
| opendevreview | Slawek Kaplonski proposed openstack/project-config master: Add new project "tripleo-neutron-tempest-plugin" in the x/ namespace https://review.opendev.org/c/openstack/project-config/+/851031 | 14:37 |
| opendevreview | Slawek Kaplonski proposed openstack/project-config master: Add new project "tripleo-neutron-tempest-plugin" in the x/ namespace https://review.opendev.org/c/openstack/project-config/+/851031 | 14:43 |
| *** dviroel is now known as dviroel|lunch | 14:55 | |
| *** ysandeep is now known as ysandeep|out | 15:00 | |
| clarkb | fungi: ianw: I guess 850957 is a low impact change to maybe address the issue 850917 is tryingto solve? | 15:27 |
| clarkb | there are a number of changes related to that from overnight and I'm wondering what the path of least resistance is | 15:27 |
| fungi | clarkb: i'll admit i haven't been able to look at them closely enough yet | 15:42 |
| *** dviroel|lunch is now known as dviroel | 16:01 | |
| *** marios is now known as marios|out | 16:16 | |
| *** jpena is now known as jpena|off | 16:33 | |
| ianw | clarkb: right, 850957 is required by https://review.opendev.org/c/openstack/project-config/+/850962 which hopefully explains it | 19:02 |
| clarkb | aha thats the piece I was missing. Will review post meeting | 19:03 |
| opendevreview | Merged zuul/zuul-jobs master: ensure-python: pull in venv package on Debuntu https://review.opendev.org/c/zuul/zuul-jobs/+/850957 | 19:27 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: fix spaces between filters https://review.opendev.org/c/zuul/zuul-jobs/+/851014 | 19:53 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: add names to blocks https://review.opendev.org/c/zuul/zuul-jobs/+/851015 | 19:53 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: rename loop variable https://review.opendev.org/c/zuul/zuul-jobs/+/851016 | 19:53 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: update to ansible-lint 6 https://review.opendev.org/c/zuul/zuul-jobs/+/851017 | 19:53 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: upload-artifactory: fix version comparision https://review.opendev.org/c/zuul/zuul-jobs/+/851087 | 19:53 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: setup.py: override modules to stop auto-detection https://review.opendev.org/c/zuul/zuul-jobs/+/851088 | 19:53 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: test/upload-pypi : install venv https://review.opendev.org/c/zuul/zuul-jobs/+/851089 | 19:53 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: test/upload-pypi : install venv https://review.opendev.org/c/zuul/zuul-jobs/+/851089 | 20:08 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: fix spaces between filters https://review.opendev.org/c/zuul/zuul-jobs/+/851014 | 20:08 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: add names to blocks https://review.opendev.org/c/zuul/zuul-jobs/+/851015 | 20:08 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: rename loop variable https://review.opendev.org/c/zuul/zuul-jobs/+/851016 | 20:08 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: linters: update to ansible-lint 6 https://review.opendev.org/c/zuul/zuul-jobs/+/851017 | 20:08 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-kubernetes: install cri-dockerd https://review.opendev.org/c/zuul/zuul-jobs/+/851093 | 20:33 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Run our base playbook on jammy https://review.opendev.org/c/opendev/system-config/+/851094 | 20:40 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-kubernetes: install cri-dockerd https://review.opendev.org/c/zuul/zuul-jobs/+/851093 | 21:03 |
| clarkb | ianw: I'm looking at https://review.opendev.org/c/openstack/project-config/+/850962 and it modifies jobs on both focal and bionic but I think maybe we only want ot update the jobs on bionic? Specifically I'm worried we'll break the requirements update jobs on focal. But maybe the work in the pre.yaml playbook is happy for both? | 21:16 |
| clarkb | oh except the new bits are only for bionic. I think maybe we need to keep the focal job the sam ethen? | 21:17 |
| clarkb | ya I'll leave a note | 21:18 |
| ianw | clarkb: i think the focal path should be the same, effectively? | 21:18 |
| clarkb | ianw: we won't install python3.8 on the focal job if I read it correctly | 21:18 |
| clarkb | I just posted a comment | 21:19 |
| ianw | right, but we don't need to do that on focal? | 21:19 |
| clarkb | we do because the requirements jobs are trying to build requirements for both 3.8 and 3.9 | 21:19 |
| clarkb | thats what the comment on line 827 is about | 21:19 |
| ianw | well i'm not sure, i don't see where python3.9 was being installed | 21:20 |
| clarkb | on line 836 of the old diff in the job def | 21:21 |
| ianw | oh hrm. i think you're right, but actually it's from line 834 | 21:22 |
| clarkb | but I think the vars are merged into child jobs so we have to split the inheritance maybe? | 21:23 |
| clarkb | I'm not actually sur ehow to fix this immediately | 21:23 |
| ianw | setting python_version will pull in the python3.9 packages | 21:25 |
| *** rlandy is now known as rlandy|biab | 21:27 | |
| ianw | setting python_version on the job i think really confuses the matter over what's going on. because it's still using python 3.8 too | 21:28 |
| opendevreview | Ian Wienand proposed openstack/project-config master: [dnm] additional discussion for requirements proposal https://review.opendev.org/c/openstack/project-config/+/851098 | 21:35 |
| ianw | clarkb / fungi: ^ i think we probably want to squash that change into it? i think this makes it clearer overall what's going on | 21:36 |
| opendevreview | Clark Boylan proposed opendev/system-config master: Run our base playbook on jammy https://review.opendev.org/c/opendev/system-config/+/851094 | 21:36 |
| fungi | lookin | 21:36 |
| clarkb | ianw: I think that is still not installing python3.8 on focal though? | 21:38 |
| ianw | for focal 3.8 is the base python which will be installed | 21:38 |
| clarkb | I guess it is the default on focal so maybe its already there? | 21:38 |
| clarkb | ya that | 21:38 |
| clarkb | and ya I think squashing is a good idea to avoid any further confusion with additional job failures if we land the two changes apart from each other | 21:39 |
| ianw | ++ | 21:39 |
| fungi | a big continued concern of mine is that the requirements proposal jobs would be better run separately per interpreter version and combined after rather than trying to combine multiple versions in a single run | 21:42 |
| fungi | a lot of the inherent complexity is trying to find ways to do it all in a single build | 21:43 |
| ianw | ++++++++++++ | 21:43 |
| ianw | multiple people proposing changes to install multiple interpreters on multiple platforms via multiple roles has created quite the matrix | 21:45 |
| ianw | (not "throwing shade" ... everyone just trying to get things to work with the information we have at the time) | 21:48 |
| fungi | well, it nearly came to a head this past openstack cycle when for a bit we were faced with a need to build requirements from python versions which we couldn't sanely install all of on a single platform | 21:48 |
| fungi | ianw: anyway, in the near term, sure it seems like a way forward if we mash that in | 21:50 |
| opendevreview | Ian Wienand proposed openstack/project-config master: translation updates: refactor Python 3.8 workarounds https://review.opendev.org/c/openstack/project-config/+/850962 | 21:54 |
| ianw | ^ that squashes everything, and adds another few paragraphs of changelog description | 21:55 |
| ianw | as if it wasn't long enough | 21:55 |
| clarkb | it was definitely easier when all we had to worry about was python2.7 and a 3.x version | 21:55 |
| ianw | thanks for picking that up though! | 21:59 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-kubernetes: install cri-dockerd https://review.opendev.org/c/zuul/zuul-jobs/+/851093 | 22:03 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-kubernetes: install cri-dockerd https://review.opendev.org/c/zuul/zuul-jobs/+/851093 | 22:14 |
| *** dasm is now known as dasm|off | 22:17 | |
| opendevreview | Clark Boylan proposed zuul/zuul-jobs master: DNM check if this fixes artifactory testing https://review.opendev.org/c/zuul/zuul-jobs/+/851101 | 22:24 |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-kubernetes: install cri-dockerd https://review.opendev.org/c/zuul/zuul-jobs/+/851093 | 22:26 |
| clarkb | nb01 and nb02 both appear t ohave full /opts so ansible is unhappy with them. nb03 is not responding to ssh as well ( Iwonder if if those hosts finally got cleaned up?) I'm going to stop the nodepool builders on nb01 and nb02 and clean them up | 22:26 |
| clarkb | I think we have a lot more fedora-35 images in /opt/nodepool_dib on both nb01 and nb02 than we really should have | 22:33 |
| clarkb | Once I've done the typicaly cleanup I'll look at those images and see if maybe nodepool leaked them | 22:33 |
| clarkb | Error loading json data from image build /nodepool/images/fedora-35/builds/0000007464 I'll manually delete that node | 22:36 |
| clarkb | I've removed the problematic znode and resetarted builders after clearing out /opt/dib_tmp | 22:44 |
| clarkb | I believe the builders are chewing through the fedora-35 images in zk and cleaning them up now, but it may take some time | 22:45 |
| clarkb | was 500 images a couple of minutes ago and now down to 491. Only a small faction of which are taking up disk space | 22:45 |
| clarkb | and now it is caught up and happy and disks have room | 22:51 |
| clarkb | now to look at nb03 | 22:51 |
| clarkb | openstack apis are still there. nb03 and mirror are both in a shutoff state. Going to try startingthem now | 22:53 |
| clarkb | and now nb03 is up and running a builder. I think that concludes the "why is our nodepool deploy job failing" debugging | 22:55 |
| fungi | last week i saw deploy jobs failing and nb03 in shutoff was the cause | 22:58 |
| fungi | openstack server start brought it right up | 22:58 |
| clarkb | yup that is what I did, but also nb01 and nb02 were unhappy because fedora-35 builds weren't pruning and filled the disks | 22:59 |
| opendevreview | Merged openstack/project-config master: translation updates: refactor Python 3.8 workarounds https://review.opendev.org/c/openstack/project-config/+/850962 | 23:07 |
| *** rlandy|biab is now known as rlandy | 23:17 | |
| opendevreview | Ian Wienand proposed zuul/zuul-jobs master: ensure-kubernetes: install cri-dockerd https://review.opendev.org/c/zuul/zuul-jobs/+/851093 | 23:23 |
| clarkb | service coordinator election email sent | 23:26 |
| *** dviroel is now known as dviroel|out | 23:29 | |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!