| *** rlandy|ruck2 has quit IRC | 00:01 | |
| mnaser | mordred: yeah it might be a little odd to expose them, however, we could mark them as community images and be referenced by uuid | 00:04 |
|---|---|---|
| mnaser | but not available in listing | 00:04 |
| *** rfolco has quit IRC | 00:28 | |
| *** yamamoto has joined #openstack-infra | 00:33 | |
| *** armax has quit IRC | 00:50 | |
| *** yamamoto_ has joined #openstack-infra | 00:59 | |
| *** yamamoto has quit IRC | 00:59 | |
| EmilienM | fungi: thanks! I got plenty of examples. | 01:03 |
| *** Goneri has quit IRC | 01:07 | |
| *** yamamoto_ has quit IRC | 01:11 | |
| *** pkopec has quit IRC | 01:17 | |
| *** yamamoto has joined #openstack-infra | 01:21 | |
| *** factor__ has quit IRC | 01:53 | |
| *** factor__ has joined #openstack-infra | 01:53 | |
| *** gyee has quit IRC | 01:58 | |
| *** yamamoto has quit IRC | 02:00 | |
| *** factor__ has quit IRC | 02:02 | |
| *** jamesmcarthur has joined #openstack-infra | 02:02 | |
| *** jamesmcarthur has quit IRC | 02:08 | |
| *** jamesmcarthur has joined #openstack-infra | 02:08 | |
| *** yamamoto has joined #openstack-infra | 02:11 | |
| *** rcernin has quit IRC | 02:12 | |
| *** jamesmcarthur has quit IRC | 02:15 | |
| *** yamamoto has quit IRC | 02:16 | |
| *** jamesmcarthur has joined #openstack-infra | 02:24 | |
| *** jamesmcarthur has quit IRC | 02:37 | |
| *** jamesmcarthur has joined #openstack-infra | 02:38 | |
| *** yamamoto has joined #openstack-infra | 02:42 | |
| *** jamesmcarthur has quit IRC | 02:43 | |
| *** lbragstad has quit IRC | 03:00 | |
| *** tetsuro has quit IRC | 03:11 | |
| *** rcernin has joined #openstack-infra | 03:17 | |
| *** jamesmcarthur has joined #openstack-infra | 03:19 | |
| *** jamesmcarthur has quit IRC | 03:22 | |
| *** jamesmcarthur has joined #openstack-infra | 03:23 | |
| *** psachin has joined #openstack-infra | 03:29 | |
| *** tetsuro has joined #openstack-infra | 03:45 | |
| *** armax has joined #openstack-infra | 03:49 | |
| *** jamesmcarthur has quit IRC | 03:58 | |
| *** jamesmcarthur has joined #openstack-infra | 03:58 | |
| *** jamesmcarthur has quit IRC | 04:04 | |
| *** ysandeep|away is now known as ysandeep | 04:05 | |
| *** markvoelker has joined #openstack-infra | 04:24 | |
| *** markvoelker has quit IRC | 04:29 | |
| *** evrardjp has quit IRC | 04:33 | |
| *** evrardjp has joined #openstack-infra | 04:33 | |
| *** jamesmcarthur has joined #openstack-infra | 04:40 | |
| *** apetrich has quit IRC | 04:42 | |
| *** jamesmcarthur has quit IRC | 04:44 | |
| *** jamesmcarthur has joined #openstack-infra | 04:45 | |
| *** ykarel|away is now known as ykarel | 04:51 | |
| openstackgerrit | Merged openstack/project-config master: Add ensure-tox to pti-python-tarball https://review.opendev.org/736848 | 04:54 |
| *** jamesmcarthur has quit IRC | 05:09 | |
| *** jamesmcarthur has joined #openstack-infra | 05:09 | |
| *** markvoelker has joined #openstack-infra | 05:09 | |
| *** markvoelker has quit IRC | 05:14 | |
| *** jamesmcarthur has quit IRC | 05:15 | |
| *** udesale has joined #openstack-infra | 05:34 | |
| *** lastmikoi has quit IRC | 05:35 | |
| *** carl_cai has joined #openstack-infra | 05:42 | |
| *** lastmikoi has joined #openstack-infra | 05:42 | |
| *** bdodd has quit IRC | 05:50 | |
| *** jamesmcarthur has joined #openstack-infra | 05:52 | |
| *** bdodd has joined #openstack-infra | 05:53 | |
| *** lmiccini has joined #openstack-infra | 05:56 | |
| *** dklyle has quit IRC | 06:01 | |
| *** jamesmcarthur has quit IRC | 06:06 | |
| *** eolivare has joined #openstack-infra | 06:21 | |
| *** tosky has joined #openstack-infra | 06:30 | |
| *** tetsuro has quit IRC | 06:32 | |
| *** tetsuro has joined #openstack-infra | 06:40 | |
| *** rpittau|afk is now known as rpittau | 06:44 | |
| *** slaweq has joined #openstack-infra | 07:00 | |
| *** markvoelker has joined #openstack-infra | 07:10 | |
| frickler | noonedeadpunk: removed the held node | 07:13 |
| frickler | ianw: clarkb: jrosser: kevinz: corvus: mnaser: most of those holds look pretty old, please double-check what is still needed. maybe also some nodes got cleaned up manually. http://paste.openstack.org/show/794989/ | 07:14 |
| *** markvoelker has quit IRC | 07:15 | |
| *** dtantsur|afk is now known as dtantsur | 07:17 | |
| jrosser | oh sorry, I’m done with mine | 07:18 |
| *** amoralej|off is now known as amoralej | 07:19 | |
| *** rosmaita has quit IRC | 07:19 | |
| *** jcapitao has joined #openstack-infra | 07:22 | |
| *** tetsuro has quit IRC | 07:24 | |
| frickler | jrosser: deleted, thx | 07:27 |
| *** hashar has joined #openstack-infra | 07:30 | |
| *** rosmaita has joined #openstack-infra | 07:33 | |
| *** ralonsoh has joined #openstack-infra | 07:38 | |
| *** bhagyashris|away is now known as bhagyashris | 07:39 | |
| *** michael-beaver has quit IRC | 07:52 | |
| *** jpena|off is now known as jpena | 07:57 | |
| *** rcernin has quit IRC | 07:59 | |
| *** carl_cai has quit IRC | 08:00 | |
| *** gfidente has joined #openstack-infra | 08:19 | |
| *** pkopec has joined #openstack-infra | 08:21 | |
| *** carl_cai has joined #openstack-infra | 08:31 | |
| *** markvoelker has joined #openstack-infra | 08:34 | |
| *** markvoelker has quit IRC | 08:39 | |
| *** Lucas_Gray has joined #openstack-infra | 08:42 | |
| *** ykarel is now known as ykarel|lunch | 08:45 | |
| *** mugsie has quit IRC | 08:48 | |
| *** mugsie has joined #openstack-infra | 08:48 | |
| *** pkopec_ has joined #openstack-infra | 08:48 | |
| *** pkopec has quit IRC | 08:48 | |
| *** pkopec_ has quit IRC | 08:52 | |
| *** rcernin has joined #openstack-infra | 08:53 | |
| *** rcernin has quit IRC | 09:01 | |
| *** apetrich has joined #openstack-infra | 09:13 | |
| *** jamesmcarthur has joined #openstack-infra | 09:21 | |
| *** tkajinam has quit IRC | 09:21 | |
| *** clarkb has quit IRC | 09:23 | |
| *** calebb has quit IRC | 09:23 | |
| *** rcernin has joined #openstack-infra | 09:23 | |
| *** jamesmcarthur has quit IRC | 09:27 | |
| *** xek has joined #openstack-infra | 09:27 | |
| *** clarkb has joined #openstack-infra | 09:28 | |
| *** ysandeep is now known as ysandeep|brb | 09:29 | |
| *** pkopec has joined #openstack-infra | 09:35 | |
| *** priteau has joined #openstack-infra | 09:36 | |
| *** ykarel|lunch is now known as ykarel | 09:48 | |
| *** pkopec has quit IRC | 09:53 | |
| *** pkopec has joined #openstack-infra | 09:54 | |
| *** rcernin has quit IRC | 09:58 | |
| *** pkopec has quit IRC | 09:59 | |
| *** yamamoto has quit IRC | 09:59 | |
| *** pkopec has joined #openstack-infra | 10:00 | |
| openstackgerrit | Merged openstack/project-config master: Complete retirement of mox3 https://review.opendev.org/736760 | 10:03 |
| ianw | frickler: sorry can't log in, but you can delete any of mine too | 10:15 |
| frickler | ianw: done, thx, enjoy your weekend | 10:18 |
| *** rpittau is now known as rpittau|bbl | 10:22 | |
| *** yamamoto has joined #openstack-infra | 10:35 | |
| *** yamamoto has quit IRC | 10:43 | |
| *** yamamoto has joined #openstack-infra | 10:43 | |
| *** markvoelker has joined #openstack-infra | 10:44 | |
| *** jcapitao is now known as jcapitao_lunch | 10:47 | |
| *** markvoelker has quit IRC | 10:49 | |
| openstackgerrit | Hervé Beraud proposed openstack/project-config master: Add Backport-Candidate label for oslo deliverables https://review.opendev.org/734096 | 10:49 |
| *** carl_cai has quit IRC | 10:50 | |
| *** yamamoto has quit IRC | 10:51 | |
| *** rcernin has joined #openstack-infra | 10:54 | |
| *** yamamoto has joined #openstack-infra | 10:56 | |
| *** carl_cai has joined #openstack-infra | 11:01 | |
| *** rcernin has quit IRC | 11:08 | |
| elod | hi, process-stackviz role fails on xenial based jobs, becuase subunit2sql package from mirror: http://mirror.ord.rax.opendev.org/wheel/ubuntu-16.04-x86_64/subunit2sql/ | 11:18 |
| elod | is it possible to add it to the mirror? | 11:18 |
| elod | * subunit2sql package *missing* from mirror | 11:18 |
| *** jamesmcarthur has joined #openstack-infra | 11:24 | |
| frickler | elod: can you show the log or check the pip version? this error is likely due to pip2 not being update on py3 jobs | 11:29 |
| frickler | updated | 11:29 |
| elod | frickler: https://zuul.opendev.org/t/openstack/build/c1e2da80537448bfb24331fb4198a931/log/job-output.txt#30561-30565 | 11:30 |
| *** jamesmcarthur has quit IRC | 11:31 | |
| elod | or maybe, this is simpler to check: https://zuul.opendev.org/t/openstack/build/c1e2da80537448bfb24331fb4198a931 :) | 11:31 |
| elod | python 3 Version: 3.5.1-3 | 11:32 |
| elod | sorry, pip version 8.1.1 | 11:33 |
| elod | as this is from Rocky branch | 11:34 |
| *** derekh has joined #openstack-infra | 11:36 | |
| frickler | elod: yes, we need pip 9.something, 8.1.1 cannot handle our mirror properly | 11:37 |
| frickler | the issue only seems to affect the py3 job, where devstack doesn't update pip2, but in the post we still run stackviz on python2 | 11:38 |
| frickler | gmann: ^^ maybe you have an idea for this? | 11:39 |
| frickler | see also https://review.opendev.org/735615 | 11:40 |
| *** jpena is now known as jpena|lunch | 11:41 | |
| elod | actually I'm trying to help gmann with debugging old jobs :) | 11:45 |
| elod | frickler: so then the fix should be somewhere in the job definitions, since it is not an option to add subunit2sql to the mirror. am I right? | 11:47 |
| *** rcernin has joined #openstack-infra | 11:53 | |
| *** rlandy has joined #openstack-infra | 11:56 | |
| *** rlandy is now known as rlandy|ruck | 11:57 | |
| frickler | elod: iiuc there is a wheel for that on pypi, thus we don't build a local wheel. newer pip can successfully install that, see the tempest-full job in the devstack review above | 11:57 |
| frickler | the weird thing is that process-stackviz explicitly calls /tmp/stackviz/bin/pip3 , but still ends up with pip 8.1.1 | 12:00 |
| *** Lucas_Gray has quit IRC | 12:01 | |
| frickler | mordred: maybe you can look at this, I guess ianw may already be off for the weekend https://zuul.opendev.org/t/openstack/build/c1e2da80537448bfb24331fb4198a931/console#4/0/29/controller | 12:02 |
| *** ociuhandu has quit IRC | 12:03 | |
| *** yamamoto has quit IRC | 12:04 | |
| *** tkajinam has joined #openstack-infra | 12:04 | |
| *** rcernin has quit IRC | 12:06 | |
| *** ysandeep|brb is now known as ysandeep | 12:11 | |
| *** rfolco has joined #openstack-infra | 12:12 | |
| *** Lucas_Gray has joined #openstack-infra | 12:14 | |
| *** rpittau|bbl is now known as rpittau | 12:19 | |
| *** lamt has joined #openstack-infra | 12:19 | |
| *** lbragstad has joined #openstack-infra | 12:19 | |
| *** jcapitao_lunch is now known as jcapitao | 12:20 | |
| *** yamamoto has joined #openstack-infra | 12:21 | |
| elod | frickler: ok, thanks for the information! | 12:22 |
| mnaser | frickler: feel free to kill mine too | 12:26 |
| *** ociuhandu has joined #openstack-infra | 12:31 | |
| *** derekh has quit IRC | 12:33 | |
| *** yamamoto has quit IRC | 12:37 | |
| *** amoralej is now known as amoralej|lunch | 12:39 | |
| *** jpena|lunch is now known as jpena | 12:43 | |
| *** udesale_ has joined #openstack-infra | 12:44 | |
| *** dayou_ has joined #openstack-infra | 12:45 | |
| *** udesale has quit IRC | 12:46 | |
| *** dayou has quit IRC | 12:48 | |
| *** derekh has joined #openstack-infra | 12:51 | |
| openstackgerrit | Hervé Beraud proposed openstack/project-config master: Add Backport-Candidate label for oslo deliverables https://review.opendev.org/734096 | 13:03 |
| openstackgerrit | Hervé Beraud proposed openstack/project-config master: Add Backport-Candidate label for oslo deliverables https://review.opendev.org/734096 | 13:09 |
| *** dtantsur is now known as dtantsur|brb | 13:11 | |
| *** yamamoto has joined #openstack-infra | 13:12 | |
| *** yamamoto has quit IRC | 13:19 | |
| *** amoralej|lunch is now known as amoralej | 13:21 | |
| noonedeadpunk | fungi: btw, there's no centos8 image :( https://nb01.opendev.org/images/ | 13:23 |
| AJaeger | noonedeadpunk: check nb02 | 13:24 |
| noonedeadpunk | yeah, thanks | 13:25 |
| AJaeger | noonedeadpunk: project-config/nodepool/ shows which image is build on which host | 13:25 |
| *** jamesmcarthur has joined #openstack-infra | 13:26 | |
| *** ykarel is now known as ykarel|afk | 13:28 | |
| *** Goneri has joined #openstack-infra | 13:36 | |
| *** eharney has joined #openstack-infra | 13:38 | |
| *** auristor has quit IRC | 13:39 | |
| *** yamamoto has joined #openstack-infra | 13:41 | |
| *** d34dh0r53 has joined #openstack-infra | 13:44 | |
| *** dayou has joined #openstack-infra | 13:44 | |
| *** auristor has joined #openstack-infra | 13:44 | |
| *** dayou_ has quit IRC | 13:47 | |
| gmann | frickler: elod i think this is the one fixed on master Tempest - https://review.opendev.org/#/c/724198/3 | 13:50 |
| gmann | but rocky use old Tempest. | 13:51 |
| *** rpittau is now known as rpittau|brb | 13:54 | |
| openstackgerrit | Donny Davis proposed openstack/project-config master: Reduce max servers on OE - air handler needs repairs https://review.opendev.org/737009 | 13:54 |
| rosmaita | when someone has a few minutes, i am seeing really weird behavior on some openstack-tox-pyxx jobs in stable/stein -- they seem to be using the upper-constraints from master, even though the tox file is looking for stein | 13:55 |
| rosmaita | https://review.opendev.org/#/c/736805/1 | 13:55 |
| AJaeger | donnyd: should I approve that quickly? | 13:57 |
| AJaeger | Ok, let's discuss on #opendev | 13:58 |
| *** rpittau|brb is now known as rpittau|afk | 14:00 | |
| *** psachin has quit IRC | 14:01 | |
| *** yamamoto has quit IRC | 14:04 | |
| *** ociuhandu has quit IRC | 14:07 | |
| *** tosky has quit IRC | 14:08 | |
| *** ociuhandu has joined #openstack-infra | 14:12 | |
| openstackgerrit | Merged openstack/project-config master: Reduce max servers on OE - air handler needs repairs https://review.opendev.org/737009 | 14:13 |
| *** tkajinam has quit IRC | 14:13 | |
| *** ysandeep is now known as ysandeep|away | 14:14 | |
| noonedeadpunk | sorry for bothering you.... but can I ask for hold of https://review.opendev.org/#/c/689629/ one more time? as despite setting UMASK I still get 0077 for some reason:( https://storage.gra.cloud.ovh.net/v1/AUTH_dcaab5e32b234d56b626f72581e3644c/zuul_opendev_logs_e87/689629/60/check/openstack-ansible-deploy-aio_metal-centos-8/e8773b9/logs/ara-report/result/7d6200cd-046d-4f45-b357-751c93aeb353/ | 14:14 |
| noonedeadpunk | downloading your image in the meanwhile (it's max 1mbit/s) | 14:15 |
| *** KeithMnemonic has joined #openstack-infra | 14:23 | |
| mordred | frickler: we're installing pip from distro packages now | 14:24 |
| mordred | frickler: a job can set ensure_pip_from_upstream and it'll install upstream pip - so if we have thinngs on an old node type where pip is too old, we can do that | 14:24 |
| fungi | noonedeadpunk: my pleasure, which job? | 14:24 |
| frickler | mordred: but iirc there was a special case for xenial because distro pip is too old there | 14:25 |
| fungi | noonedeadpunk: looks like several failed so not sure which one you want the hold for | 14:25 |
| frickler | fungi: noonedeadpunk: I think I have that in my history still, let me check | 14:26 |
| fungi | noonedeadpunk: oh, i guess openstack-ansible-deploy-aio_metal-centos-8 since that's the log you referenced | 14:26 |
| mordred | frickler: I agree, it does look like there is a xenial file with tasks in it that set up a PPA | 14:26 |
| noonedeadpunk | fungi: disregard, I guess I know what the problem is.... | 14:26 |
| fungi | noonedeadpunk: oh, well i've just set the autohold | 14:27 |
| noonedeadpunk | fungi: but yah, it's that job | 14:27 |
| noonedeadpunk | oh, ok then | 14:27 |
| mordred | frickler: it has 9.0.1-3~3 of python-pip | 14:27 |
| noonedeadpunk | will use it | 14:27 |
| *** hashar has quit IRC | 14:27 | |
| mordred | frickler: it does not have a backport for pip3 | 14:27 |
| noonedeadpunk | thanks) | 14:27 |
| fungi | noonedeadpunk: no problem, met me know when you get a failure and i can add your ssh key | 14:28 |
| frickler | mordred: ah, yes, it's the pip3 that is failing | 14:28 |
| *** ykarel|afk is now known as ykarel | 14:28 | |
| *** dtantsur|brb is now known as dtantsur | 14:28 | |
| mordred | frickler: I'm not sure what the right answer is here. | 14:29 |
| elod | gmann: :( then that cannot be fixed in tempest I guess, so a new workaround needs to be found i guess :S I'll think on it. | 14:30 |
| *** carl_cai has quit IRC | 14:30 | |
| frickler | AJaeger: actually unless I'm mistaken, both nb01 and nb02 use nodepool/nodepool.yaml and whoever has time when an image is due for rebuild starts it? so the location may change each other day | 14:32 |
| fungi | elod: probably a terrible idea, but you could embed a diff in the job and patch the checked out tempest tag state before running. i would probably leave that as a solution of last resort though | 14:33 |
| fungi | frickler: AJaeger: yes that's correct | 14:34 |
| AJaeger | Thanks for the correction | 14:34 |
| fungi | whichever notices the staleness of the last build sooner starts to work on replacing it | 14:34 |
| fungi | so often you'll find some of each image on each builder, but sometimes the last two images will both wind up on the same builder and then there won't be any of that kind on the other | 14:35 |
| frickler | elod: fungi: actually I think ensure-pip is being used, it's just that for xenial it installs the too old distro pip, as I was just discussing with mordred | 14:35 |
| fungi | since we prune old images from disk and only ever keep the most current two | 14:35 |
| AJaeger | I see, thanks, fungi | 14:36 |
| fungi | frickler: i thought there was a workaround ianw put in ensure-pip for xenial specifically to pull a backported bionic pip from a ppa | 14:36 |
| frickler | fungi: that seems to have only pip2, not pip3 | 14:36 |
| frickler | i.e python-pip vs. python3-pip | 14:37 |
| mordred | I think we could totally just set ensure_pip_from_upstream for stable branch of devstac | 14:37 |
| mordred | since it installed pip from upstream through the entire existence of the stable branches | 14:37 |
| frickler | can that also cap the pip version? because we also did that until recentish | 14:38 |
| mordred | we did? | 14:39 |
| fungi | hrm, i didn't realize it only did the pip backport on xenial for python 2.7 and not 3.5 | 14:39 |
| fungi | there's supposedly also an option you can pass to ensure-pip to install fron pypi | 14:39 |
| mordred | frickler: no, there is no support for a pip version cap - but I'm honestly not sure how we capped pip when we were instlaling from upstream pip before - unless we did a get-pip.py then a pip -U pip=='capped_version' | 14:40 |
| frickler | mordred: yes because of the system pks reinstall conflicts with pip >= 10. the solution for that came only in ussuri or maybe train | 14:40 |
| clarkb | mordred: frickler it did becausenewpip refuses to uninstall stuff. BUT I thought devstack always installed pip for itself | 14:40 |
| mordred | headdesk | 14:40 |
| clarkb | it uses get-pip.py and installs exactly what ut needs | 14:41 |
| frickler | o.k., for the stackviz use case that might not be needed | 14:41 |
| *** yamamoto has joined #openstack-infra | 14:41 | |
| clarkb | We shouldnt need to fix that in an image or job context as devstack is already self managing that | 14:41 |
| fungi | sounds like maybe it's not doing it consistently for creation of the stackviz venv, which is where the failure is happening, right? | 14:42 |
| frickler | clarkb: fungi: https://zuul.opendev.org/t/openstack/build/c1e2da80537448bfb24331fb4198a931/console#4/0/29/controller | 14:42 |
| clarkb | ya it sounds like a bug yo fix in devstack not the job or image is what I'm trying to get at | 14:43 |
| frickler | that's in the post, after devstack has run | 14:43 |
| clarkb | ok so its a virtualenv not the devstack managed global pip? | 14:45 |
| *** chandankumar is now known as raukadah | 14:45 | |
| clarkb | and ithappens outsideof stack.sh | 14:46 |
| *** dklyle has joined #openstack-infra | 14:46 | |
| *** ccamacho has quit IRC | 14:48 | |
| clarkb | and that ignores the devstack installed get-pip.py because it uses distro packaged virtualenv which uses distro packaged pip? | 14:48 |
| *** yamamoto has quit IRC | 14:49 | |
| clarkb | which would work if python2 were used | 14:49 |
| clarkb | ok in that case I think we want to install virtualenv from pypi | 14:49 |
| clarkb | does ensure-virtualenv have that option? | 14:50 |
| frickler | clarkb: "virtualenv_command":"/usr/bin/python3 -m venv" , not sure how that selects which pip to use | 14:50 |
| clarkb | frickler: its part of the distro python3 packaging as a wheel that gets installed to the virtualenv, unfortunately at the wrong version. As you've discovered the python2 sidegets fixed | 14:53 |
| clarkb | I think this is largely an oversight with xenial + python3 virtualenvs | 14:53 |
| clarkb | but if weinstall virtualenv from pypi it will pull in a newer pip for that | 14:53 |
| frickler | I need to leave now, but I can hold a node and test some options later or tomorrow | 14:55 |
| elod | and I just thought it is as simple as adding subunit2sql's whl file ( https://pypi.org/project/subunit2sql/#files ) to the mirror ( http://mirror.ord.rax.opendev.org/wheel/ubuntu-16.04-x86_64/ ). It looked so easy :S | 15:01 |
| clarkb | elod: not sure if the raeson we don't want to do ^ was ever explained. Its because the real problem is a bug in pip 8 where it doesn't know to ignore packages missing on secondary indexes | 15:03 |
| clarkb | elod: the proper pip behavior is to find the package where it can and use it from there | 15:03 |
| clarkb | and we rely on that beacuse we can't build wheels for all the packages on pypi | 15:04 |
| clarkb | instead we build wheels for the packages we know we need that don't have wheels on pypi already | 15:04 |
| elod | clarkb: thanks for the detailed explanation :-o frickler mentioned that the cause is pip 8 does not handle the mirror properly, but I was not aware the details. | 15:07 |
| *** jtomasek has quit IRC | 15:08 | |
| gmann | clarkb: frickler elod also i am thinking we should decouple the stackviz roles from tempest which is branchless and fixes cannot be backported for older branches using old tempest - https://opendev.org/openstack/tempest/src/branch/master/roles/process-stackviz/tasks/main.yaml | 15:08 |
| gmann | may be moving on devstack side? | 15:08 |
| *** lmiccini has quit IRC | 15:08 | |
| clarkb | gmann: ya I'm sort of surprised its in tempest. I understand why but that makes the installation and management of the software trickier | 15:09 |
| gmann | clarkb: it was added there because it is only used by tempest job not devstack | 15:10 |
| elod | gmann: sounds good, but i guess we still have the problem, that anything we change in tempest, it doesn't matter for the pinned tempest on rocky | 15:10 |
| gmann | so adding it in devstack is also odd | 15:10 |
| clarkb | gmann: devstack's job is to install the software necessary to run the integration test. That includes stackviz | 15:11 |
| gmann | or let's add in stackviz itself which is branchless but we never tag that so master is used everywhere | 15:11 |
| clarkb | gmann: personally I think I'd made stackviz a devstack service | 15:11 |
| clarkb | similar to how tempest is a devstack service | 15:11 |
| gmann | yeah that is also point | 15:11 |
| gmann | and that will give us advantage of handling branch specific things in clean way | 15:12 |
| gmann | elod: if we add that role on devstack rocky then it will pick from there instead of tempest master. that is what i think will happen but clarkb can corect | 15:13 |
| clarkb | I'm not actually sure | 15:13 |
| clarkb | I know we can't have conflicting job names | 15:13 |
| clarkb | but at a role level it will depend on ansible role path lookup rules | 15:14 |
| clarkb | and maybe because devstack sorts before tempest it would work? | 15:14 |
| *** ociuhandu has quit IRC | 15:14 | |
| elod | rossz -> 25a02666 Ensure connection when connecting to broker | 15:15 |
| gmann | but we can remove that role from tempest once we have in devstack master | 15:15 |
| elod | sry, accidently pasterd | 15:16 |
| elod | *pasted here | 15:16 |
| gmann | we just need to make sure devstack role are included in devstack-tempest job | 15:16 |
| gmann | we do that - https://opendev.org/openstack/tempest/src/branch/master/.zuul.yaml#L14 | 15:16 |
| clarkb | gmann: ya | 15:17 |
| gmann | let me try that and see if rocky job work | 15:17 |
| artom | I'm getting an 'ModuleNotFoundError: No module named 'pkg_resources'' error in devstack-based jobs (ex: https://zuul.opendev.org/t/openstack/build/d28c8a44b1ac4ee89e6e0ad0cfee1a92) Is that specific to Fort Nebula (donnyd?) or something across the board? | 15:19 |
| clarkb | artom: nots not cloud specific | 15:21 |
| clarkb | artom: the issue is ansible's pip module needs the system pip to be preconfigured for it otherwise it has a sad. You can fix that by adding the ensure-pip role to your job's pre.yaml | 15:22 |
| clarkb | artom: in general devstack jobs don't need that because devstack manages pip internally, but it seems your job there is doing pip things external to devstack | 15:23 |
| artom | clarkb, ah, yes, we are - we have to install a couple of things from github because of unmerged fixes | 15:24 |
| artom | clarkb, weird that it's only now started to be a problem, but OK | 15:24 |
| clarkb | artom: I mean you can do that in devstack too | 15:24 |
| clarkb | the downside to the approach you are using is that I can't just grab devstack and your devstack plugin and run it locally | 15:25 |
| artom | clarkb, is there like a "devstack_pip" module that can do that? I'm just using 'pip' directly in my ansible role | 15:25 |
| artom | Oh, you mean in devstack/plugin.sh | 15:25 |
| clarkb | artom: devstack has python install functions which sort out the correct python and pip and all that | 15:25 |
| clarkb | artom: as a general rule you don't want tool functionality to be dependent on the CI system | 15:27 |
| artom | clarkb, makes sense | 15:28 |
| clarkb | to me that means "if this is a devstack job then I should be able to run devstack locally with the same localrc and get the same result" | 15:28 |
| clarkb | there will likely always be some level of bootstrapping though so the lines can blur | 15:28 |
| artom | clarkb, so will `pip_install git+https://github.com/pixelb/crudini.git#egg=crudini` work as expected? | 15:29 |
| clarkb | I expect so, though it will apply openstack constraints to that so if crudini is constrained you may not get that end result | 15:30 |
| clarkb | if that is the acse then you'll need to do whatever libs from git processing does to work around constraints (it may just use a constraintsless install function? I'm not sure) | 15:31 |
| artom | Looks like crudini and iniparse aren't in https://opendev.org/openstack/requirements/src/branch/master/upper-constraints.txt | 15:31 |
| artom | So I should be safe | 15:31 |
| mordred | ++ | 15:31 |
| *** Goneri has quit IRC | 15:32 | |
| *** Lucas_Gray has quit IRC | 15:32 | |
| *** icey has quit IRC | 15:32 | |
| *** Goneri has joined #openstack-infra | 15:32 | |
| *** Lucas_Gray has joined #openstack-infra | 15:32 | |
| *** icey has joined #openstack-infra | 15:32 | |
| artom | Btw, I learned some time ago that some folks pronounce crudini like Houdini (and not crud-eye-enn-eye), and I just wanted to use this opportunity to let folks know that I think it's awesome | 15:32 |
| mordred | hah | 15:33 |
| *** Lucas_Gray has quit IRC | 15:33 | |
| mordred | clarkb: we should write a blog post about tools not dependent on ci system | 15:34 |
| artom | But how can us tools merge code without our awesome CI system? ;) | 15:34 |
| mordred | clarkb: like, zuul doesn't export a "CI" env var (or anything like it) like many other ci systems, and logistics with ansible notwithstanding - that's actually on purpose | 15:34 |
| mordred | artom: :) | 15:34 |
| mordred | artom: the inverse of that ... the ci system should be good at running tools in a production-like manner | 15:35 |
| mordred | the tools shouldn't have branching logic for "am I running in CI" | 15:35 |
| mordred | if the tool has to know if it's in CI or not, then the test is potentially invalid | 15:35 |
| mordred | but this is a big philosophical difference we have in our world compared to other systems out there | 15:35 |
| mordred | so is maybe worth a long-form blog post | 15:36 |
| clarkb | mordred: ya, or even a section of zuul documentation | 15:36 |
| mordred | clarkb: ++ | 15:37 |
| *** eolivare has quit IRC | 15:38 | |
| noonedeadpunk | fungi: job finished:) ssh key https://launchpad.net/~noonedeadpunk/+sshkeys | 15:39 |
| fungi | mordred: clarkb: zuul-ci.org/soapbox ;) | 15:45 |
| *** Lucas_Gray has joined #openstack-infra | 15:47 | |
| fungi | noonedeadpunk: ssh root@104.130.26.165 | 15:47 |
| *** tosky has joined #openstack-infra | 15:50 | |
| noonedeadpunk | weird things.... | 15:52 |
| AJaeger | fungi, could you review this docstheme update for election repo, please? https://review.opendev.org/734854 | 15:52 |
| *** jamesmcarthur has quit IRC | 15:53 | |
| *** jamesmcarthur has joined #openstack-infra | 15:55 | |
| *** amoralej is now known as amoralej|off | 15:56 | |
| *** bdodd has quit IRC | 15:57 | |
| *** bdodd has joined #openstack-infra | 16:00 | |
| *** jcapitao has quit IRC | 16:01 | |
| *** ykarel is now known as ykarel|away | 16:03 | |
| *** xek has quit IRC | 16:04 | |
| *** rlandy|ruck is now known as rlandy|ruck|brb | 16:09 | |
| *** dtantsur is now known as dtantsur|afk | 16:13 | |
| *** armax has quit IRC | 16:20 | |
| *** jamesmcarthur has quit IRC | 16:20 | |
| *** udesale_ has quit IRC | 16:26 | |
| *** pkopec has quit IRC | 16:27 | |
| *** rlandy|ruck|brb is now known as rlandy|ruck | 16:37 | |
| *** jamesmcarthur has joined #openstack-infra | 16:41 | |
| *** Lucas_Gray has quit IRC | 16:41 | |
| *** sreejithp has joined #openstack-infra | 16:42 | |
| *** Goneri has quit IRC | 16:43 | |
| noonedeadpunk | fungi: nice, you may drop hold, sorry for bothering | 16:48 |
| fungi | noonedeadpunk: so did you figure it out then? | 16:57 |
| noonedeadpunk | uh... for some reason, when I replaced umask in /etc/login.defs in runtime (ie with ansible-hardening role) - it wasn;t applied for some reason for the resrt of the roles as well. So I moved to pre-run step and things are ok | 16:59 |
| *** ChanServ has quit IRC | 16:59 | |
| fungi | aha, cool | 16:59 |
| fungi | in unrelates news, the remaining publish-openstack-python-branch-tarball post_failures are for charms repos... i think maybe the job shouldn't be running on them? error is "python3: can't open file 'setup.py': [Errno 2] No such file or directory" | 17:00 |
| fungi | https://zuul.opendev.org/t/openstack/build/b0a48d626f88443e9ec2f39c626438f1 | 17:01 |
| fungi | i'm going to wager that making sdists and wheels from those repos is just not desirable (or even possible) | 17:01 |
| *** derekh has quit IRC | 17:02 | |
| *** jamesmcarthur has quit IRC | 17:04 | |
| *** jpena is now known as jpena|off | 17:04 | |
| *** hamalq has joined #openstack-infra | 17:07 | |
| fungi | hamalq: so the error you're getting, for context, is at https://zuul.opendev.org/t/openstack/build/8da2f74869744629a223ae03b698bb1e/log/job-output.txt#13127 | 17:09 |
| hamalq | yes | 17:10 |
| hamalq | fungi: yes | 17:10 |
| fungi | looks like something is trying to pip install file:///opt/stack/designate-tempest-plugin in that job, but we don't have verbose tracing from the script responsible so not sure exactly where/how that's happening | 17:11 |
| *** gmann is now known as gmann_afk | 17:13 | |
| hamalq | i see this change in designate https://github.com/openstack/designate/commit/36086c73df5d1552e531bc0729207bb2bd875ac8 | 17:18 |
| hamalq | fungi: ^^ | 17:18 |
| hamalq | that could be related | 17:18 |
| fungi | hamalq: ahh, gmann_afk wrote that change, so maybe he's a good one to ask | 17:21 |
| fungi | (at least when he's not afk) | 17:21 |
| hamalq | fungi: thanks will do | 17:21 |
| *** ChanServ has joined #openstack-infra | 17:37 | |
| *** tepper.freenode.net sets mode: +o ChanServ | 17:37 | |
| *** jamesmcarthur has joined #openstack-infra | 17:37 | |
| *** Goneri has joined #openstack-infra | 17:37 | |
| *** gfidente is now known as gfidente|afk | 17:38 | |
| *** jamesmcarthur has quit IRC | 18:09 | |
| *** jamesmcarthur has joined #openstack-infra | 18:10 | |
| *** jaicaa_ has quit IRC | 18:11 | |
| *** Lucas_Gray has joined #openstack-infra | 18:11 | |
| *** jaicaa has joined #openstack-infra | 18:19 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Fix and test multiarch docker builds in a release pipeline https://review.opendev.org/737059 | 18:27 |
| openstackgerrit | Sergii Golovatiuk proposed zuul/zuul-jobs master: Install source Python for supported OSes https://review.opendev.org/737060 | 18:27 |
| *** artom has quit IRC | 18:32 | |
| *** artom has joined #openstack-infra | 18:32 | |
| *** jamesmcarthur has quit IRC | 18:40 | |
| *** jamesmcarthur has joined #openstack-infra | 18:41 | |
| *** armax has joined #openstack-infra | 18:41 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack/reviewstats master: Fix 'reviewers' command to make with Python3 https://review.opendev.org/737063 | 18:48 |
| openstackgerrit | Ivan Kolodyazhny proposed openstack/reviewstats master: Fix 'openreviews' script to work with Python3 https://review.opendev.org/737064 | 18:52 |
| *** jamesmcarthur_ has joined #openstack-infra | 18:57 | |
| *** jamesmca_ has joined #openstack-infra | 18:58 | |
| *** jamesmc__ has joined #openstack-infra | 18:59 | |
| *** jamesmcarthur has quit IRC | 19:00 | |
| *** jamesmc__ has quit IRC | 19:00 | |
| *** jamesmcarthur_ has quit IRC | 19:02 | |
| *** jamesmca_ has quit IRC | 19:03 | |
| openstackgerrit | Ivan Kolodyazhny proposed openstack/reviewstats master: Add launchpadlib to requirements.txt https://review.opendev.org/737065 | 19:05 |
| *** Lucas_Gray has quit IRC | 19:06 | |
| *** bnemec is now known as beekneemech | 19:08 | |
| *** jamesmcarthur has joined #openstack-infra | 19:14 | |
| *** jamesmcarthur has quit IRC | 19:20 | |
| *** jamesmcarthur has joined #openstack-infra | 19:22 | |
| *** markvoelker has joined #openstack-infra | 19:31 | |
| *** jamesmcarthur has quit IRC | 19:32 | |
| openstackgerrit | Andreas Jaeger proposed zuul/zuul-jobs master: Fix zuul-jobs-test-ensure-python-pyenv files https://review.opendev.org/737068 | 19:32 |
| *** jamesmcarthur has joined #openstack-infra | 19:32 | |
| *** markvoelker has quit IRC | 19:36 | |
| *** yolanda has quit IRC | 19:41 | |
| *** KeithMnemonic has quit IRC | 19:59 | |
| *** markvoelker has joined #openstack-infra | 20:04 | |
| *** markvoelker has quit IRC | 20:09 | |
| *** jamesmcarthur_ has joined #openstack-infra | 20:12 | |
| *** jamesmcarthur has quit IRC | 20:15 | |
| *** gmann_afk is now known as gmann | 20:15 | |
| *** jamesmcarthur_ has quit IRC | 20:26 | |
| *** jamesmcarthur has joined #openstack-infra | 20:27 | |
| *** Lucas_Gray has joined #openstack-infra | 20:30 | |
| *** ralonsoh has quit IRC | 20:33 | |
| *** priteau has quit IRC | 20:36 | |
| *** gyee has joined #openstack-infra | 20:46 | |
| *** jamesmcarthur has quit IRC | 20:48 | |
| *** hashar has joined #openstack-infra | 20:54 | |
| *** xek has joined #openstack-infra | 20:54 | |
| *** rfolco has quit IRC | 20:54 | |
| *** factor has joined #openstack-infra | 21:04 | |
| *** xek_ has joined #openstack-infra | 21:25 | |
| *** xek has quit IRC | 21:28 | |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Add tests for upload-docker-image https://review.opendev.org/735402 | 21:29 |
| openstackgerrit | James E. Blair proposed zuul/zuul-jobs master: Fix and test multiarch docker builds in a release pipeline https://review.opendev.org/737059 | 21:29 |
| *** lbragstad has quit IRC | 21:32 | |
| *** lbragstad has joined #openstack-infra | 21:42 | |
| *** xek_ has quit IRC | 21:54 | |
| *** hashar has quit IRC | 21:54 | |
| *** eharney has quit IRC | 21:58 | |
| *** weshay|ruck is now known as weshay_pto | 22:00 | |
| *** markvoelker has joined #openstack-infra | 22:05 | |
| *** markvoelker has quit IRC | 22:10 | |
| *** gyee has quit IRC | 22:42 | |
| *** jamesmcarthur has joined #openstack-infra | 22:48 | |
| *** yamamoto has joined #openstack-infra | 22:48 | |
| *** yamamoto has quit IRC | 22:52 | |
| *** rlandy|ruck has quit IRC | 22:59 | |
| *** jamesmcarthur has quit IRC | 23:07 | |
| *** jamesmcarthur has joined #openstack-infra | 23:09 | |
| *** hamalq has quit IRC | 23:11 | |
| *** tosky has quit IRC | 23:45 | |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!