Friday, 2020-07-03

*** KeithMnemonic has quit IRC00:30
*** lbragstad has quit IRC01:24
*** evrardjp has quit IRC04:33
*** evrardjp has joined #openstack-requirements04:33
*** udesale has joined #openstack-requirements04:39
*** mnasiadka_ is now known as mnasiadka06:42
*** ccamacho has joined #openstack-requirements06:55
*** e0ne has joined #openstack-requirements07:17
*** tosky has joined #openstack-requirements07:26
*** e0ne has quit IRC08:04
*** dtantsur|afk is now known as dtantsur08:11
*** tosky has quit IRC08:32
*** rakhmerov has joined #openstack-requirements09:19
rakhmerovhi, I have a question on requirements. The Ussuri version of "mistral" is not compatible with the latest mistral-lib (2.2.0). But in the requirements.txt there's still "mistral-lib>=1.4.0"09:19
rakhmerovI'm wondering how to best fix it09:19
rakhmerovwould it be right to just do https://review.opendev.org/#/c/739169/ that constrains "mistral-lib" version (<2.2.0) and make the same change in global-requirements.txt09:20
rakhmerovboth for ussuri branch09:20
rakhmerovalthough the older branches are also affected..09:20
*** tosky has joined #openstack-requirements09:22
rakhmerovwould appreciate a hint09:24
*** e0ne has joined #openstack-requirements10:20
*** udesale_ has joined #openstack-requirements11:09
*** udesale has quit IRC11:11
*** e0ne_ has joined #openstack-requirements12:25
*** e0ne has quit IRC12:25
openstackgerritElod Illes proposed openstack/requirements stable/stein: Bump subunit to 1.4.0 in train too  https://review.opendev.org/73922212:32
hberaudrakhmerov: o/ I think your approach is good, but another POV than mine on this topic could be worth13:02
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for os-traits to new release 2.4.0  https://review.opendev.org/73922513:05
smcginnisrakhmerov: Something else is going on there. Stable/ussuri mistral should not be using mistral-lib 2.2.0.14:28
smcginnisrakhmerov: https://opendev.org/openstack/requirements/src/branch/stable/ussuri/upper-constraints.txt#L49814:28
smcginnisrakhmerov: Likely you have a broken job or broken tox.ini that isn't using constraints like it should.14:29
smcginnisrakhmerov: Looks like at least most of the tox jobs are using constraints. I don't see any job failures on stable/ussuri patches though, so not sure where this is an issue.14:31
rakhmerovsmcginnis: it happens for people who just use pip14:41
rakhmerovif they install mistral separately14:41
rakhmerovin OpenStack CI all is good, yes14:41
rakhmerovhberaud: ^14:41
smcginnisrakhmerov: Installing from pip still needs to use the upper-constraints for the given stable branch.14:42
rakhmerovhm... really? You mean PIP is somehow aware of the upper constraints?14:42
rakhmerovI just don't know that mechanism14:42
smcginnisThat's the -c that we put in our tox files and elsewhere. That's not a tox thing, that's a pip thing.14:43
smcginnisIf you want to install a stable version of something, you need to use that to make sure you get compatible versions of the packages.14:43
smcginnisEven master, really.14:43
rakhmerovooh, I see what you mean.. yes. But it's not so obvious for someone who just found a package in PIP and wants to install it14:44
rakhmerovok, so14:44
smcginnisYeah. Thankfully I don't think it's too common that someone just randomly tries to pip install a service, but it is an implicit requirement if they do so.14:45
rakhmerovok, gotcha14:45
rakhmerovI got a complaint from our users on that14:45
rakhmerovwe're used to all these machinery (upper-constraints etc) but there are people really who just use Pip14:46
smcginnisThey are likely to have a lot more suprises if they think they can just pip install and be done. ;)14:46
rakhmerovsmcginnis: so I'm thinking if we can still do something to make it better14:46
rakhmerovsmcginnis: so do you just recommend to mention in the docs maybe?14:47
smcginnisTracking upper-constraints really is that thing that was done. We used to try to cap specific versions, then have a bot that would update every single project that referenced that package. But that was unmaintainable.14:47
smcginnisSo yeah, adding some documentation definitely wouldn't hurt to try to make sure folks are aware of how that needs to work.14:48
rakhmerovyeah-yeah... I remember that transition14:48
smcginnisIf you are coming across users that try this often.14:48
rakhmerovhm.. ok14:48
rakhmerovalright, thanks! I'll put the corresponding info somewhere in the docs and make sure it's visible enough14:49
smcginnisGreat, thanks rakhmerov.14:50
rakhmerovhave a good one14:50
hberaudsmcginnis++15:03
*** markmcclain has quit IRC15:06
*** markmcclain has joined #openstack-requirements15:08
*** dtantsur is now known as dtantsur|afk15:20
smcginnisprometheanfire: Commenting here since I doubt the necessary folks are around (like fungi, who I hope is happily vacationing). The nightly generate constraints job is failing yet: https://aa3f5bd002bc3471eaeb-0ee3eeb68aa256c74f1e35f60c262d61.ssl.cf5.rackcdn.com/periodic/opendev.org/openstack/requirements/master/propose-updates/519e935/job-output.txt15:21
smcginnisThe issue appears to be that this job needs to run under py3.6 through py3.8 to generate the constraints.15:21
smcginnisIt creates a venv for each one, runs the commands, then gets the output from each.15:21
smcginnisThe issues is venv is not installed for each environment.15:22
smcginnisI had switched the command to run "python -m venv" instead of "virtualenv ..." thinking that would help since venv is standard lib and virtualenv is not.15:22
smcginnisBut on ubuntu they break out python3-venv into a separate package that is not installed.15:23
smcginnisSo either we need a way to get that installed, or we need to revert my change and go back to virtualenv, and also figure out how the ensure-virtualenv role would need to be updated so we can give it each python version that we need to have virtualenv installed under.15:24
*** otherwiseguy_ has joined #openstack-requirements15:24
smcginnisSomething like the ensure_pip_from_upstream_interpreters option in ensure-pip.15:24
smcginnisThat does not exist today.15:24
funginot here, but the options for that are similar to what we discussed earlier in #openstack-infra when i thought that was the failure it was hitting (i guess i remembered the job correctly after all, we just weren't getting that far yet and so the problem was masked by a different error)15:24
smcginnisYeah, now I see what you were thinking about. ;)15:24
* smcginnis isn't here either.15:25
*** otherwiseguy has quit IRC15:25
*** dhellmann has quit IRC15:25
smcginnisTalking this through, I wonder if we can just switch the job to run on a RH image so there isn't a separate package to install for python3-venv.15:25
*** dhellmann has joined #openstack-requirements15:26
fungiso anyway, could extent ensure-pip to have a multi-interpreter option for its distro packages logical branch, or could switch the job to install pip from pypi via get-pip.py (though i don't know if the latter will *actually* get you a working venv module, that's part of stdlib)15:26
smcginnisIt doesn't look like it.15:26
smcginnisIs there an ansible role we can just use directly that installs system packages under a given python version?15:27
smcginnisSomething like a: - role   name: install-package   package: python3.6-venv15:28
smcginnisThough it looks like bionic only has python3.6-venv and python3.7-venv, so I'm not sure how 3.8 would be handled.15:28
smcginnisSo maybe easier going back to virtualenv so we can just pip install it.15:28
fungithere is a separate ensure-python role15:30
fungiwhich can install arbitrary pythons, not limited to the ones provided by the distro15:30
smcginnisIs there a way to tell that to include venv?15:31
fungithere is a 3.8 venv in bionic too: https://packages.ubuntu.com/bionic-updates/python3.8-venv15:32
smcginnisAh, I was looking under bionic, not bionic-updates.15:32
fungiyou can search most easily with https://packages.ubuntu.com/python3.8-venv and it will turn up all instances of that package name across every suite15:33
smcginnisSo I guess we need an ensure-venv to go along with ensure-virtualenv. One that includes the version to install?15:33
*** udesale has joined #openstack-requirements16:23
*** udesale_ has quit IRC16:25
*** udesale has quit IRC16:49
fungiensure-pip installs the separate venv package if distro packaging is used, but doesn't (yet) have a way to say install for more than one distro packaged python interpreter version so only uses the default python3: https://opendev.org/zuul/zuul-jobs/src/branch/master/roles/ensure-pip/tasks/Debian.yaml16:54
fungimy vote would be to extend install-pip and always use it if you need to make sure venv is present16:54
fungibut that's a discussion for #zuul16:55
openstackgerritMerged openstack/requirements stable/stein: Bump subunit to 1.4.0 in train too  https://review.opendev.org/73922217:01
*** e0ne_ has quit IRC17:21
openstackgerritSean McGinnis proposed openstack/requirements master: DNM: Test propose-updates fix  https://review.opendev.org/73927618:43
*** e0ne has joined #openstack-requirements19:56
*** e0ne has quit IRC20:00
*** e0ne has joined #openstack-requirements20:06
*** e0ne has quit IRC20:10
*** e0ne has joined #openstack-requirements20:30
*** e0ne has quit IRC20:35
*** e0ne has joined #openstack-requirements20:55
*** e0ne has quit IRC21:00
*** e0ne has joined #openstack-requirements21:19
*** e0ne has quit IRC21:24
*** e0ne has joined #openstack-requirements21:57
*** e0ne has quit IRC22:01
openstackgerritGhanshyam Mann proposed openstack/requirements master: Temporarily cap setuptools<48.0.0  https://review.opendev.org/73929022:26
gmannsmcginnis: prometheanfire ^^ i know this is not recommended for setuptools but this is the quick way to unblock the gates - http://lists.openstack.org/pipermail/openstack-discuss/2020-July/015781.html22:30
gmanni have filed bug on devstack side also, at least to revert back the cap at the end, so this is temporary to gate unblock.22:30
prometheanfiregmann: yep, I reviewed it (with questoins)22:32
prometheanfireglad you mentioned a revert plan22:33
*** e0ne has joined #openstack-requirements22:34
gmannprometheanfire: replied too22:36
prometheanfirethanks22:36
prometheanfiregiven the holiday I'm not gonna wait for smcginnis22:36
gmannsure, thanks22:37
*** e0ne has quit IRC22:39
prometheanfiregmann: what I'll probably do is propose the patch to revert with DNM on just so I don't forget22:40
gmannprometheanfire: +1 make sense.22:40
*** e0ne has joined #openstack-requirements22:46
*** tosky has quit IRC22:50
*** e0ne has quit IRC22:51
*** e0ne has joined #openstack-requirements23:10
*** e0ne has quit IRC23:15
*** e0ne has joined #openstack-requirements23:23
*** e0ne has quit IRC23:27
*** e0ne has joined #openstack-requirements23:35
*** e0ne has quit IRC23:40

Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!