Tuesday, 2020-02-25

*** brinzhang has joined #openstack-requirements00:21
*** vishalmanchanda has joined #openstack-requirements00:21
*** brinzhang_ has joined #openstack-requirements01:35
*** brinzhang_ has quit IRC01:37
*** brinzhang_ has joined #openstack-requirements01:37
*** brinzhang has quit IRC01:39
*** brinzhang has joined #openstack-requirements01:59
*** brinzhang has quit IRC02:00
*** brinzhang has joined #openstack-requirements02:02
*** brinzhang_ has quit IRC02:02
*** brinzhang_ has joined #openstack-requirements02:22
*** brinzhang has quit IRC02:25
*** brinzhang has joined #openstack-requirements02:44
*** brinzhang_ has quit IRC02:47
*** vishalmanchanda has quit IRC03:09
adriantamotoki: this commit and the others like it, break installation for horizon from source: https://github.com/openstack/requirements/commit/6aa3b0ced466089cab5cf9eb529af2c1a4c67976#diff-0bdd949ed8a7fdd4f95240bd951779c803:13
adriantbecause I am trying to install our fork of horizon, with constraint to rocky, and because I am install horizon using pip from source, it breaks since that commit03:14
adriantand I've had to pin our upper-constraints to the commit RIGHT before that one03:14
adriantI can understand the requirements for plugins in horizon wanting an upper-constraint, but this breaks our build, and potentially others would just like to build from source and use the upstream 'stable' constraint branches03:15
adriantERROR: Could not satisfy constraints for 'horizon': installation from path or url cannot be constrained to a version03:16
adriantwith the install command being:03:17
adriantpip install -c https://raw.githubusercontent.com/openstack/requirements/stable/rocky/upper-constraints.txt /opt/horizon/03:17
adriantand our source code for horizon sitting in /opt/horizon03:17
adriantthat used to work before your commit03:19
adriantkind of related: https://github.com/pypa/pip/issues/631003:20
prometheanfireso, hi03:22
prometheanfireI don't like them being in tree as a constraint either, but their plugins using them as libs makes it impossible to avoid03:23
prometheanfirethey are only constrained on stable branches03:23
adriantbut that kind of breaks anyone doing builds from source like this :/03:23
adriantand I'd assume that not an uncommon pattern03:23
prometheanfirepackagers / deployers are welcome do use our upper-consrtaints as is, or modify them to their need03:23
adriantbut then we're maintaining a fork of upperconstaints too03:24
adriantso many forks :(03:24
prometheanfireI would stress (as a packager myself) that constraints are a very strong suggestion, if you don't lik something, you can change it03:24
prometheanfireya :(03:24
prometheanfirea pipe'd sed could work too03:24
prometheanfireless forky03:24
adriantmaybe03:24
prometheanfireunfortunaltey it's just a bad situation03:25
adriantI would argue that we should solve this differently than breaking this for people03:25
adriantthis is a BAD solution03:26
adriantnot that I have a useful alternative :/03:26
adriantthe plugins only use horizon as a lib for testing03:32
adriantyou can't exactly have plugins without horizon itself03:32
adriantI have the exact same problem with Adjutant, although i can't say I solve it, other than have the plugins rely on adjutant master repo for testing, and potentially will start pinning test-requirments in my plugins to specific stable branches of Adjutant in their own stable branches.03:33
adriantmaybe that is a saner pattern to keep horizon out of upperconstraints?03:34
adriantand I guess we may have similar issues with:03:35
adrianthttps://github.com/openstack/requirements/commit/1d44f821536a970cd804abe31cba3bcd5188bcb103:35
adrianthonestly this sounds like a nightmare. Adding services to upper-constraints shouldn't be allowed03:36
adriantor we need some official pattern to do it in a sane way03:36
adriant"Generally adding OpenSatck services isn't allowed but..."03:37
* adriant sighs03:37
prometheanfireadriant: it's been discussed, (sorry, was afk)03:37
prometheanfirethe alternate (right) solution is to get the projects (neutron/horizon) to enforce the non-usage of themselves as libraries, forking library code to $PROJECT-lib and having both the libraries and plugins use that03:38
prometheanfireya, it's a pain03:39
adriantlike, if pip allowed more than one constraint file, we could split this out03:39
adriantor even have one with services, one without...03:39
adriantdoes mean duplication but doesn't break anyone03:40
prometheanfirepossibly, I thought that it did, or that the last one specified took priority03:40
adriantdoes it allow more than one?03:40
prometheanfireI thought it did, but may be thinking of requirements files03:40
adriantbecause then you can have "upper-constraints.txt" and "service-upper-constraints.txt" or something, and places that need the latter, use both03:41
adriantwith the latter having just services03:41
adriantthat happen to be used as libs...03:41
adriantthat's not exactly a good idea either03:42
prometheanfireright03:43
prometheanfireit's just shitty all around03:43
prometheanfirethe project won't do anything to split out -lib versions03:43
adriantI'd hard enforce that. do a -lib library, or don't get added to upper-constraints03:44
adriantthe alternative is kind of worse, and we're there now...03:44
adriantand I say this knowing I'll get hit by that issue myself :P03:45
adriantsince Adjutant plugins rely on Adjutant itself for testing03:45
prometheanfirehmm I should have them do whatever causes https://github.com/pypa/pip/issues/507903:45
prometheanfireI might make that a cycle goal, might go like this03:46
prometheanfirehmm, just removing them again early in the cycle could be interesting03:47
prometheanfirenot sure it's within this projects scope, (maintaning co-installable openstack), part of that definition is not caring about the outside (sorry adriant)03:48
prometheanfirethe problem I've had in getting projects to do $FOO-lib is that the projects themselves don't necessarilly care if I (a third party project) ask, also, if I have them or don't in constraints doesn't mater to them either, it's all on the libs03:50
adriantI would assume being able to use upper-constraints to install stable version of openstack services with sane versions of making libraries IS well within the project scope03:50
*** timburke has quit IRC03:50
prometheanfireI guess this would force the libs to keep the -lib version updated03:50
prometheanfiredefine sane versions :D03:50
adriantversions semi-officially decided by the community and merged into this repo03:51
prometheanfireconstraints are first and foremost for gating03:51
adriantI'm fairly sure we are not the only company using upper-constraints to install stable releases of the services03:51
prometheanfireI'm sure you are not03:52
adriantI'd assume thats a common and sane practice to ensure library compatibility with the version of the software we are trying to run03:52
prometheanfireyep03:52
adriantso maybe it should be considered as part of the scope of the project officially?03:52
prometheanfireI'm not seeing why you are having a problem really, lets get back to the basic question03:52
adriant"ERROR: Could not satisfy constraints for 'horizon': installation from path or url cannot be constrained to a version"03:53
prometheanfireis your problem that you cannot install a fork of horizon using upstream constraints?03:53
adriantyes03:53
adriantor even upstream horizon from source03:53
adriantfork doesn't matter03:53
*** timburke has joined #openstack-requirements03:53
prometheanfireit should install from pip03:53
adriantin a docker container, clone a horizon repo, install using pip and upper-constraint03:53
prometheanfireshould be trying horizon===14.something right?03:54
adriantthe problem is horizon's weird enabled files and such make it better handled as source03:54
adriantat least in my experience03:54
prometheanfireah, zuul got aroud it by removing the project being installed from constraints, so horizon would install unconstrainted via zuul iirc03:54
adriantI'd rather and more commonly, install from source than pypi for services03:55
prometheanfirethat's what it mentions with zuulv3, even openstack gate modifies the constraints file :P03:55
adriantnot sure if other do the same or that's just use03:55
* adriant sighs03:55
adriantok... I guess I could add that as a step in our pipeline03:56
adriantbut it would be nice if we had a blacklist of such services in a file somewhere in this repo I could source to strip from the other03:56
prometheanfireya, perfect world would be nice and I'll revisit the -lib thing with others soon (reqs meeting is wednesday)03:56
adriantless stuff we need to keep in sync03:56
prometheanfirepipeline would mean less to keep in sync (sed, etc)03:56
adriantwell yeah, but I'd still need to maintain my own list of blacklist values03:57
adriantwhich may not change often mind you03:57
adriantbut still :P03:57
prometheanfirethe main blacklist is what we maintian for testing/top_level_projects03:57
prometheanfirehttps://github.com/openstack/requirements/blame/master/blacklist.txt03:57
prometheanfireansible-lint six months ago was most recent03:58
prometheanfireI was able to head off sahara (see the commit message for that one)03:59
prometheanfirehorizon/neutron were before my time :(03:59
adriantprometheanfire, well thanks for listening, and sorry for ranting. If you can bring it up and something sensible happens I'd be happy to know. Just annoyed because "this used to work", and now it doesn't without modification.04:03
prometheanfireI've had a rant or two04:03
*** brinzhang_ has joined #openstack-requirements04:13
*** brinzhang_ has quit IRC04:15
*** brinzhang_ has joined #openstack-requirements04:15
*** brinzhang has quit IRC04:17
*** udesale has joined #openstack-requirements04:23
*** vishalmanchanda has joined #openstack-requirements04:31
*** brinzhang has joined #openstack-requirements05:04
*** brinzhang_ has quit IRC05:07
openstackgerritMerged openstack/requirements master: update constraint for python-openstackclient to new release 5.0.0  https://review.opendev.org/70959105:31
*** evrardjp has quit IRC05:34
*** evrardjp has joined #openstack-requirements05:35
*** brinzhang_ has joined #openstack-requirements05:37
*** brinzhang has quit IRC05:40
*** brinzhang_ has quit IRC06:02
*** strigazi has quit IRC06:16
*** strigazi has joined #openstack-requirements06:18
*** tosky has joined #openstack-requirements08:05
*** ccamacho has joined #openstack-requirements08:05
*** e0ne has joined #openstack-requirements08:24
*** ralonsoh has joined #openstack-requirements08:40
*** witek_ has joined #openstack-requirements08:46
*** iurygregory has joined #openstack-requirements08:50
*** hberaud has joined #openstack-requirements09:00
*** hberaud has quit IRC09:06
*** udesale has quit IRC09:07
*** hberaud has joined #openstack-requirements09:15
*** e0ne has quit IRC09:16
*** hberaud has quit IRC10:09
*** hberaud has joined #openstack-requirements10:10
*** hberaud has quit IRC10:22
*** hberaud has joined #openstack-requirements10:23
*** e0ne has joined #openstack-requirements10:32
*** brinzhang has joined #openstack-requirements10:36
*** e0ne has quit IRC11:16
*** udesale has joined #openstack-requirements11:17
*** iurygregory has quit IRC11:26
*** brinzhang_ has joined #openstack-requirements11:40
*** brinzhang has quit IRC11:43
*** brinzhang_ has quit IRC11:46
*** witek_ has quit IRC14:05
smcginnisI do not like having services in upper constraints either. But I also do not think it's upstreams place to exclude those just so someone can install a fork of a service. That's entirely a downstream concern that has to be dealt with by maintaining its own upper constraints.14:05
smcginnisDon't install a fork.14:06
smcginnis(easy for me to say, I know)14:06
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for oslo.log to new release 4.0.1  https://review.opendev.org/70973114:23
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for oslo.config to new release 8.0.1  https://review.opendev.org/70973614:28
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for oslo.rootwrap to new release 6.0.1  https://review.opendev.org/70973714:29
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for oslo.utils to new release 4.0.1  https://review.opendev.org/70973814:30
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for oslo.concurrency to new release 4.0.1  https://review.opendev.org/70973914:32
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for oslo.middleware to new release 4.0.1  https://review.opendev.org/70974014:32
openstackgerritOpenStack Proposal Bot proposed openstack/requirements master: update constraint for oslo.vmware to new release 3.1.0  https://review.opendev.org/70974114:35
*** iurygregory has joined #openstack-requirements15:05
*** irclogbot_2 has quit IRC15:27
*** irclogbot_0 has joined #openstack-requirements15:29
*** e0ne has joined #openstack-requirements15:49
*** e0ne has quit IRC15:54
*** e0ne has joined #openstack-requirements16:09
*** e0ne has quit IRC16:16
prometheanfirehmm, reqs being generated don't have python_version correct16:29
prometheanfiresmcginnis: how does the releases repo submit jobs to reqs?  (doesn't seem to obey python_version)16:30
smcginnisprometheanfire: Do you have an example?16:31
smcginnisIt's just a script in the release playbooks.16:31
smcginnisOh, I see https://review.opendev.org/#/c/709740/1/upper-constraints.txt16:32
smcginnisOdd. I thought that had been working right. I wonder if something changed?16:32
prometheanfiresmcginnis: ya, I agree with you, though I will say that the reason I want them gone from reqs/constraints is because the service as lib thing16:32
smcginnisIn a meeting now, but I will take a look a little later.16:33
* prometheanfire shrugs16:34
*** camelCaser has quit IRC16:42
*** camelCaser has joined #openstack-requirements16:43
smcginnishttps://opendev.org/openstack/project-config/src/branch/master/roles/copy-release-tools-scripts/files/release-tools/update_constraints.sh16:44
prometheanfirefun16:45
smcginnisI think the issue is this? https://opendev.org/openstack/project-config/src/branch/master/roles/copy-release-tools-scripts/files/release-tools/update_constraints.sh#L10716:45
*** iurygregory has quit IRC16:48
openstackgerritMerged openstack/requirements stable/rocky: update constraint for keystonemiddleware to new release 5.2.2  https://review.opendev.org/70959516:50
openstackgerritMerged openstack/requirements stable/rocky: update constraint for keystoneauth1 to new release 3.10.1  https://review.opendev.org/70959616:50
openstackgerritMerged openstack/requirements stable/train: update constraint for keystoneauth1 to new release 3.17.2  https://review.opendev.org/70963216:50
*** udesale has quit IRC17:04
*** vishalmanchanda has quit IRC17:11
*** e0ne has joined #openstack-requirements17:16
*** evrardjp has quit IRC17:39
*** evrardjp has joined #openstack-requirements17:39
*** e0ne has quit IRC18:27
*** e0ne has joined #openstack-requirements18:28
smcginnisprometheanfire: Think I have a fix - https://review.opendev.org/#/c/709809/18:30
*** hberaud has quit IRC18:40
*** ralonsoh has quit IRC18:42
*** e0ne has quit IRC18:44
prometheanfirecool18:46
*** e0ne has joined #openstack-requirements22:20
*** e0ne has quit IRC22:21
*** e0ne has joined #openstack-requirements22:21
*** migawa|lunch is now known as masayukig22:39
*** e0ne has quit IRC23:34
*** tosky has quit IRC23:52

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!