Friday, 2022-05-20

fricklerI had this bug in early jammy testing where pip was missing in a venv (duplicate of https://bugs.launchpad.net/ubuntu/+source/python3.10/+bug/1962791)05:46
fricklerI wonder whether the fix for that may be related to this05:46
*** lajoskatona_ is now known as lajoskatona08:29
fungiclarkb: dansmith: something similar-sounding came up in the python discourse today, regarding apple's patched sysconfig in the python shipped in xcode, i wonder if the distro package could be doing something similar? https://github.com/pypa/pip/blob/22.1/src/pip/_internal/locations/__init__.py#L486-L49811:48
fungihttps://discuss.python.org/t/understanding-site-packages-directories/12959/1711:52
noonedeadpunkHey there! Sorry, I didn't dig too much, decieded to ask stupid question at once. Were there some changes of merging heat plugin to core of tempest or smth like that?15:03
noonedeadpunkAs when I'm installing heat-tempest-plugin tempest cli just falls apart15:03
noonedeadpunkie `tempest workspace list`  silently exist with rc115:03
noonedeadpunkthe moment I drop heat plugin things are good15:04
noonedeadpunkSeing https://opendev.org/openstack/tempest/src/branch/master/tempest/services/orchestration/json/orchestration_client.py sounds like it it15:06
noonedeadpunkbut don't see tests at same time15:06
noonedeadpunkMost frustrating part is that even no stack trace is shown15:15
gmannnoonedeadpunk: no, there is no plan to merge heat plugin into tempest. orchestration_client.py in tempest is supposed to be removed. I remember i had kept it as todo because it has some dependency on murano tempest plugin. I will start fixing the deps and remove it from tempest tree,.15:18
gmannnoonedeadpunk: orchestration_client.py is pending work of migrating heat tests into heat-tempest-plugin15:18
noonedeadpunkThen I wonder if I'm the only one who can't init workspace when heat plugin is installed15:18
noonedeadpunkI don't know tempest code good enough. So if you have some guess where to start looking - that would be helpful:)15:19
noonedeadpunkjust in case I tried tempest==30.1.0 and 29.2.0, heat plugin - 1.5.0, 1.4.015:20
noonedeadpunkI can reproduce it with just `pip install tempest heat-tempest-plugin`15:23
noonedeadpunkhttps://paste.openstack.org/show/bIVgD948OUQ2e1XpScoT/15:24
clarkbfungi: as far as I could tell the behavior I described and patched for us all upstream code related15:24
clarkbfungi: the problem arises on my suse machine as well if I do editable installs in a virtualenv which should be very isolated from the distro15:25
noonedeadpunkAnd I bet that happens just after some dependancy update, as this started failing several weeks ago without changing a thing in CI15:25
clarkbfungi: reading that linked message this may explain why only 3.10 beraks hard though15:26
gmannnoonedeadpunk:  it seems heat-tempest-plugin installation issue. Tempest is installing all fine. 15:27
gmannnoonedeadpunk: "  ERROR: Failed building wheel for Yappi" may be clarkb or fungi can help here 15:28
noonedeadpunkIt fallsback actually 15:28
noonedeadpunk`Running setup.py install for Yappi ... done`15:28
noonedeadpunkso wheel fails, but installation of it is done at the end15:29
noonedeadpunkBut should actually tempest cli jsut silently fail because of some plugin being weird at all?15:29
gmannthat's the latest run of heat-tempest-plugin but 10 days ago, not sure if that is happening in our jobs too  https://review.opendev.org/c/openstack/heat-tempest-plugin/+/84113615:29
clarkbnoonedeadpunk: gmann: that isn't a failure15:30
clarkbits a weird pip behavior where it tries to build a wheel for the package first to install the wheel. But if that fails it falls back to making an sdist15:30
noonedeadpunkyup^15:30
clarkbin this case the wheel build failed because you don't have the `wheel` packge installed which gives it the ability to run15:30
clarkbbut it isn't a failure15:30
gmannok15:31
gmannnoonedeadpunk: you can check if plugin is installed or not via 'tempest list-plugins'. but tempest workspace cli does not fail if any explicit installation of plugin is failed. 15:31
gmannnoonedeadpunk: what is exact error you are getting in tempest cli15:33
gmannnoonedeadpunk: and you are not creating any workspace just running 'tempest workspace list'  ?15:34
clarkbon a newly held jammy node I have a dist-info dir for dbcounter but no dbcounter.py under dist-packages which is what I expect based on a local install16:39
clarkbso it seems there is another problem on jammy16:39
clarkbdbcounter.py is not ending up in the SOURCES.txt or RECORD files16:41
opendevreviewClark Boylan proposed openstack/devstack master: DNM debugging jammy pip install stuff  https://review.opendev.org/c/openstack/devstack/+/84262016:52
clarkbI think ^ may fix it. If that manages to pass I'll clean up the change and propose it as something that is mergable16:53
noonedeadpunkgmann: it;s installed - `| heat | heat_tempest_plugin.plugin:HeatTempestPlugin |`17:42
noonedeadpunkgmann: in tempest workspace list I don't get literally anything17:42
noonedeadpunk*for `tempest workspace list` Same goes if I want to init new workspace17:43
gmannnoonedeadpunk: you need to use this  'tempest list-plugins' to know/list all installed plugins. 'tempest workspace' is separate things. let me know if you created/init the workspace and list does not show that workspace17:44
gmannthis is workflow of 'tempest workspace' https://docs.openstack.org/tempest/16.1.0/workspace.html17:45
gmannhttps://docs.openstack.org/tempest/latest/workspace.html17:45
noonedeadpunkgmann: https://paste.openstack.org/show/b0u2RAEsc8bjYDJVzVMr/17:46
gmanncool, so heat plugin is there17:46
noonedeadpunkyup. And that was the only thing I installed for testing :)17:47
clarkbwhat is the actual failure? I don't think we've seen that yet?17:56
bkopilov_gmann, Hi , please review , let me know what do you think ?  https://review.opendev.org/c/openstack/tempest/+/84041017:59
gmannnoonedeadpunk: so you are not creating/registering the workspace so what is the expectation and did not work17:59
gmannbkopilov_: ack, I was waiting for unit test which you added. will check today17:59
bkopilov_gmann, perfect thanks a lot !18:00
gmannnp!18:00
noonedeadpunkgmann: sorry didn't really got question. Expectation is that `tempest init --name workspace $path` or `tempest workspace list` works :)18:08
noonedeadpunkgmann: basically we have script https://opendev.org/openstack/openstack-ansible-os_tempest/src/commit/c3a2a979744a617b04e384846a6a2b016784e19d/tasks/tempest_post_install.yml#L89-L12318:08
noonedeadpunkand when we have heat installed, all CI fails18:09
noonedeadpunkWhich basically also blocks magnum, sahara and several more CI 18:09
gmannok, let me check. Its been while I have tried workspace cli18:10
noonedeadpunkshouldn't it be used? what's the recommended way?18:15
noonedeadpunkas I guess if you want to run tempest not in CI, workspaces make sense, right?18:16
gmannnoonedeadpunk: yes, workspace make more sense and should work. btw where you are registering the workspace ?18:20
noonedeadpunkgmann: Tried `/root/workspace`  but in script it's basically $HOME18:21
noonedeadpunkor well, `tempest init --name workspace /root/workspace` but it also fails silently with return code 118:21
gmannnoonedeadpunk:  'tempest workspace list' and register working fine. let me try with tempest init18:39
noonedeadpunkum....18:40
noonedeadpunkhow's that possible....18:41
noonedeadpunkI guess I know what's the issue....18:41
noonedeadpunkIt doesn't like `[heat_plugin]/endpoint_type = internalURL` in /etc/tempest/tempest.conf. I didn't know that workspace init would read and rely on that18:43
noonedeadpunkbecause it should be ``[heat_plugin]/endpoint_type = internal`18:44
noonedeadpunkuh18:44
opendevreviewClark Boylan proposed openstack/devstack master: Fix dbcounter installation on Jammy  https://review.opendev.org/c/openstack/devstack/+/84262018:44
noonedeadpunkI wish failure output was more verbose :)18:44
clarkbdansmith: frickler ^ I expect that change is mergeable now and hopefully I've written enough text about the situation to explain all the weirdness here18:44
noonedeadpunkgmann: thanks a lot for help and sorry for wasting your time18:45
noonedeadpunkBut I wouldn't catch that without you ;)18:45
gmannnoonedeadpunk: ok, i ran init also and worked fine for me. 18:52
gmannnoonedeadpunk: I see, so tempest config things can cause these error as you mentioned18:52
gmannbecause init do parse the config file and udpate it18:53
noonedeadpunkthe worst part is it's silent...18:53
noonedeadpunkhaving stack trace would be so much a relief....18:53
gmannyeah, we should put some log or stop there18:54
* noonedeadpunk really hopes that `internal` is valid this for _all_ plugins18:54
gmannnoonedeadpunk: tempest accept both but seems like heat does not https://github.com/openstack/heat-tempest-plugin/blob/master/heat_tempest_plugin/config.py#L7918:56
gmannoctavia plugin also https://github.com/openstack/octavia-tempest-plugin/blob/master/octavia_tempest_plugin/config.py#L48-L5118:57
gmannbut 'internal' should work for all18:57
noonedeadpunkyeah. already pushed https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/84275819:01
noonedeadpunkthanks a lot!19:01
gmann+119:02
opendevreviewGhanshyam proposed openstack/tempest master: Add py310 job in gate  https://review.opendev.org/c/openstack/tempest/+/83214419:09
opendevreviewGhanshyam proposed openstack/grenade master: Do not run grenade-skip-level job on older stable branches  https://review.opendev.org/c/openstack/grenade/+/84279919:25
opendevreviewMerged openstack/eslint-config-openstack master: Switch testing to Zed testing runtime  https://review.opendev.org/c/openstack/eslint-config-openstack/+/84049422:28
opendevreviewMerged openstack/karma-subunit-reporter master: Switch testing to Zed testing runtime  https://review.opendev.org/c/openstack/karma-subunit-reporter/+/84049622:29

Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!