| opendevreview | Artem Goncharov proposed openstack/devstack master: Enable keystone token caching by OSC https://review.opendev.org/c/openstack/devstack/+/886339 | 07:02 |
|---|---|---|
| opendevreview | Artem Goncharov proposed openstack/devstack master: Enable keystone token caching by OSC https://review.opendev.org/c/openstack/devstack/+/886339 | 09:07 |
| opendevreview | Dr. Jens Harbott proposed openstack/devstack master: DNM testing /opt moving performance https://review.opendev.org/c/openstack/devstack/+/858996 | 11:24 |
| frickler | kopecmartin: fyi I'll have to miss today's PTG sessions, will try to catch up later | 12:18 |
| kopecmartin | frickler: ack, no worries, we practically went through everything on Tuesday, today's session is just in case someone else wants to join or raise a topic that hasn't been discussed yet | 12:40 |
| gmann | frickler: kopecmartin: dansmith: this is enabling neutron new RBAC by default in devstack https://review.opendev.org/c/openstack/devstack/+/899306 | 13:15 |
| gmann | it was enabled in neutron in bobcat release | 13:15 |
| opendevreview | Lajos Katona proposed openstack/tempest master: Remove tap-as-a-service-tempest-plugin https://review.opendev.org/c/openstack/tempest/+/899400 | 13:44 |
| opendevreview | Merged openstack/devstack master: Enable NEUTRON_ENFORCE_SCOPE to True by default https://review.opendev.org/c/openstack/devstack/+/899306 | 15:28 |
| harsh | Hi Folks, i am having issues in installing devstack on ubuntu 20.04 LTS | 16:21 |
| harsh | Tried to install stable/yoga with python 3.8 and python3.6 both but it is failing | 16:22 |
| harsh | The service devstack@q-ovn-metadata-agent.service | 16:22 |
| harsh | is not getting started. | 16:22 |
| harsh | The only relevant bug that i found on this is https://bugs.launchpad.net/neutron/+bug/1966858?comments=all | 16:23 |
| harsh | But even after downgrading python to 3.6 and changing the permissions of /opt/stack/ , I am getting the same issue. | 16:24 |
| harsh | Can anyone help on this please ? | 16:24 |
| clarkb | harsh: the first thing to note is that 20.04 doesn't have python3.6 I don't think. I'm not sure what version of ubuntu yoga was tested with but that is where I'd start. Also you should look at the logs for q-ovn-metadata-agent and see what the error is | 16:25 |
| clarkb | but without an error it is hard to say what is wrong | 16:25 |
| clarkb | yoga was tested with 20.04 from what I can see so python3.8 + devstack yoga should be fine | 16:26 |
| harsh | Yes i had python 3.8 but after seeing the launchpad bug i tried it with python3.6 | 16:28 |
| clarkb | you should find the error from the q-ovn-metadata-agent service log and work from there. Devstack should have logs for each of hte services in its directory somewhere. You can also ask journalctl -u q-ovn-metadata-agent.service for logs too I think | 16:28 |
| harsh | Ok let me try to find that | 16:31 |
| harsh | Oct 26 16:36:42 a9kagl3-2 neutron-ovn-metadata-agent[104154]: ERROR neutron File "/usr/local/lib/python3.8/dist-packages/oslo_privsep/daemon.py", line 358, in __init__ | 16:39 |
| harsh | Oct 26 16:36:42 a9kagl3-2 neutron-ovn-metadata-agent[104154]: ERROR neutron raise FailedToDropPrivileges(msg) | 16:39 |
| harsh | Oct 26 16:36:42 a9kagl3-2 neutron-ovn-metadata-agent[104154]: ERROR neutron oslo_privsep.daemon.FailedToDropPrivileges: privsep helper command exited non-zero (96) | 16:39 |
| harsh | Oct 26 16:36:42 a9kagl3-2 neutron-ovn-metadata-agent[104154]: ERROR neutron | 16:39 |
| harsh | Oct 26 16:36:42 a9kagl3-2 neutron-ovn-metadata-agent[104167]: INFO oslo_service.service [-] Parent process has died unexpectedly, exiting | 16:39 |
| harsh | Oct 26 16:36:42 a9kagl3-2 systemd[1]: devstack@q-ovn-metadata-agent.service: Main process exited, code=exited, status=1/FAILURE | 16:39 |
| harsh | Oct 26 16:36:42 a9kagl3-2 neutron-ovn-metadata-agent[104164]: INFO oslo_service.service [-] Parent process has died unexpectedly, exiting | 16:39 |
| harsh | Oct 26 16:36:42 a9kagl3-2 systemd[1]: devstack@q-ovn-metadata-agent.service: Failed with result 'exit-code'. | 16:39 |
| harsh | clarkb : i tried to start the service and captured the journalctl logs. Here is the error that i see. | 16:40 |
| clarkb | harsh: can you use a paste service like https://paste.opendev.org to paste the entire traceback? That looks like the privsep service is failing to start because it can't drop privleges appropriately. I think that is idfferent than the bug you linked | 16:43 |
| harsh | https://paste.opendev.org/show/bemLdtsQGZU5jWrWr0Xf/ | 16:45 |
| clarkb | https://opendev.org/openstack/oslo.privsep/src/branch/stable/yoga/oslo_privsep/daemon.py#L351-L358 is what fails | 16:48 |
| clarkb | oh the error is right there privsep log: /usr/local/bin/neutron-rootwrap: Executable not found: privsep-helper (filter match = privsep-helper) | 16:48 |
| clarkb | the privsetp-helper command is not found. I don't know where that originates. Lets see if we can figure that out | 16:49 |
| clarkb | that comes from https://opendev.org/openstack/oslo.privsep/src/branch/stable/yoga/setup.cfg#L30 can you check that oslo.privsep is installed? Something like `pip freeze | grep privsep` and also `which privsep-helper` | 16:51 |
| clarkb | But this si quickly getting beyond my current openstack and devstack knowledge. Importantly we know what is actually failing now. privsep-helper can't be found so the whole privsep daemon process exits non zero (it returend 96) indicating an error | 16:52 |
| clarkb | the bug you linked is similar but not quite the same. However the cause may be the same? file permissions preventing access to the privsep helper | 16:53 |
| clarkb | but I'm not sure of that | 16:53 |
| clarkb | https://review.opendev.org/c/openstack/devstack/+/838645/3/doc/source/guides/single-machine.rst is the doc update that was made for newer ubuntu which shouldn't be necessary on the version you've got but maybe check the permissions on your devstack directory | 17:07 |
| clarkb | just to rule that out at least | 17:07 |
| harsh | I checked the privsep and it is oslo.privsep==2.7.0 | 17:09 |
| clarkb | ok thats good, we know it is installed. The next thing to check is that the privsep-helper command was installed too | 17:10 |
| harsh | Regarding the permissions, /opt/stack/ has executable permission for all the users : 755 | 17:11 |
| opendevreview | James Parker proposed openstack/whitebox-tempest-plugin master: Add test support for bochs display device https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/899420 | 17:30 |
| harsh | clarkb : I don't see which privsep command is being run here. Also, i see a similar bug https://lists.openstack.org/pipermail/openstack-discuss/2021-April/021645.html | 17:48 |
| harsh | But in this bug also it just says to fix the permissions. | 17:49 |
| clarkb | harsh: the command is `privsep-helper` according to the log you pasted then I quoted above. This bit: `privsep log: /usr/local/bin/neutron-rootwrap: Executable not found: privsep-helper (filter match = privsep-helper)` | 17:50 |
| clarkb | this is why I asked if `which privsep-helper` returns anything to check the command exists | 17:50 |
| harsh | Oh.. `which privsep-helper' doesn't return anything. But when i am running 'privsep-helper' it says to install it using: apt install python3-oslo.privsep | 17:52 |
| harsh | I have installed it. Now it says it requires options so i guess the module is not present. Let me restack it see if this time it finds the executable. | 17:55 |
| clarkb | harsh: you don't want to install it form the distro | 17:56 |
| clarkb | devstack should install it when devstack installs oslo.privsep | 17:56 |
| clarkb | you'll probably want to look in your devstack logs to see where it installs oslo.privsep and work from there to see why that command isn't being installed | 17:56 |
| harsh | in my devstack logs it says Requirement for oslo.privsep is satisfied. Means oslo.privsep==2.7 is already present. But still privsep-helper installation log is not not there | 18:00 |
| clarkb | harsh: you need to look earlier in the run to see the installation occur | 18:00 |
| * clarkb double checks versions | 18:00 | |
| clarkb | https://opendev.org/openstack/oslo.privsep/src/tag/2.7.0/setup.cfg#L30 2.7.0 does specify that the command should be installed. Other possibility is that it isn't isntalling it to the correct location | 18:01 |
| clarkb | I need to step out now. But that is the underlying cause of the problem so need ot track it down. Why is privsep-helper not available to neutron | 18:02 |
| harsh | Sure. thanks for all the help clarkb. Have a good day :) | 18:02 |
| harsh | clarkb : i know you are out but just wanted to update you that installing python3-oslo.privsep manually using the command 'sudo apt install python3-oslo.privsep' solved the problem and now devstack has installed successfully | 18:36 |
| harsh | I don't know why devstack script didn't install it on it own. I'll keep looking into it but for now this manual installation is the workaround. Thankyou so much for all your help :) | 18:37 |
| opendevreview | James Parker proposed openstack/whitebox-tempest-plugin master: Add test support for bochs display device https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/899420 | 19:54 |
| opendevreview | James Parker proposed openstack/whitebox-tempest-plugin master: Add test support for bochs display device https://review.opendev.org/c/openstack/whitebox-tempest-plugin/+/899420 | 21:27 |
Generated by irclog2html.py 2.17.3 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!