Wednesday, 2018-11-28

*** hoonetorg has quit IRC00:09
*** tosky has quit IRC00:13
*** hoonetorg has joined #openstack-sahara00:22
*** pcaruana has joined #openstack-sahara05:09
*** rcernin has quit IRC06:57
openstackgerritVieri proposed openstack/python-saharaclient master: add python 3.6 unit test job  https://review.openstack.org/62051707:54
*** tosky has joined #openstack-sahara08:51
*** chason has quit IRC11:31
*** chason has joined #openstack-sahara11:36
*** dave-mccowan has joined #openstack-sahara11:45
*** tomtom001 has joined #openstack-sahara15:37
tomtom001Hello, I'm configuring Sahara for Queens and getting an Unauthorized message when HaProxy tries to run the /healthcheck...  I've been trying to find some instruction or details of how that should be setup to operate correctly.  Does anyone have any website or doc they can point me to so that I can try and figure out why it's unauthorized?15:40
toskyuh, I don't remember any specific configuration for that, but I only tried devstack (where I think it's not used), packstack (same) and tripleo (where it's magically configured)16:32
toskyany specific configuration on the sahara side, I mean16:32
toskyI don't remember about ansible-os_sahara16:32
tomtom001yeah it's supposed to be magically configured on the ansible-os_sahara side too, but it doesn't work which is why I'm asking about any specific health check settings I can look for.16:52
*** pcaruana has quit IRC17:03
GaasmannHello. We're upgrading to Rocky and I encounter an issue with Sahara. I think sahara-api might send bogus requests to keystone. I have those messages on sahara logs: http://paste.openstack.org/show/736327/17:15
GaasmannI'm not sure if it's a Sahara problem or a kolla-ansible one or a simple configuration issue on my side. Does it ring some bells?17:16
tellesnobregaHi Gaasmann, I've never seen this before17:31
tomtom001How can I test the healthcheck for sahara for myself either through curl or a web browser?  I'm using OpenStack Queens and am a little stuck on why I can't make those requests?17:55
tellesnobregahi tomtom00117:57
tellesnobregaI will be right over, on a meeting now18:01
Gaasmannhttp://paste.openstack.org/show/736333/ It seems Sahara do a POST /v3/auth/tokens but the payload contains null for password. Do you know in which part of the configuration the password is? Is it keystone_authtoken?18:10
toskyfrom which version did you upgrade? From Queens18:17
tosky?18:17
toskyGaasmann: also, how did you originally deployed it?18:18
toskyand when does sahara print that error? When it starts, or periodically?18:19
toskyat some point we moved few options from the [keystone_auth] configuration section to a new [trustee] configuration section, even if the old options should still work18:21
tellesnobregatomtom001, you can test it using cli18:22
tellesnobregahttps://github.com/openstack/python-saharaclient/blob/0d9d8264b19c6108c8093f3a47803dfc70d6bae6/saharaclient/osc/v1/clusters.py18:22
toskytomtom001: about healthccheck, just to be sure: this is not the internal healthcheck for clusters deployed inside sahara, right?18:22
Gaasmanntosky: I am on a fresh install of Rocky18:23
toskyif it's an haproxy thing, I really don't know - and probably not even sure18:23
Gaasmannusing kolla-ansible18:23
toskyGaasmann: deployed how?18:23
toskyoh, uh18:23
toskycheck sahara.conf and see if keystone_auth is filled, or better if there is trustee section18:23
tomtom001tosky: right, this is haproxy doing a service healthcheck on the sahara processes18:23
toskyalso, when does the error happen? On start or periodically?18:23
toskytomtom001: (sorry) not even sure that it's a sahara-specific thing18:24
Gaasmannthe error happens on requests, like openstack dataprocessing plugin list18:24
toskyI would say that kolla-ansible is not configuring something properly18:24
Gaasmannfor conf section, I have keystone_authtoken, service_credentials and trustee18:25
tomtom001tosky ok, so how can I run the healthcheck on sahara?18:25
toskytomtom001: I don't know haproxy18:26
toskyI don't know what healthcheck means in the haproxy contest18:26
toskycontext*18:26
tomtom001tosky, ok so sahara can't be reached on http://localhost:8386/healthcheck, or there's no such thing at all?18:27
toskytomtom001: if it's there, it's provided by a some library (oslo.middleware?), not by sahara-specific code18:29
toskyGaasmann: and which keys are there?18:29
* tosky really need to go, back later18:29
tellesnobregatomtom001, no such thing from sahara side18:30
Gaasmanntosky: http://paste.openstack.org/show/736334/18:32
tellesnobregaGaasmann, it all looks in place18:41
openstackgerritNicolas Haller proposed openstack/sahara master: Add DEBIAN_FRONTEND=noninteractive in front of apt-get install commands  https://review.openstack.org/62039620:12
toskyGaasmann: I'm pretty much sure that admin_user, admin_password and admin_tenant_name should not live in keystone_authtoken20:17
toskybut it may be unrelated20:18
GaasmannI'll try20:18
Gaasmannsame result, I'll dig into the code20:32
toskyuhm20:35
*** openstackgerrit has quit IRC20:36
toskyit's something in the kolla-ansible configuration - I didn't see this issue with devstack, packstack and tripleo20:36
Gaasmanndo you have an example of configuration so I can compare with mine?21:00
toskyGaasmann: this is freshly generated from devstack/master, but it should not be too different: http://paste.openstack.org/show/736339/21:09
Gaasmanngreat, thanks21:11
Gaasmannok, this is it21:16
Gaasmannyou were right about the admin_* and then, the password/username/project_name/project_domain_name/user_domain_name were missing21:18
GaasmannI'll check on kolla-ansible now :-)21:19
toskyGaasmann: but the password/username/project_name/project_domain_name/user_domain_name should not be needed if you defined them in [trustee]21:23
toskyGaasmann: see https://docs.openstack.org/releasenotes/sahara/queens.html#deprecation-notes21:24
Gaasmannho, I replicated what I see in the file you paste me21:24
toskyuhm21:24
GaasmannI'll try with those variables removed from keystone_authtoken21:25
toskyso does it work if you replicate the same structure from the devstack configuration file?21:27
Gaasmannyes21:31
GaasmannI can't remove the variables from keystone_authtoken, otherwise, sahara seems to connect to 127.0.0.1:35357 but there is nothing there21:34
toskyuhm, I will ask Jeremy again about that21:36
toskyanyway, ok, good to hear21:37
Gaasmannthanks for the help21:37
toskyyou may want to tell kolla-ansible people that they need to fix the setup21:39
toskyand thanks for testing!21:39
Gaasmannsure, I'll push a patch and discuss with them21:40
*** rcernin has joined #openstack-sahara21:50
*** rcernin has quit IRC22:03
*** rcernin has joined #openstack-sahara22:12
*** openstackgerrit has joined #openstack-sahara23:30
openstackgerritTobias Urdin proposed openstack/puppet-sahara master: Remove auth_uri  https://review.openstack.org/62074723:30

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!