| *** gyee has quit IRC | 00:10 | |
| *** hamzy has joined #openstack-ansible | 00:10 | |
| *** altlogbot_0 has quit IRC | 00:10 | |
| *** altlogbot_2 has joined #openstack-ansible | 00:11 | |
| *** tuxjohnson has joined #openstack-ansible | 00:19 | |
| *** tuxjohnson has left #openstack-ansible | 00:19 | |
| *** sreejithp_ has quit IRC | 00:21 | |
| *** sreejithp has joined #openstack-ansible | 00:22 | |
| *** sreejithp_ has joined #openstack-ansible | 00:25 | |
| *** sreejithp has quit IRC | 00:28 | |
| *** sreejithp_ has quit IRC | 00:37 | |
| *** sreejithp has joined #openstack-ansible | 00:37 | |
| *** jamesdenton has joined #openstack-ansible | 00:44 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_glance master: db_setup: refactor database setup to a common file https://review.opendev.org/657029 | 01:52 |
|---|---|---|
| *** sreejithp has quit IRC | 02:07 | |
| *** djhankb has joined #openstack-ansible | 02:29 | |
| *** vnogin has joined #openstack-ansible | 02:36 | |
| *** vnogin has quit IRC | 02:40 | |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_glance master: db_setup: refactor database setup to a common file https://review.opendev.org/657029 | 02:43 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible stable/stein: Bump tempest role SHA to pull in ping test fix https://review.opendev.org/660547 | 02:44 |
| *** nicolasbock has quit IRC | 02:45 | |
| logan- | could i have reviews on https://review.opendev.org/#/c/660547/ https://review.opendev.org/#/c/616407/ and https://review.opendev.org/#/c/659714/ please | 02:46 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_keystone master: db_setup: refactor database setup to a common file https://review.opendev.org/657036 | 03:50 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_nova master: db_setup: refactor database setup to a common file https://review.opendev.org/657038 | 03:53 |
| *** sreejithp has joined #openstack-ansible | 04:03 | |
| *** sreejithp has quit IRC | 04:07 | |
| *** udesale has joined #openstack-ansible | 04:11 | |
| *** markvoelker has joined #openstack-ansible | 04:14 | |
| snadge | so my AIO is working.. i can create instances that have combinations of the default private/public network | 04:17 |
| *** markvoelker has quit IRC | 04:18 | |
| snadge | very impressed so far.. but now I'm going to probably need to learn the ins and outs of networking | 04:19 |
| snadge | by default we have no local resolver.. its configured to use one that isn't running.. and no nat on either the private or public interface by default either | 04:19 |
| guilhermesp | noonedeadpunk: huum seems that nfs and v2_registry are broken for a while https://review.opendev.org/#/q/project:openstack/openstack-ansible-os_glance+status:open | 04:23 |
| *** ivve has quit IRC | 04:26 | |
| logan- | i thought registry got combined into api at some point | 04:27 |
| guilhermesp | yeah same logan- | 04:28 |
| logan- | https://specs.openstack.org/openstack/glance-specs/specs/newton/approved/glance/deprecate-registry.html | 04:28 |
| guilhermesp | yeah, i think we don't need that job anymore... but seems that the error is unrelated and happens on both nfs and registry senario? http://logs.openstack.org/29/657029/5/check/openstack-ansible-v2_registry_enabled/3bb8e0c/job-output.txt.gz#_2019-05-22_03_00_40_600281 | 04:29 |
| logan- | i do remember working with odyssey4me on the glance registry v1/v2 stuff around newton timeframe, i wonder if this "registry v2" is the combined thing | 04:30 |
| logan- | ouch | 04:31 |
| guilhermesp | https://github.com/openstack/openstack-ansible-os_glance/commit/4fa98725102f98700ddc0844272222ab7b8bfea1 | 04:31 |
| logan- | logs are pretty useless http://logs.openstack.org/29/657029/5/check/openstack-ansible-v2_registry_enabled/3bb8e0c/logs/host/lxc/lxc-openstack1.log.txt.gz | 04:31 |
| logan- | nice todo there in that patch guilhermesp :) | 04:32 |
| logan- | hmm although that relates to registry v1 i think | 04:32 |
| guilhermesp | yeah, right in time :) | 04:32 |
| logan- | which we disabled several cycles ago, so it should certainly be safe to remove all v1 stuff now | 04:33 |
| guilhermesp | more stuff to clean up | 04:33 |
| logan- | oh i see v1 was removed in queens, v2 in stein | 04:33 |
| logan- | according to the notes here https://github.com/openstack/openstack-ansible-os_glance/commit/4fa98725102f98700ddc0844272222ab7b8bfea1#diff-7eeda618087b49ae876084ab6c73fdbbR69 | 04:33 |
| logan- | what branch is this on | 04:34 |
| logan- | master? | 04:34 |
| guilhermesp | yes | 04:34 |
| logan- | because i notice that lxc create failure is a xenial node | 04:34 |
| guilhermesp | which means registry code is removed already? | 04:35 |
| logan- | yep | 04:35 |
| logan- | registry is gone, xenial is gone | 04:35 |
| guilhermesp | so I assume we drop these two jobs | 04:35 |
| guilhermesp | they are useless for us now | 04:36 |
| logan- | yeah I think similar to the lbaas/placement stuff we need to rip out the tests and registry tasks/vars | 04:36 |
| guilhermesp | https://github.com/openstack/openstack-ansible-os_glance/blob/master/zuul.d/jobs.yaml#L19 | 04:36 |
| logan- | the nfs test could probalby just be updated to use a bionic node | 04:37 |
| guilhermesp | huum good point | 04:37 |
| guilhermesp | I can patch it now to remove the v2 xenial job | 04:37 |
| guilhermesp | and update the nfs to bionic | 04:37 |
| logan- | ok, late here, i'm off for the night. ttyl! | 04:38 |
| guilhermesp | late here too, almost 2am hahaha | 04:38 |
| guilhermesp | o/ logan- | 04:38 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_glance master: Drop v2 registry job and ubuntu-xenial nodeset https://review.opendev.org/660558 | 04:49 |
| openstackgerrit | Guilherme Steinmuller Pimentel proposed openstack/openstack-ansible-os_glance master: db_setup: refactor database setup to a common file https://review.opendev.org/657029 | 04:50 |
| *** radeks_ has joined #openstack-ansible | 04:59 | |
| *** radeks_ has quit IRC | 05:05 | |
| *** radeks_ has joined #openstack-ansible | 05:06 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/rocky: Update Calico Felix to v3 https://review.opendev.org/659714 | 05:14 |
| *** CeeMac has quit IRC | 05:28 | |
| *** jrosser has quit IRC | 05:29 | |
| *** mwhahaha has quit IRC | 05:30 | |
| *** fresta has quit IRC | 05:32 | |
| *** CeeMac has joined #openstack-ansible | 05:33 | |
| *** fresta has joined #openstack-ansible | 05:33 | |
| *** mwhahaha has joined #openstack-ansible | 05:33 | |
| *** jrosser has joined #openstack-ansible | 05:34 | |
| *** vnogin has joined #openstack-ansible | 05:35 | |
| *** ivve has joined #openstack-ansible | 05:39 | |
| *** vnogin has quit IRC | 05:40 | |
| *** raukadah is now known as chandankumar | 05:44 | |
| *** ivve has quit IRC | 05:54 | |
| *** kopecmartin|off is now known as kopecmartin | 06:06 | |
| *** markvoelker has joined #openstack-ansible | 06:15 | |
| *** starborn has joined #openstack-ansible | 06:23 | |
| *** cshen has joined #openstack-ansible | 06:23 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_glance master: Clarify supported SUSE versions https://review.opendev.org/660077 | 06:32 |
| *** markvoelker has quit IRC | 06:49 | |
| *** joshualyle has quit IRC | 07:02 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_tacker master: Clarify supported distro versions https://review.opendev.org/660291 | 07:12 |
| *** pcaruana has joined #openstack-ansible | 07:17 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-galera_client master: Add linter jobs https://review.opendev.org/660584 | 07:18 |
| openstackgerrit | Merged openstack/openstack-ansible stable/stein: Bump tempest role SHA to pull in ping test fix https://review.opendev.org/660547 | 07:18 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-galera_client master: Add integrated coverage https://review.opendev.org/660319 | 07:20 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-galera_client master: Make coverage consistent https://review.opendev.org/660319 | 07:20 |
| *** tosky has joined #openstack-ansible | 07:21 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-memcached_server master: Add integrated coverage https://review.opendev.org/660322 | 07:21 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-openstack_openrc master: Add integrated coverage https://review.opendev.org/660331 | 07:23 |
| evrardjp | logan-: I adapted to add linters. But it's very confusing to me that we reduce the scope of the testing by not having role tests at all. I guess we should do some extra pass to convert the role tests to the new mechanisms. | 07:25 |
| *** luksky has joined #openstack-ansible | 07:29 | |
| *** hwoarang has quit IRC | 07:29 | |
| *** pnull has quit IRC | 07:32 | |
| jrosser | evrardjp: I am confused about that too | 07:33 |
| evrardjp | I marked it as action item in the next steps | 07:34 |
| evrardjp | I suppose we can add that to the template | 07:34 |
| evrardjp | base functional testing | 07:35 |
| evrardjp | for one distro | 07:35 |
| evrardjp | probably in the linters template or something | 07:35 |
| evrardjp | " minimum jobs" | 07:36 |
| evrardjp | but I am merely starting with a full end to end testing story, then we can increase coverage :p | 07:36 |
| evrardjp | now that we've agreed we'll do integrated testing everywhere, let's just make that happen | 07:36 |
| *** hwoarang has joined #openstack-ansible | 07:37 | |
| *** pnull has joined #openstack-ansible | 07:38 | |
| *** luksky has quit IRC | 07:42 | |
| *** markvoelker has joined #openstack-ansible | 07:46 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Add rally install to the integrated https://review.opendev.org/660591 | 07:47 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Add integrated coverage https://review.opendev.org/660284 | 07:48 |
| *** cshen has quit IRC | 07:50 | |
| *** luksky has joined #openstack-ansible | 07:57 | |
| *** hwoarang has quit IRC | 07:58 | |
| *** hwoarang has joined #openstack-ansible | 08:00 | |
| *** sreejithp has joined #openstack-ansible | 08:04 | |
| *** sreejithp has quit IRC | 08:08 | |
| *** hamzaachi has joined #openstack-ansible | 08:14 | |
| *** markvoelker has quit IRC | 08:18 | |
| *** cshen has joined #openstack-ansible | 08:31 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Drop v2 registry job and ubuntu-xenial nodeset https://review.opendev.org/660558 | 08:36 |
| *** hwoarang has quit IRC | 08:44 | |
| *** hwoarang has joined #openstack-ansible | 08:46 | |
| *** luksky has quit IRC | 08:48 | |
| *** priteau has joined #openstack-ansible | 08:54 | |
| *** electrofelix has joined #openstack-ansible | 09:00 | |
| *** pnull has joined #openstack-ansible | 09:01 | |
| noonedeadpunk | guilhermesp: oh, thanks for the tip | 09:03 |
| openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata https://review.opendev.org/658731 | 09:05 |
| openstackgerrit | Dmitriy Rabotyagov (noonedeadpunk) proposed openstack/openstack-ansible-os_glance master: Replace git.openstack.org with opendev.org https://review.opendev.org/654003 | 09:06 |
| evrardjp | logan-: rally can now be tested in the integrated if we merge https://review.opendev.org/#/c/660591/ . It will be problematic, as it lengthen all the builds, so I suppose we should do it conditionally in a later patchset (by changing the hosts) | 09:06 |
| evrardjp | this is marked in the follow-up work in https://docs.google.com/spreadsheets/d/1coiPHGqaIKNgCGYsNhEgzswqwp4wedm2XoBCN9WMosY/edit#gid=752070695 | 09:06 |
| *** markvoelker has joined #openstack-ansible | 09:15 | |
| noonedeadpunk | guilhermesp: I've placed a comment here https://review.opendev.org/#/c/657029 but I guess it's applicable to https://review.opendev.org/#/q/topic:osa/db-refactor+(status:open+OR+status:merged) | 09:20 |
| noonedeadpunk | This tends to work for https://opendev.org/openstack/openstack-ansible-os_ceilometer/src/branch/master/tasks/ceilometer_service_setup.yml but I'd better to double check this, as I may miss smth important | 09:20 |
| *** luksky has joined #openstack-ansible | 09:22 | |
| noonedeadpunk | Yep, at least I'm missed that ceilometer_services['ceilometer-polling']['group'] is a list, but it's string in glance, so just "in" may be ok | 09:22 |
| CeeMac | morning | 09:28 |
| nowster | chandankumar: any glimmer of hope? ;) | 09:31 |
| L_SR | CeeMac morning | 09:31 |
| CeeMac | evrardjp: jrosser: so, to continue the saga from yesterday. I'm getting the same user denied error if I try and connect from the utility container to any of the galera IPs using the keystone user/password combination | 09:31 |
| CeeMac | so at least the error is constistent. The question is, at what point should access be configured for the keystone user and why isn't it working. | 09:32 |
| CeeMac | morning L_SR | 09:32 |
| L_SR | CeeMac is this new error related to mine? | 09:33 |
| CeeMac | i'll probably roll back my snapshots and try kicking off the playbook again, but its a good troubleshooting exercise initially | 09:33 |
| CeeMac | L_SR: in that its the same error yes, not sure its the same cause | 09:33 |
| CeeMac | I had an issue where traffic from the LB was getting blocked by mysql, because the IP it connects on is different to the IP int he ansible inventory, however I've resolved that with an override. Now, it connects but gets and auth error | 09:34 |
| L_SR | CeeMac I'm having a new error today, maybe completely unrelated. At "Run nova-status upgrade check to validate a healthy configuration" in setup-openstack playbook I get a "Placement service credentials do not work" Failure. How is it that precisely these credentials don't work? I don't think it is related to HAProxy this time | 09:34 |
| CeeMac | although I can't see any logs to validate that on the sql side | 09:34 |
| CeeMac | L_SR: you're running 19 right? I didn't go there yet. Running with rocky 18.1.5 tag | 09:35 |
| L_SR | yes, running from the master branch | 09:35 |
| L_SR | Ok, will fallback to Rocky an retry | 09:35 |
| CeeMac | L_SR: you're getting a lot of practice at blowing away your environment and building from scratch at least :) | 09:40 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-apt_package_pinning master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660618 | 09:43 |
| CeeMac | hmm, ok so I've enables logging warnings on one of the galera nodes and I can see the same auth error in the logs, so its definitely permission related. | 09:44 |
| *** flaper87 has quit IRC | 09:48 | |
| CeeMac | ok, so i've logged in to mysql as root and there are no DBs or users set up for keystone, which explains the error...... | 09:48 |
| CeeMac | now, to work out where the db and user should be getting created...... | 09:48 |
| *** markvoelker has quit IRC | 09:49 | |
| *** cshen has quit IRC | 10:04 | |
| CeeMac | ok, i'm just confused | 10:09 |
| CeeMac | looking through the play books, the keystone credentials are created before the db and db user are set up. yet the keystone-manage command appears to want to connect to the database that doesn't exist yet? | 10:10 |
| CeeMac | *credential keys | 10:10 |
| jrosser | L_SR: the master branch is work-in-progress for the future Train release, i wouldnt be trying to base deployments on that | 10:12 |
| jrosser | CeeMac: hello - you still stuck? | 10:13 |
| CeeMac | jrosser: yes. yes i am. very. | 10:13 |
| CeeMac | although i'm wondering if the fact the play is currently skipping "Create credential keys for Keystone" is causing an issue and if i'd be better just blowing the container away and redeploying. | 10:14 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-ceph_client master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660624 | 10:16 |
| jrosser | CeeMac: there is a good change stuff is in a mess becasue of the previous inability to connect to the db | 10:16 |
| CeeMac | yeah, thats what i'm wondering. | 10:18 |
| CeeMac | is this one of those times when its better to just blow it away rather than try fix it? | 10:18 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Bump rally versions https://review.opendev.org/660625 | 10:19 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Bump rally versions https://review.opendev.org/660625 | 10:19 |
| *** cshen has joined #openstack-ansible | 10:21 | |
| CeeMac | ok, I'm going to shoot the keystone container in the head and redeploy. | 10:24 |
| *** cshen has quit IRC | 10:26 | |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-galera_client master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660637 | 10:27 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-galera_server master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660638 | 10:28 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-haproxy_server master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660639 | 10:28 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-lxc_container_create master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660640 | 10:29 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-lxc_hosts master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660641 | 10:29 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-memcached_server master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660643 | 10:30 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-nspawn_container_create master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660644 | 10:30 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-nspawn_hosts master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660646 | 10:30 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-openstack_hosts master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660647 | 10:31 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-openstack_openrc master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660648 | 10:31 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-ops master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660650 | 10:32 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_aodh master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660651 | 10:33 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_barbican master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660652 | 10:33 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_blazar master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660653 | 10:34 |
| *** cshen has joined #openstack-ansible | 10:34 | |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_ceilometer master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660655 | 10:34 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_cinder master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660656 | 10:35 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_cloudkitty master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660657 | 10:35 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_congress master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660658 | 10:36 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_designate master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660659 | 10:36 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_glance master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660660 | 10:37 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_gnocchi master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660661 | 10:38 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_heat master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660662 | 10:38 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_horizon master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660663 | 10:39 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_ironic master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660664 | 10:39 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_keystone master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660666 | 10:40 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_magnum master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660667 | 10:41 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_masakari master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660668 | 10:41 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_monasca master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660669 | 10:42 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_monasca-agent master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660670 | 10:42 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_neutron master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660671 | 10:43 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_nova master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660672 | 10:44 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_octavia master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660673 | 10:45 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_panko master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660674 | 10:45 |
| *** markvoelker has joined #openstack-ansible | 10:46 | |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_rally master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660675 | 10:46 |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_sahara master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660676 | 10:46 |
| *** luksky has quit IRC | 10:47 | |
| openstackgerrit | inspurericzhang proposed openstack/openstack-ansible-os_swift master: Replace git.openstack.org URLs with opendev.org URLs https://review.opendev.org/660677 | 10:47 |
| _janno | What's the right way to define kvm as hypervisor with Stein? | 10:48 |
| _janno | is setting kvm-compute_hosts sufficient? | 10:48 |
| jamesdenton | kvm is the default, i would not expect you to have to do anything | 10:52 |
| *** itandops has joined #openstack-ansible | 10:57 | |
| *** pnull has quit IRC | 10:58 | |
| *** pnull has joined #openstack-ansible | 11:01 | |
| _janno | jamesdenton: seems that you are right. nova.conf already says 'virt_type = kvm', but horizon says qemu | 11:01 |
| *** nicolasbock has joined #openstack-ansible | 11:06 | |
| CeeMac | gah, keysonte install failing at service check, looks at haproxy, realises haproxy is still showing old container | 11:11 |
| * CeeMac facepalms | 11:11 | |
| *** devx has quit IRC | 11:12 | |
| *** devx has joined #openstack-ansible | 11:14 | |
| jamesdenton | _janno qemu uses kvm for virt in this case, thus the confusion | 11:14 |
| *** tuxjohnson has joined #openstack-ansible | 11:15 | |
| _janno | jamesdenton: little confusing that it says qemu, but uses kvm, but thanks for clarification. | 11:16 |
| *** luksky has joined #openstack-ansible | 11:18 | |
| *** markvoelker has quit IRC | 11:18 | |
| CeeMac | now its failing on one keystone container in 'keystonte_service_update' task with error "shade is required for this module" | 11:22 |
| * CeeMac bangs head on desk | 11:22 | |
| jrosser | CeeMac: which host is running that task? | 11:23 |
| *** kplant has joined #openstack-ansible | 11:24 | |
| CeeMac | jrosser, what the easiest way to tell? | 11:24 |
| jrosser | these tasks are delegated https://github.com/openstack/openstack-ansible-os_keystone/blob/master/tasks/keystone_service_update.yml#L27 so it's either your deploy host or $elsewhere | 11:25 |
| CeeMac | i'm perplexed because the other keystone container has built fine (in as far as I can tell) | 11:25 |
| chandankumar | nowster: Hello | 11:25 |
| chandankumar | nowster: I think I found the issue | 11:25 |
| CeeMac | jrosser: it'll be the utility container, if the task is delegated | 11:26 |
| jrosser | CeeMac: if you have an override to that effect, yes | 11:26 |
| jrosser | otherwise it will default to the deploy host | 11:26 |
| CeeMac | jrosser, i do | 11:26 |
| jrosser | ok right - we came across this exact thing yesterday | 11:27 |
| chandankumar | jrosser: evrardjp Here extras repos are getting disabled https://opendev.org/openstack/openstack-ansible-tests/src/branch/master/test-ansible-functional.sh#L80-L84 | 11:27 |
| CeeMac | jrosser: http://paste.openstack.org/show/751923/ <- user variable override | 11:27 |
| jrosser | CeeMac: one moment | 11:28 |
| CeeMac | sure | 11:28 |
| jrosser | add 'shade' to the end of this list https://github.com/openstack/openstack-ansible/blob/master/inventory/group_vars/utility_all.yml#L41 | 11:29 |
| CeeMac | in a group_var override presumably? | 11:30 |
| jrosser | and re-run the utility container playbook | 11:30 |
| *** udesale has quit IRC | 11:30 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible master: [DOCS] Replace env.d with conf.d in provnet_groups docs https://review.opendev.org/660684 | 11:30 |
| *** sreejithp has joined #openstack-ansible | 11:30 | |
| jrosser | CeeMac: not sure - we edited that file in-place and will submit a patch hopefully today | 11:30 |
| CeeMac | let me try with an override then | 11:31 |
| *** udesale has joined #openstack-ansible | 11:31 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/openstack-ansible-tests master: Donot disable centos extra repos https://review.opendev.org/660685 | 11:34 |
| *** sreejithp has quit IRC | 11:35 | |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: Update openstack.org -> opendev.org https://review.opendev.org/654942 | 11:35 |
| CeeMac | jrosser: thanks mate, that's done the trick. I never would have found that. | 11:39 |
| CeeMac | keysone, done. just need to run through the rest of the os_*_install plays now! | 11:39 |
| jrosser | CeeMac: excellent - i'll just make a bug on launchpad so we can track this | 11:42 |
| _janno | CeeMac: Good luck! :) | 11:44 |
| jrosser | CeeMac: you could paste the error you got here if it's still to hand https://bugs.launchpad.net/openstack-ansible/+bug/1830028 | 11:44 |
| openstack | Launchpad bug 1830028 in openstack-ansible "utility container is missing the shade library" [Undecided,New] | 11:44 |
| CeeMac | jrosser: sure | 11:45 |
| CeeMac | jrosser: done, I added a little extra detail for context too | 11:49 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible stable/queens: zuul: Add required project openstack/openstack-ansible https://review.opendev.org/660688 | 11:49 |
| itandops | hi all, I want to deploy multi region and I wonder if OPSA allows using pacemaker to set controllers in active pacive mode ? | 11:52 |
| nowster | chandankumar: That change is from Sep 2017 ! | 11:53 |
| *** vnogin has joined #openstack-ansible | 12:05 | |
| logan- | easy quick review: https://review.opendev.org/#/c/660688/ | 12:05 |
| *** markvoelker has joined #openstack-ansible | 12:16 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_neutron master: Stop installing python-httplib2 https://review.opendev.org/660697 | 12:19 |
| chandankumar | logan-: https://review.opendev.org/#/c/660307/ ^6 similar patch | 12:21 |
| logan- | ah | 12:22 |
| *** hwoarang has quit IRC | 12:23 | |
| jrosser | chandankumar: lets recheck that - looks just like the mirrors were broken? | 12:23 |
| chandankumar | jrosser: dnm one? | 12:24 |
| jrosser | well i guess logan- patch is the same? so it doesnt matter, so long as one runs properly | 12:24 |
| *** hwoarang has joined #openstack-ansible | 12:25 | |
| logan- | ya hopefully that rabbitmq mirror issue is worked out by now | 12:26 |
| logan- | i didn't see that in any other jobs so im guessing its not a problem still | 12:26 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_tempest master: Default network segmentation ID correctly https://review.opendev.org/659877 | 12:27 |
| *** markvoelker has quit IRC | 12:29 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-tests master: Add a note explaning why we disable yum repos https://review.opendev.org/660700 | 12:33 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Bump rally versions https://review.opendev.org/660625 | 12:34 |
| *** vnogin has quit IRC | 12:34 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_rally master: Add integrated coverage https://review.opendev.org/660284 | 12:34 |
| *** persia has quit IRC | 12:34 | |
| *** persia has joined #openstack-ansible | 12:35 | |
| evrardjp | logan-: chandankumarI think we should wait for odyssey4me's input before merging this. I am not really sure why this is still there, but I suppose there is a good reason (neutron/nova plugins?) | 12:35 |
| logan- | evrardjp: I researched the history and explained it in my commit message | 12:36 |
| evrardjp | logan-: https://review.opendev.org/660625 that fixes rally, which will be necessary for the host ubild | 12:36 |
| evrardjp | logan-: oh good | 12:36 |
| evrardjp | ahah yes I remember now that you've written it :) | 12:36 |
| evrardjp | cool | 12:37 |
| evrardjp | good explanation | 12:37 |
| *** ansmith has joined #openstack-ansible | 12:37 | |
| evrardjp | chandankumar: good catch on the extra disable. | 12:41 |
| evrardjp | shouldn't we enable it? | 12:41 |
| logan- | evrardjp: i'm not sure if we should, but i also looked into why we disable it in the first place here https://review.opendev.org/#/c/660685/ | 12:42 |
| logan- | apparently we disable everything except base and updates because yum is slow | 12:43 |
| evrardjp | yeah I saw that | 12:43 |
| evrardjp | if we can do without it, let's do without | 12:44 |
| logan- | that's what i'm thinking too | 12:44 |
| evrardjp | but I thought this was a good way to unwedge things fast, and revert | 12:44 |
| logan- | gotcha | 12:44 |
| logan- | well i stacked an open tempest change on that os_neutron one https://review.opendev.org/#/c/659877/ | 12:45 |
| logan- | so we'll see if it all passes | 12:45 |
| evrardjp | I think your patch is worth merging anyway | 12:45 |
| logan- | ps would like to get https://review.opendev.org/#/c/660688/ in the gate asap once it passes ;) | 12:45 |
| evrardjp | even if it breaks stuff | 12:46 |
| evrardjp | haha | 12:46 |
| evrardjp | (I mean it's not _per se_ required for neutron to have it) | 12:46 |
| logan- | right | 12:46 |
| *** tuxjohnson has left #openstack-ansible | 13:09 | |
| *** priteau has quit IRC | 13:09 | |
| evrardjp | logan-: the column "c" has a series of easy reviews: https://docs.google.com/spreadsheets/d/1coiPHGqaIKNgCGYsNhEgzswqwp4wedm2XoBCN9WMosY/edit#gid=752070695 | 13:14 |
| evrardjp | through the window or through the door, this will get in :p | 13:14 |
| *** dave-mccowan has joined #openstack-ansible | 13:23 | |
| openstackgerrit | kourosh vivan proposed openstack/openstack-ansible-rabbitmq_server master: Add missing variable for redhat family os https://review.opendev.org/660713 | 13:25 |
| noonedeadpunk | evrardjp: I'm a bit concerned about leaving xenial in meta... | 13:26 |
| noonedeadpunk | ofc this might be done in a separate patch.... | 13:27 |
| noonedeadpunk | but changes are pretty small | 13:27 |
| noonedeadpunk | probably I may update this to drop xenail as well, if have lack of time for this? | 13:28 |
| jrosser | noonedeadpunk: i would let them continue, the topic is after all "clarify-suse-support" | 13:28 |
| jrosser | then we can also backport suse/xenial changes seperately | 13:29 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Make coverage consistent https://review.opendev.org/660319 | 13:30 |
| guilhermesp | morning all! | 13:30 |
| guilhermesp | hey noonedeadpunk gonna see your comments on the db refactor patches | 13:31 |
| evrardjp | yeah we can do another pass to remove xenial | 13:31 |
| guilhermesp | thx btw | 13:31 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: Update openstack.org -> opendev.org https://review.opendev.org/654942 | 13:31 |
| openstackgerrit | Merged openstack/openstack-ansible-memcached_server master: Add integrated coverage https://review.opendev.org/660322 | 13:32 |
| *** sreejithp has joined #openstack-ansible | 13:33 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-memcached_server master: Clarify supported SUSE versions https://review.opendev.org/660323 | 13:33 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_openrc master: Add integrated coverage https://review.opendev.org/660331 | 13:36 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-openstack_openrc master: Clarify supported SUSE versions https://review.opendev.org/660332 | 13:36 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-galera_client master: Clarify supported SUSE versions https://review.opendev.org/660320 | 13:37 |
| *** sreejithp has quit IRC | 13:37 | |
| *** sreejithp has joined #openstack-ansible | 13:38 | |
| *** dave-mccowan has quit IRC | 13:40 | |
| *** hwoarang has quit IRC | 13:45 | |
| *** hwoarang has joined #openstack-ansible | 13:46 | |
| evrardjp | logan-: an opinion on changing the groups for tempest/rally to their own groups? I have the impression migration will be awful | 13:48 |
| evrardjp | I have messing with env.d s | 13:48 |
| *** kaiokmo has joined #openstack-ansible | 13:49 | |
| kaiokmo | morning everyone | 13:50 |
| guilhermesp | noonedeadpunk: I suppose the when condition here https://review.opendev.org/#/c/657029/6/tasks/main.yml aims only to set which of the nodes of the db cluster is going to execute the playbook and run_once as you suggested would take care of it | 13:54 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible stable/rocky: Bump os_neutron SHA to pull in fixed Calico https://review.opendev.org/660715 | 13:55 |
| logan- | evrardjp: which groups? | 13:56 |
| guilhermesp | cores, I suppose we drop or change this to bionic too? https://github.com/openstack/openstack-ansible-os_keystone/blob/3c0ee6269604401cb5e57d4ff542f6fe8bed99e3/zuul.d/jobs.yaml#L23 | 13:56 |
| logan- | guilhermesp: +2 | 13:56 |
| logan- | guilhermesp: since the parent job has a nodeset defined already, don't define a nodeset on that job please | 13:57 |
| logan- | oh wait | 13:57 |
| logan- | nevermnind what i just said | 13:57 |
| logan- | :P | 13:57 |
| noonedeadpunk | guilhermesp: should we care about it? As I'm not sure this matters | 13:58 |
| guilhermesp | I was just trying to understand hahaha the parent job doesn't have a nodeset logan- | 13:58 |
| noonedeadpunk | guilhermesp: I've placed https://review.opendev.org/#/c/660455/ to resolve it | 13:58 |
| noonedeadpunk | but the problem is a bit deeper | 13:58 |
| guilhermesp | oh, just looking noonedeadpunk it is not as simple as I imagined... | 13:59 |
| noonedeadpunk | at least it passwd creation step:) | 13:59 |
| logan- | wow that job is a nice throwback to when we used to run all role tests in -vvv | 14:00 |
| evrardjp | logan-: I guess I would prefer having rally (or rally_all) and tempest(_all) instead of utility_all | 14:00 |
| evrardjp | one day early for throwback thursday | 14:00 |
| logan- | evrardjp: oh gotcha. it seems reasonable but whats pushing you to do that? is it blocking something? | 14:01 |
| evrardjp | nope it's not blocking anything, but running rally code at each deploy annoys me | 14:02 |
| logan- | oh | 14:03 |
| logan- | so you want to empty the group | 14:03 |
| logan- | as an alternative maybe we could just add a flag like we have with tempest? | 14:03 |
| logan- | to skip it | 14:04 |
| logan- | doing it in inventory seems fine too though | 14:04 |
| evrardjp | I prefer using the inventory for that... utility_container has always been an oddball | 14:08 |
| evrardjp | for me at least | 14:08 |
| CeeMac | jrosser: just got a shade error again running os-gnocchi-install. 'add service project' step from gnocchi_identity_setup.yml which looks to be delegated too? | 14:09 |
| *** cshen has quit IRC | 14:30 | |
| CeeMac | jrosser: verbose output of error: http://paste.openstack.org/show/751937/ | 14:32 |
| CeeMac | jrosser: running 'pip list' from the venv in the utility container that was delegated the task show that shade 1.29.0 is installed. Pretty stuck on where to go next. | 14:38 |
| *** hamzaachi has quit IRC | 14:41 | |
| *** hamzaachi has joined #openstack-ansible | 14:41 | |
| CeeMac | could it be the gnocchi play is expecting a different version of shade or something? | 14:41 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible stable/stein: config: Enable OSA_CONFIG_DIR to customize configuration folder https://review.opendev.org/660742 | 14:41 |
| *** luksky has quit IRC | 14:43 | |
| *** L_SR has quit IRC | 14:43 | |
| *** udesale has quit IRC | 14:44 | |
| *** udesale has joined #openstack-ansible | 14:44 | |
| *** tosky has quit IRC | 14:45 | |
| *** tosky has joined #openstack-ansible | 14:46 | |
| CeeMac | jrosser: could it be the python interpreter isn't picking up the delgation override? https://opendev.org/openstack/openstack-ansible-os_gnocchi/src/branch/stable/rocky/tasks/gnocchi_identity_setup.yml#L27 | 14:47 |
| kukacz | hi, I've just request to help with AIO someone else deployed, with linuxbridge networking. issue is the guest instance (centos) can succesfully ping public IP but all other traffic (DNS, HTTP) is not returning. any hints where I should look, please? | 14:51 |
| CeeMac | evrardjp: logan- : noonedeadpunk : guilhermesp : do any of you know of any way to override the 'ansible_python_interpreter:' value here https://opendev.org/openstack/openstack-ansible-os_gnocchi/src/branch/stable/rocky/tasks/gnocchi_identity_setup.yml#L27 other than manually editing the line in the file? | 14:51 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Clarify supported SUSE versions https://review.opendev.org/660070 | 14:52 |
| CeeMac | kukacz: is there an upstream firewall that needs configuring to allow outbound traffic from the br-mgmt network range? | 14:53 |
| kplant | kukacz: ensure haproxy is running and 'netstat -ntpl' to see what ports it's listening on | 14:53 |
| openstackgerrit | Merged openstack/openstack-ansible-os_placement master: Clarify supported SUSE versions https://review.opendev.org/660281 | 14:53 |
| CeeMac | kukacz: I assume you mean an external public IP rather than the public IP of the haproxy? | 14:53 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/rocky: Bump SHAs for stable/rocky https://review.opendev.org/659967 | 14:54 |
| kukacz | CeeMac: no upstream firewall. and yes, I mean address as 1.1.1.1, 8.8.8.8 | 14:54 |
| evrardjp | CeeMac: group vars, or user_variables depending on what you want to do | 14:54 |
| noonedeadpunk | CeeMac: and gnocchi_service_setup_host is localhost in your case? | 14:54 |
| kukacz | CeeMac: and I can see on AIO host interface using tcpdump that the responses (eg. HTTP) are returning. they just do not pass back to the guest | 14:55 |
| CeeMac | noonedeadpunk: no it's delegated out to the utility containers, that part works fine, but the python interpreter isn't configured to use the delegated openstack_service_setup_host_python_interpreter which is I think why I'm getting the shade error | 14:55 |
| kplant | kukacz: my bad, totally misread your question. ignore what i said | 14:55 |
| kukacz | kplant: thanks anyway! | 14:56 |
| CeeMac | evrardjp: I have the user vars set up already with the delegation override, but the gnocchi role doesn't appear to use it | 14:56 |
| CeeMac | kukacz: does resolv.conf have dns servers set? | 14:56 |
| kplant | kukacz: what do the security group policies look like, did you allow any to/from 0.0.0.0/0 for testing? | 14:56 |
| CeeMac | ah, good point, by guest you are meaning tenant vm not aio ? | 14:57 |
| kukacz | CeeMac: I'm bypassing DNS by using plain IPs, cause the DNS requests do not work either | 14:57 |
| kukacz | kplant: hmm, true, I have not check the secgroups yet. I don't thing they're involved though, as the requests are leaving AIO host correctly and even the responses from public HTTP servers arrive | 14:59 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_client master: Clarify supported SUSE versions https://review.opendev.org/660404 | 14:59 |
| noonedeadpunk | CeeMac: user_*.yml are loaded by openstack-ansible wrapper, so they should be used... | 14:59 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tacker master: Clarify supported distro versions https://review.opendev.org/660291 | 15:00 |
| CeeMac | noonedeadpunk: yep, its the role that isn't configured to use the overridable variable | 15:00 |
| kukacz | CeeMac: by guest I mean the nested instance (tenant VM), not aio | 15:00 |
| *** aedc has joined #openstack-ansible | 15:00 | |
| kplant | kukacz: all egress is allowed by default, that still sounds like it could be security groups | 15:00 |
| jrosser | CeeMac: did you get that gnocchi thing working? /me been away | 15:00 |
| CeeMac | noonedeadpunk: take a look here https://opendev.org/openstack/openstack-ansible-os_gnocchi/src/branch/stable/rocky/tasks/gnocchi_identity_setup.yml#L27-L28 | 15:00 |
| CeeMac | jrosser: no, but I think I've worked out why, just trying to confirm | 15:01 |
| openstackgerrit | Merged openstack/openstack-ansible-repo_server master: Clarify supported SUSE versions https://review.opendev.org/660402 | 15:01 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible stable/stein: Fix mistral metal deploy https://review.opendev.org/660750 | 15:01 |
| CeeMac | kukacz: right. | 15:01 |
| kukacz | kplant: what rule would cause such behaviour? egress apparently works and ingress is not relevant, as it is related traffic. | 15:02 |
| openstackgerrit | Merged openstack/openstack-ansible-rsyslog_server master: Clarify supported SUSE versions https://review.opendev.org/660406 | 15:02 |
| CeeMac | if you run tcpdump on the host the aio is on, you see the http responses coming back ? | 15:02 |
| kplant | i've got to step out for lunch but i thought you were saying ingress traffic to the instance was the problem? | 15:02 |
| CeeMac | kukacz: ^ | 15:02 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Use a consolidated gate queue for integrated jobs https://review.opendev.org/660751 | 15:02 |
| kukacz | CeeMac: yes, I can see the responses | 15:02 |
| noonedeadpunk | CeeMac: this is supposed to be overriden by -e argument to openstack-ansible at least | 15:03 |
| CeeMac | and the destination address of the packets is correct for the snat IP of the router for that tenant on the 'external' network? | 15:03 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Use a consolidated gate queue for integrated jobs https://review.opendev.org/660751 | 15:03 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/queens: Bump SHAs for stable/queens https://review.opendev.org/659969 | 15:03 |
| kukacz | CeeMac: and problem is with outgoing requests - I'm receiving no response, though I can see the responses arriving at AIO host level | 15:03 |
| kukacz | CeeMac: incomming requests not tested yet | 15:04 |
| CeeMac | noonedeadpunk: that would try to run from the deployment node then? | 15:04 |
| CeeMac | noonedeadpunk: if you compare the previous paste with https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/master/tasks/keystone_service_update.yml#L28-L29 | 15:05 |
| CeeMac | the latter allows for the user_variable override to take, the former doesn't I don't think? | 15:05 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Clarify supported SUSE versions https://review.opendev.org/660270 | 15:06 |
| *** vnogin has joined #openstack-ansible | 15:06 | |
| CeeMac | kukacz: you might need to track the return packet flow back from the host upwards to see where it is going missing | 15:06 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron stable/stein: Use integrated repo scenario for Calico job https://review.opendev.org/659711 | 15:06 |
| CeeMac | kukacz: so you'd need to validate that the destination IP of the http response packet matches the expected address to route the packet via the project router etc | 15:07 |
| CeeMac | and then that the arp for the address is matching the mac of the router/vm etc | 15:07 |
| CeeMac | if there are no firewalls getting in the way policy wise, then it must be network level | 15:08 |
| openstackgerrit | Merged openstack/openstack-ansible-os_ceilometer master: Clarify supported SUSE versions https://review.opendev.org/660066 | 15:08 |
| kukacz | CeeMac: yes, that should push me forward. I'm just not very clear how to track it | 15:08 |
| CeeMac | kukacz: unless there are IP tables rule on the host outwith the AIO setup that requires return session packets to be explicitly allowed (which seems like mad overkill and unlikely) | 15:08 |
| kukacz | CeeMac: is there perhaps some picture of the linuxbridge interfaces and how they're chained? | 15:09 |
| CeeMac | kukacz: yeah, the networking and namespaces can be a bit of a brain melter | 15:09 |
| CeeMac | kukacz: there should be in the documentation | 15:09 |
| CeeMac | kukacz: do you know which version aio is running openstack-ansible wise? | 15:10 |
| kukacz | CeeMac: hmm, there's lot of iptables rules in this AIO host. I assumed that was a default | 15:10 |
| *** starborn has quit IRC | 15:11 | |
| kukacz | CeeMac: it should be pretty recent - like a month old or so. how can I best identify the release? | 15:11 |
| CeeMac | they do get configured as part of the network plumbing between routing tables as well | 15:11 |
| CeeMac | kukacz: 'cat /etc/openstack-release' from within the aio | 15:12 |
| kukacz | CeeMac: DISTRIB_RELEASE="17.1.8" | 15:12 |
| CeeMac | so queens | 15:12 |
| kukacz | yes | 15:12 |
| CeeMac | one moment | 15:12 |
| *** vnogin has quit IRC | 15:13 | |
| CeeMac | kukacz: there is a referece diagram at the bottom of https://docs.openstack.org/openstack-ansible/queens/user/aio/quickstart.html | 15:14 |
| kukacz | CeeMac: thanks! | 15:14 |
| CeeMac | kukacz: also some information on the networks in use here https://docs.openstack.org/project-deploy-guide/openstack-ansible/queens/targethosts.html#configuring-the-network | 15:15 |
| kukacz | CeeMac: I'll read those and try to identify which interface is the next in path | 15:16 |
| openstackgerrit | Mohammed Naser proposed openstack/openstack-ansible master: metal: loop over provider networks only if necessary https://review.opendev.org/660756 | 15:17 |
| kukacz | CeeMac: enjoy your lunch! I'm sorry I've delayed you. thanks for this great help! | 15:18 |
| openstackgerrit | Merged openstack/openstack-ansible-os_rally master: Bump rally versions https://review.opendev.org/660625 | 15:19 |
| CeeMac | kukacz: also https://docs.openstack.org/openstack-ansible/queens/reference/architecture/container-networking.html for more detailed diagrams etc | 15:19 |
| kukacz | CeeMac: ahh, sorry, it was kplant mentioning the lunch. everything else applies anyway :-) | 15:19 |
| *** hwoarang has quit IRC | 15:20 | |
| *** gshippey has joined #openstack-ansible | 15:20 | |
| CeeMac | kukacz: that last one should really help with unpicking how all of the networking fits together | 15:20 |
| CeeMac | with the router namespaces etc | 15:20 |
| kukacz | CeeMac: thanks, these diagrams are helpful. I've been only working with contrail networking for years and am not used to troubleshoot OVS and linuxbridge | 15:21 |
| *** hwoarang has joined #openstack-ansible | 15:21 | |
| CeeMac | kukacz: surely after contrail OVS and lxb should be easy :D | 15:21 |
| kukacz | CeeMac: yes, :-) it should be better documented at least | 15:23 |
| CeeMac | jrosser: sorry to be a pest, but any thoughts? | 15:27 |
| noonedeadpunk | CeeMac: probably this is due to delegate_to. Have you tried to override with host_vars for gnocchi_service_setup_host? | 15:29 |
| CeeMac | noonedeadpunk: gnocchi_service_setup_host should pick up openstack_service_setup_host which I have defined | 15:30 |
| CeeMac | in master gnocchi_service_setup_host_python_interpreter is used in gnocchi_service_setup.yml, but in stable/rocky it isn't, which I think is the problem | 15:31 |
| CeeMac | presuming I haven't made a gross over-assumption that is | 15:31 |
| *** gyee has joined #openstack-ansible | 15:32 | |
| logan- | CeeMac: hmm it looks like that change was backported to rocky https://review.opendev.org/#/c/622534/ | 15:32 |
| *** macza has joined #openstack-ansible | 15:32 | |
| CeeMac | logan-: maybe it came in after 18.1.5 | 15:33 |
| logan- | oh, it was done for service_setup | 15:33 |
| logan- | but not identity_setup | 15:33 |
| logan- | master also still does it the old way https://github.com/openstack/openstack-ansible-os_gnocchi/blob/master/tasks/gnocchi_identity_setup.yml#L27-L28 | 15:34 |
| CeeMac | thats the one I'm failing on | 15:35 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_gnocchi master: Fix ansible_python_interpreter for identity setup https://review.opendev.org/660759 | 15:36 |
| logan- | CeeMac ^ | 15:36 |
| logan- | once this merges in master we can backport to stein & rocky | 15:37 |
| CeeMac | in the mean time I can just manually edit the gnocchi_identity_setup.yml to complete my deployment? There isn't another override to try? | 15:39 |
| logan- | yes the former is exactly what i'd do | 15:39 |
| CeeMac | awesome, thanks. I'll do that. | 15:39 |
| CeeMac | so in a roundabout way I think I got to the correct conclusion with my random shots in the dark? | 15:40 |
| logan- | yeah, you are right that the old way it was specified does not allow for overrides. it is either set to one thing, or the other, the user cannot specify it | 15:40 |
| *** hamzaachi has quit IRC | 15:42 | |
| logan- | and it also doesn't inherit from the integrated repo's openstack_service_setup_* vars in the old way it was written | 15:42 |
| *** bline has quit IRC | 15:42 | |
| CeeMac | thanks. just glad I've got a path forwards now | 15:42 |
| CeeMac | FYI editing the file manually did the trick :D | 15:46 |
| guilhermesp | noonedeadpunk: might be a clue for keystone uw job? http://logs.openstack.org/55/660455/1/check/openstack-ansible-uw_apache-ubuntu-bionic/8b977ec/logs/openstack/keystone1/apache2/keystone-apache-error.log.txt.gz#_2019-05-22_10_24_38_145108 | 15:51 |
| noonedeadpunk | Yep, might be. Tbh, had no time to dig into it, but cool that you found the issue. | 15:54 |
| noonedeadpunk | probably we should symlink module, or do smth like a2enmod | 15:55 |
| *** itandops has quit IRC | 15:57 | |
| *** jsquare has quit IRC | 15:59 | |
| *** jsquare has joined #openstack-ansible | 15:59 | |
| chandankumar | logan-: that fix is not working http://logs.openstack.org/42/654942/12/check/openstack-ansible-functional-tempestconf-centos-7/bfcb014/job-output.txt.gz#_2019-05-22_14_12_45_697709 | 15:59 |
| chandankumar | logan-: sorry | 16:00 |
| chandankumar | logan-: i putted wrong depends on | 16:00 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: Update openstack.org -> opendev.org https://review.opendev.org/654942 | 16:01 |
| logan- | chandankumar: it works fine, but we have more roles to remove it from | 16:03 |
| logan- | chandankumar: it is failing in os_nova now | 16:03 |
| *** hamzaachi has joined #openstack-ansible | 16:04 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_nova master: Stop installing python-httplib2 https://review.opendev.org/660772 | 16:06 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_tempest master: Default network segmentation ID correctly https://review.opendev.org/659877 | 16:06 |
| logan- | chandankumar: it looks like os_neutron and os_nova will be the only 2 patches needed based on http://codesearch.openstack.org/?q=python-httplib2&i=nope&files=&repos= | 16:07 |
| *** hwoarang has quit IRC | 16:07 | |
| chandankumar | logan-: yes | 16:07 |
| chandankumar | there was only two | 16:08 |
| logan- | cool | 16:08 |
| logan- | that should wrap it up then | 16:08 |
| openstackgerrit | Chandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: Update openstack.org -> opendev.org https://review.opendev.org/654942 | 16:08 |
| *** hwoarang has joined #openstack-ansible | 16:09 | |
| *** tuxjohnson has joined #openstack-ansible | 16:09 | |
| *** jbadiapa has quit IRC | 16:10 | |
| tuxjohnson | Does anyone know what I need to set in my openstack_user_config.yml or user_variables.yml to get my compute nodes to mount the cinder NFS shares? I am getting the following error on my compute nodes because the NFS share is not there: "/var/lib/nova/mnt/c9d01fa1b97146f46b8da02da6bdc920/volume-1f034213-4dd0-402f-9f5e-5e203cf4c488': Permission denied". I realize I could do all of this manually, but thought maybe I mis | 16:12 |
| tuxjohnson | thing when deployiing with OSA. | 16:12 |
| *** pnull has quit IRC | 16:21 | |
| *** johnny101 has joined #openstack-ansible | 16:23 | |
| *** jbadiapa has joined #openstack-ansible | 16:24 | |
| *** kopecmartin is now known as kopecmartin|off | 16:25 | |
| *** hamzaachi has quit IRC | 16:34 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible master: Utility container is missing the shade library https://review.opendev.org/660779 | 16:35 |
| *** udesale has quit IRC | 16:38 | |
| guilhermesp | huu noonedeadpunk we already load the module https://github.com/openstack/openstack-ansible-os_keystone/blob/4a936a514f1e63801d0b273334d44147b3dce7c4/vars/debian.yml#L90 and loaded in the failing job http://logs.openstack.org/55/660455/1/check/openstack-ansible-uw_apache-ubuntu-bionic/8b977ec/logs/etc/openstack/keystone1/apache2/mods-enabled/proxy_http.load.txt.gz | 16:40 |
| noonedeadpunk | need to run this job on sandbox to see what exactly happens | 16:41 |
| noonedeadpunk | ofc if you have time and want to dig inside this - you may feel free to update my patch/place another one :) | 16:43 |
| *** udesale has joined #openstack-ansible | 16:43 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible stable/stein: Bump os_neutron SHA to pull in fixed Calico https://review.opendev.org/660786 | 16:54 |
| guilhermesp | no noonedeadpunk ! I will dig into it | 16:56 |
| guilhermesp | np* | 16:56 |
| noonedeadpunk | Just not usre wether will have time for it until friday | 16:58 |
| noonedeadpunk | s/usre/sure/ | 16:58 |
| *** vnogin has joined #openstack-ansible | 17:06 | |
| *** electrofelix has quit IRC | 17:10 | |
| *** vnogin has quit IRC | 17:11 | |
| *** udesale has quit IRC | 17:12 | |
| *** vnogin has joined #openstack-ansible | 17:14 | |
| *** chandankumar is now known as raukadah | 17:14 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible-repo_server master: Improving repo sync and HAProxy checks https://review.opendev.org/660788 | 17:16 |
| *** vnogin has quit IRC | 17:18 | |
| openstackgerrit | Georgina Shippey proposed openstack/openstack-ansible master: Improve repo server haproxy healthcheck to verify repo synchronisation https://review.opendev.org/660477 | 17:19 |
| *** luksky has joined #openstack-ansible | 17:23 | |
| *** samueldmq has joined #openstack-ansible | 17:50 | |
| *** tosky has quit IRC | 18:30 | |
| *** tosky has joined #openstack-ansible | 18:30 | |
| openstackgerrit | Logan V proposed openstack/openstack-ansible-os_tempest master: Default network segmentation ID correctly https://review.opendev.org/659877 | 18:57 |
| *** flaper87 has joined #openstack-ansible | 19:21 | |
| *** kplant has quit IRC | 19:41 | |
| *** aludwar has left #openstack-ansible | 19:53 | |
| *** pcaruana has quit IRC | 20:20 | |
| *** pnull has joined #openstack-ansible | 20:23 | |
| *** ansmith has quit IRC | 20:29 | |
| jrosser | somethings broken https://review.opendev.org/#/c/660320/ | 20:31 |
| jrosser | openstack-ansible-deploy-aio_metal-debian-stable finger://ze05.openstack.org/ffd612ebdd0e40b98e52c9886f012b41 : RETRY_LIMIT in 39m 17s | 20:32 |
| logan- | yep | 20:32 |
| logan- | discussing in infra | 20:32 |
| logan- | it should be resolved soon, zuul has a memory leak and needs to be restarted | 20:36 |
| *** tuxjohnson has left #openstack-ansible | 20:41 | |
| dmsimard | FYI there was a regression in ara with Ansible 2.8, it's fixed in 0.16.4 which was just tagged | 20:58 |
| *** Talion has joined #openstack-ansible | 21:05 | |
| *** cshen has joined #openstack-ansible | 21:17 | |
| *** cshen has quit IRC | 21:22 | |
| *** aedc has quit IRC | 21:53 | |
| *** Weifan has joined #openstack-ansible | 21:56 | |
| *** sreejithp has quit IRC | 22:02 | |
| *** sreejithp has joined #openstack-ansible | 22:03 | |
| *** Weifan has quit IRC | 22:03 | |
| *** Weifan has joined #openstack-ansible | 22:04 | |
| *** sreejithp has quit IRC | 22:14 | |
| *** hamzaachi has joined #openstack-ansible | 22:21 | |
| *** hamzaachi has quit IRC | 22:36 | |
| *** macza has quit IRC | 22:57 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_glance master: Clarify supported SUSE versions https://review.opendev.org/660077 | 22:59 |
| *** tosky has quit IRC | 23:11 | |
| *** tosky has joined #openstack-ansible | 23:11 | |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Clarify supported SUSE versions https://review.opendev.org/660320 | 23:30 |
| *** tosky has quit IRC | 23:34 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!