| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Switch default virtualenv to python3 https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/779692 | 00:18 |
|---|---|---|
| *** tosky has quit IRC | 00:26 | |
| *** jamesdenton has quit IRC | 01:26 | |
| *** jamesden_ has joined #openstack-ansible | 01:28 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Add integrated tests various Neutron deployment scenarios https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/778015 | 01:55 |
| openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Fix conditional for ovs https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/778075 | 01:55 |
| *** macz_ has quit IRC | 02:02 | |
| *** spatel_ has joined #openstack-ansible | 02:03 | |
| openstackgerrit | Merged openstack/ansible-role-uwsgi master: Switch default python version to python3 https://review.opendev.org/c/openstack/ansible-role-uwsgi/+/779723 | 02:08 |
| *** macz_ has joined #openstack-ansible | 02:49 | |
| *** macz_ has quit IRC | 02:54 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Switch default virtualenv to python3 https://review.opendev.org/c/openstack/openstack-ansible-os_swift/+/779690 | 03:06 |
| *** openstackgerrit has quit IRC | 03:25 | |
| *** spatel_ has quit IRC | 03:53 | |
| *** rh-jelabarre has quit IRC | 04:10 | |
| *** jamesden_ has quit IRC | 04:36 | |
| *** jamesdenton has joined #openstack-ansible | 04:37 | |
| jamesdenton | seems mgariepy had the magic touch with the os_neutron patches. thanks! | 04:56 |
| *** evrardjp has quit IRC | 05:33 | |
| *** evrardjp has joined #openstack-ansible | 05:33 | |
| *** gyee has quit IRC | 05:52 | |
| *** yasemind has joined #openstack-ansible | 06:02 | |
| *** jamesdenton has quit IRC | 06:21 | |
| *** jamesden_ has joined #openstack-ansible | 06:21 | |
| *** shyamb has joined #openstack-ansible | 07:06 | |
| *** miloa has joined #openstack-ansible | 08:01 | |
| jrosser | could i get reviews on this please Move neutron pip packages from constraints to requirements | 08:07 |
| jrosser | oops | 08:07 |
| jrosser | this https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/770276 | 08:07 |
| *** shyamb has quit IRC | 08:11 | |
| *** openstackgerrit has joined #openstack-ansible | 08:14 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ceilometer master: Move ceilometer pip packages from constraints to requirements https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/779668 | 08:14 |
| *** andrewbonney has joined #openstack-ansible | 08:24 | |
| *** tosky has joined #openstack-ansible | 08:33 | |
| *** miloa has quit IRC | 08:43 | |
| *** jamesden_ has quit IRC | 08:44 | |
| *** jamesdenton has joined #openstack-ansible | 08:45 | |
| *** tosky_ has joined #openstack-ansible | 08:52 | |
| *** tosky is now known as Guest86814 | 08:53 | |
| *** tosky_ is now known as tosky | 08:53 | |
| *** Guest86814 has quit IRC | 08:55 | |
| *** shyamb has joined #openstack-ansible | 08:56 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: remove argsplat warning https://review.opendev.org/c/openstack/openstack-ansible-ops/+/778884 | 09:05 |
| openstackgerrit | Merged openstack/openstack-ansible-os_cloudkitty master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_cloudkitty/+/779730 | 09:07 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Move neutron pip packages from constraints to requirements https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/770276 | 09:24 |
| openstackgerrit | Andrew Bonney proposed openstack/openstack-ansible-tests master: Adjust modules path for Neutron test containers https://review.opendev.org/c/openstack/openstack-ansible-tests/+/777091 | 09:24 |
| *** shyamb has quit IRC | 09:32 | |
| *** shyamb has joined #openstack-ansible | 09:50 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_blazar master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_blazar/+/779727 | 09:58 |
| openstackgerrit | Merged openstack/openstack-ansible-os_trove master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_trove/+/779753 | 10:03 |
| openstackgerrit | Merged openstack/openstack-ansible-os_placement master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_placement/+/779763 | 10:04 |
| *** pcaruana has quit IRC | 10:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_keystone/+/779737 | 10:10 |
| openstackgerrit | Merged openstack/openstack-ansible-os_zun master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/779754 | 10:30 |
| *** shyamb has quit IRC | 10:34 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_barbican master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_barbican/+/779726 | 10:40 |
| openstackgerrit | Merged openstack/openstack-ansible-os_zun master: Switch default virtualenv to python3 https://review.opendev.org/c/openstack/openstack-ansible-os_zun/+/779694 | 10:45 |
| *** cp- has quit IRC | 11:11 | |
| *** cp- has joined #openstack-ansible | 11:11 | |
| *** shyamb has joined #openstack-ansible | 11:14 | |
| *** jawad_axd has joined #openstack-ansible | 11:17 | |
| *** cp- has quit IRC | 11:21 | |
| *** cp- has joined #openstack-ansible | 11:22 | |
| *** cp- has quit IRC | 11:22 | |
| *** cp- has joined #openstack-ansible | 11:23 | |
| *** cp- has quit IRC | 11:24 | |
| *** cp- has joined #openstack-ansible | 11:41 | |
| *** shyamb has quit IRC | 11:42 | |
| *** macz_ has joined #openstack-ansible | 12:06 | |
| admin0 | on one controller, which has over 64GB of unused RAM ( out of 128gb total) , what could cause this: Out of memory: Killed process 976680 (openstack) total-vm:83867164kB, anon-rss:83832244kB, file-rss:0kB, shmem-rss:0kB, UID:0 pgtables:164156kB oom_score_adj:0 | 12:07 |
| admin0 | is one of the controllers .. do we limit any processes/containers in osa in terms of memory | 12:07 |
| *** macz_ has quit IRC | 12:11 | |
| *** jamesdenton has quit IRC | 12:13 | |
| *** jamesdenton has joined #openstack-ansible | 12:14 | |
| *** emmadavis has joined #openstack-ansible | 12:18 | |
| *** emmadavis has joined #openstack-ansible | 12:18 | |
| *** shyamb has joined #openstack-ansible | 12:19 | |
| *** emmadavis has quit IRC | 12:22 | |
| *** emmadavis has joined #openstack-ansible | 12:23 | |
| *** emmadavis has quit IRC | 12:28 | |
| *** emmadavis has joined #openstack-ansible | 12:28 | |
| *** shyamb has quit IRC | 12:55 | |
| *** openstack has joined #openstack-ansible | 13:17 | |
| *** ChanServ sets mode: +o openstack | 13:17 | |
| *** rh-jelabarre has joined #openstack-ansible | 13:39 | |
| *** cp- has quit IRC | 13:54 | |
| *** cp- has joined #openstack-ansible | 13:55 | |
| mgariepy | jamesdenton, it's been more than 30 minutes ;p haha https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/778771 | 14:04 |
| jamesdenton | :D | 14:04 |
| mgariepy | so it took my ovs patch for neutron to finally merge? | 14:04 |
| jamesdenton | i think that merged after? i'd have to see the order. You just +1'd it | 14:05 |
| jamesdenton | that sweet, sweet +1 | 14:05 |
| openstackgerrit | Marc Gariépy proposed openstack/openstack-ansible-os_neutron stable/victoria: Fix conditional for ovs https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/779928 | 14:12 |
| mjwales | what process creates the dhcp_agent.controller-X queues? Nothing we try seems to get the queue created | 14:23 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Add panko repo to required_projects for distro jobs https://review.opendev.org/c/openstack/openstack-ansible/+/780012 | 14:33 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_panko master: Switch default virtualenv to python3 https://review.opendev.org/c/openstack/openstack-ansible-os_panko/+/779685 | 14:35 |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: Implement uWSGI for neutron-api https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/486156 | 14:35 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_panko master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_panko/+/779746 | 14:36 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_panko master: [reno] Stop publishing release notes https://review.opendev.org/c/openstack/openstack-ansible-os_panko/+/772043 | 14:36 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_aodh master: Switch default virtualenv to python3 https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/779666 | 14:37 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_aodh master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_aodh/+/779725 | 14:37 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Add panko repo to required_projects for distro jobs https://review.opendev.org/c/openstack/openstack-ansible/+/780012 | 14:42 |
| admin0 | anyone here also running a public facing osa cloud ? | 14:55 |
| *** LowKey has joined #openstack-ansible | 15:02 | |
| *** spotz has joined #openstack-ansible | 15:10 | |
| fungi | admin0: i know logan- runs one to help with opendev's ci workload | 15:12 |
| fungi | mnaser may also? and noonedeadpunk possibly | 15:12 |
| fungi | if you're looking for commercial public cloud examples (i don't know for sure they're using osa, but i know they help run commercial public clouds and they're involved in osa or have been) | 15:13 |
| fungi | also i think rackspace's managed private cloud service relies or at least at one time relied on osa (i don't know who's running it these days but cloudnull might have some idea if it still is) | 15:14 |
| admin0 | i am looking for commercial ones .. our workload is getting bigger so want to expand to commercial ones when need arises, and due to the news of the ovh datacenter fire, also need to write a business continuity procedure so that in case it happens in our own dc, we have someting pre-tested and setup to shift our workload | 15:15 |
| admin0 | users => (custom portal) => cloud .. so for the users, its transparent as to where it is being deployed | 15:15 |
| fungi | in theory, whether a public openstack provider is using osa or kolla or tripleo or puppet-openstack or chef-openstack or openstack-charms or... should be invisible to the users of their service | 15:16 |
| *** dirk2 is now known as dirk | 15:23 | |
| *** mjwales has quit IRC | 15:23 | |
| *** spatel_ has joined #openstack-ansible | 15:29 | |
| *** macz_ has joined #openstack-ansible | 16:00 | |
| *** macz_ has quit IRC | 16:01 | |
| *** macz_ has joined #openstack-ansible | 16:01 | |
| spatel_ | jamesdenton look like OVN patches got merge to master does that means i don't need to manual patch if i want to build AIO right? | 16:07 |
| openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Fix Remove revoked ceph apt-keys https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/778771 | 16:12 |
| openstackgerrit | Marc Gariépy proposed openstack/openstack-ansible-ceph_client stable/victoria: Fix Remove revoked ceph apt-keys https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/779930 | 16:14 |
| openstackgerrit | Marc Gariépy proposed openstack/openstack-ansible-ceph_client stable/ussuri: Fix Remove revoked ceph apt-keys https://review.opendev.org/c/openstack/openstack-ansible-ceph_client/+/779931 | 16:14 |
| *** prometheanfire has joined #openstack-ansible | 16:35 | |
| openstackgerrit | Ebbex proposed openstack/openstack-ansible-ops master: Remove tasks for v6.5 beats (aarch64) from elk7 https://review.opendev.org/c/openstack/openstack-ansible-ops/+/779065 | 16:36 |
| openstackgerrit | Ebbex proposed openstack/openstack-ansible-ops master: It's always systemd. Remove references to upstart https://review.opendev.org/c/openstack/openstack-ansible-ops/+/779066 | 16:36 |
| jamesdenton | spatel_ that's correct | 16:41 |
| spatel_ | +1 i am deploying multi-node cluster using OVN so that is good new i don't need to manually patch | 16:41 |
| jamesdenton | niiice | 16:42 |
| spatel_ | jamesdenton do i need to create any special bridge? | 16:42 |
| jamesdenton | how are you creating your provider mappings? in openstack_user_config or user_variables? | 16:43 |
| spatel_ | I am going to create standard br-vxlan/vlan/mgmt etc.. | 16:43 |
| jamesdenton | You could do something like what's documented here: | 16:43 |
| jamesdenton | https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-ovn.html | 16:43 |
| spatel_ | jamesdenton i didn't create anything yet.. so looking for good method | 16:43 |
| jamesdenton | So, once you bootstrap-aio.sh, you could have a openstack_user_config.yml file | 16:44 |
| *** seanp has joined #openstack-ansible | 16:44 | |
| jamesdenton | and in it, there ought to be some standard ovn-related networks defined. I believe they are suited for an AIO but could be modified to use a real eth/bond interface | 16:44 |
| jamesdenton | https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio.j2#L123-L140 | 16:45 |
| jrosser | seanp: following up from in #openstack, that task has no_log as you point out | 16:46 |
| seanp | Right, but I am, as of yet, unable to find where to switch that to no_log: false | 16:46 |
| jamesdenton | spatel_ that's what it will set up in the file. eth12 is a veth, but you could replace with bond1, for example | 16:46 |
| jrosser | the playbooks and stuff are all whereever you cloned the openstack-ansible repo to | 16:46 |
| seanp | This spot was pointed out to me: https://opendev.org/openstack/openstack-ansible-os_keystone/src/branch/stable/victoria/tasks/db_setup.yml#L36 | 16:46 |
| jrosser | but the ansible roles themselves end up in /etc/ansible/roles | 16:46 |
| jamesdenton | spatel_ then the playbooks will create the br-provider bridge and put bond1 in there for you. | 16:47 |
| jamesdenton | just don't create a br-vlan, as it will conflict with the linuxbridge known as br-vlan | 16:47 |
| spatel_ | jamesdenton okay so i have to replace eth12 with my external interface bond0 or eno1 whatever | 16:47 |
| jamesdenton | right | 16:47 |
| jrosser | seanp: so you should find that in /etc/ansible/roles/os_keystone/tasks/db_setup.yml | 16:47 |
| seanp | Nice, I was just looking around in that folder, thanks! | 16:47 |
| jrosser | no worries | 16:47 |
| spatel_ | when i should be creating br-vlan or ovs/ovn will create automatically? | 16:47 |
| jrosser | just shout if you need any more help, though watch out for pasting the debug output from that if you actually care about the db password | 16:48 |
| jrosser | you can put stuff at paste.openstack.org if you want to get some extra eyes on it | 16:48 |
| seanp | Thanks. This is more or less a PoC. I've worked with openstack as a user for some time, just wanting to get some admin experience | 16:48 |
| spatel_ | jamesdenton can i use containers for multi-node or metal is good way to go, because my current AIO running on metal | 16:49 |
| jrosser | sure, no worries. most of us here are operating openstack in some form or another, so theres reasonable chance of getting unstuck | 16:49 |
| jrosser | spatel_: you can do it whichever way you like :) | 16:52 |
| jamesdenton | spatel_ i don't see why not | 16:52 |
| jrosser | remember OSA is a toolbox | 16:52 |
| spatel_ | perfect! | 16:52 |
| mgariepy | for ovn you don't need the lxb since all the fw stuff is done inside ovs-flows. | 16:53 |
| jamesdenton | yeah, i think the aio sets it up regardless, though | 16:54 |
| seanp | Step 1: "msg": "The PyMySQL (Python 2.7 and Python 3.X) or MySQL-python (Python 2.X) module is required." | 16:54 |
| mgariepy | jamesdenton, probably. | 16:54 |
| spatel_ | generally i create br-mgmt and br-vxlan using LinuxBridge what is the method with OVN, should i use OVS or keep br-mgmt/br-vxlan on LinuxBridge ? | 16:54 |
| jamesdenton | spatel_ the AIO will do all of that for you, i believe | 16:55 |
| mgariepy | my ovs cloud setup doesnt use lxb exept on the controller for simplicity, my l3 agent are baremetal without any bridges. | 16:55 |
| jamesdenton | br-vlxan bridge is not needed (as a bridge, anyway) since its purpose was to connect to lxc container(s), and now neutron agents run on metal by default. You still need the overlay IP configured somewhere, though | 16:56 |
| spatel_ | AIO use LinuxBridge for br-* interfaces | 16:56 |
| jamesdenton | and br-vxlan may need to get renamed to something else, as ovn uses geneve | 16:56 |
| jamesdenton | yes, aio does use lxb | 16:56 |
| spatel_ | jamesdenton so let me get this straight, in multi-node all i need br-mgmt right and nothing else? | 16:57 |
| jamesdenton | i guess the better question is, how are you looking to deploy multi-node with aio process? | 16:58 |
| spatel_ | no AIO | 16:58 |
| spatel_ | this is going to be production cloud | 16:58 |
| jamesdenton | gotcha | 16:58 |
| spatel_ | 10 node production cloud 3 node controller and 7 node compute | 16:58 |
| jamesdenton | so those patches won't really apply, anyway, as those were for aio/testing | 16:59 |
| jamesdenton | but i understand now. | 16:59 |
| spatel_ | :( | 16:59 |
| spatel_ | Then i shouldn't attempt to deploy if its not ready for multi-node prod design | 17:00 |
| jamesdenton | So, really, you can likely mirror your existing deployment, except anywhere in openstack_user_config you see 'neutron_linuxbridge_agent' replace it with 'neutron_ovn_controller'. You will really want to follow the guidance here (https://docs.openstack.org/openstack-ansible-os_neutron/latest/app-ovn.html) for the provider network setup there. And, don't use 'host_bind_override'. | 17:01 |
| jamesdenton | um, i would argue that multi-node is possible, just not really well tested for prod at this point (with OSA, that is) | 17:01 |
| jamesdenton | mgariepy gave it a go a while back and ran into some issues, and i haven't worked on it in a while | 17:01 |
| jamesdenton | so you'd be doing us a solid by working thru those issues :D | 17:02 |
| spatel_ | let me give it a try, will see how bad it is. | 17:02 |
| mgariepy | also note : https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tasks/providers/setup_ovs_ovn.yml#L38-L42 | 17:02 |
| mgariepy | also :https://bugs.launchpad.net/openstack-ansible/+bug/1790933 | 17:03 |
| openstack | Launchpad bug 1790933 in openstack-ansible "Implement OVSDB clustering for OVN" [Medium,In progress] - Assigned to James Denton (james-denton) | 17:03 |
| jamesdenton | 2018-09-05 | 17:04 |
| jamesdenton | lol | 17:04 |
| mgariepy | i guess i would like to have that fixed before going in prod. | 17:04 |
| mgariepy | it's in progress ;p jaja | 17:04 |
| mgariepy | will i stop finding issues on my ubuntu upgrade ? | 17:07 |
| jamesdenton | i am no magic 8 ball | 17:07 |
| mgariepy | lol. | 17:08 |
| spatel_ | I am all up for OVN now in production. I have some cool deployment on my way so planning to use OVN for all of them | 17:08 |
| *** jamesdenton has quit IRC | 17:16 | |
| *** jamesdenton has joined #openstack-ansible | 17:16 | |
| *** gyee has joined #openstack-ansible | 17:35 | |
| jrosser | seanp: can you paste the task output to paste.openstack.org, and a few of the surrouding lines for context? | 17:44 |
| seanp | I will do that. I believe I found the issue after turning off the no_log condition, PyMySQL was missing from Galera. A colleague provided me with a user yml to add that in and I'm running the playbooks now | 18:01 |
| seanp | It sounds plausible as there was no keystone DB on the galera server | 18:01 |
| seanp | Unfortunately I didn't capture the output after turning on logging, but I've pasted up what I assume was the important part of the message | 18:03 |
| seanp | http://paste.openstack.org/show/803480/ | 18:03 |
| admin0 | i am using babrican .. upgraded from 22.0.1 to 22.1.0 and i get this error -> https://gist.github.com/a1git/4e335bfdfe5fd9487b596f71d1b0190a -- what could it be ? Could not satisfy constraints for 'barbican-ui' | 18:04 |
| admin0 | so horizon is failing to be built/upgraded | 18:05 |
| jrosser | could i get reviews on this please https://review.opendev.org/c/openstack/openstack-ansible/+/780012 | 18:06 |
| *** andrewbonney has quit IRC | 18:12 | |
| *** yasemind has quit IRC | 18:16 | |
| jrosser | admin0: can you paste the contents of the files on the horizon container from your log? the constraints file? | 18:18 |
| spatel_ | admin0 I don't think barbican-ui has full support | 18:18 |
| *** yasemind has joined #openstack-ansible | 18:21 | |
| admin0 | i don't need the ui right away .22.1.0 just came with it | 18:23 |
| admin0 | btw, any of you guys seen this error in glance + ceph => https://bugs.launchpad.net/glance/+bug/1916482 | 18:24 |
| openstack | Launchpad bug 1916482 in Glance "rbd.IncompleteWriteError: RBD incomplete write (Wrote only 8388608 out of 8394566 bytes) since Victoria Upgrade, ceph v nautilus" [Undecided,New] | 18:24 |
| admin0 | jrosser, -- file: https://gist.githubusercontent.com/a1git/144090c1edb6bf576663239763030a91/raw/1466e4c83f9201a70e91d1592e9e8dfcf8a14d5c/gistfile1.txt | 18:26 |
| admin0 | not sure you wanted that | 18:26 |
| seanp | jrosser: here is that error message I got. It appears the user yml I added to /etc/openstack_deploy didn't install PyMySQL afterall http://paste.openstack.org/show/803481/ | 18:29 |
| admin0 | seanp, which vesion/tag is that ? i have seen this before and had to manually install pymysql | 18:30 |
| seanp | I believe I am using 22.0.1 | 18:31 |
| seanp | Yeah, that is right | 18:31 |
| admin0 | oh .. i think i have deployed the 22.0.1 tag like 15 times already so far .. never got that error .. i got thsoe error on earlier versions | 18:32 |
| seanp | I was advised to create a file called /etc/openstack_deploy/user_galera_py3fix.yml with this content: http://paste.openstack.org/show/803482/ | 18:32 |
| admin0 | ubuntu focal ? | 18:32 |
| seanp | yep | 18:32 |
| seanp | needs to be 18.04? | 18:32 |
| admin0 | nah | 18:33 |
| admin0 | all mine were focal also | 18:33 |
| seanp | cool | 18:33 |
| admin0 | 22.0.1 worked out of the box for me ( non aio, multi node setup) | 18:33 |
| admin0 | seanp, maybe you can go -vvvv .. redirect the setup hosts and setup infra to a logfile and analyze if that pymysql is mentioned | 18:39 |
| seanp | I will try that right now | 18:41 |
| seanp | wow, that puts out significantly more data lol | 18:43 |
| jrosser | wtf :) | 18:43 |
| jrosser | you really really should not have to install anything else | 18:43 |
| seanp | i've wiped and restarted a couple of times at this point and would always get stuck at this point during setup-openstack.yml | 18:44 |
| seanp | I'm installing on VERSION="20.04.2 LTS (Focal Fossa)" | 18:44 |
| admin0 | seanp, having done a lot of deployments on focal and 22.0.1, i can validate that it runs out of the box | 18:44 |
| admin0 | all i do is install focal with only ssh and let the playbooks do the rest | 18:45 |
| seanp | thats it? I've found I need to set my timezone, ssh keys everywhere, set my network config and change to ifupdown from netplan, install resolvconf and set my nameservers | 18:46 |
| seanp | otherwise it would seem to poop out at one step or another | 18:46 |
| admin0 | those aside :D | 18:46 |
| admin0 | i meant in terms of software requirements | 18:46 |
| seanp | oh cool, just want to make sure im not crazy lol | 18:46 |
| admin0 | ssh keys and networks need to be there | 18:46 |
| jrosser | seanp: one moment, take a look at this failed: [infra1_keystone_container-e6d60aac -> 172.29.237.184] | 18:47 |
| jrosser | ^ thats from your paste | 18:47 |
| jrosser | the task that sets the database up is delegated from the keystone container to whatever 172.29.237.184 is | 18:47 |
| jrosser | what is 172.29.237.184 in your setup? | 18:47 |
| seanp | infra1-utility-container-1dc37db4 | 18:48 |
| jrosser | right, so the db setup tasks are all run on the utility container | 18:48 |
| jrosser | there are variables which control that, here https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/source_install.yml#L30-L36 | 18:48 |
| jrosser | you can see for the service and db setup the host and python venv are defined | 18:49 |
| jrosser | thats why i'm a bit surprised at needing to install new packages on the galera host for pymysql, becasue thats not at all where the tasks are run | 18:49 |
| seanp | so it would, in theory, need to be on the utility container? | 18:49 |
| jrosser | it should already be there | 18:49 |
| jrosser | in the virtualenv at /openstack/venvs/utility-{{ openstack_release }}/bin/python | 18:50 |
| admin0 | seanp, grep on that logfile when the run is complete might shed some light | 18:51 |
| admin0 | and also build log from utility container if something failed | 18:51 |
| seanp | yeah, python3-pymysql is installed on that container | 18:51 |
| jrosser | on the container or in the venv? | 18:51 |
| jrosser | those are not the same python environments | 18:52 |
| seanp | i ssh'd into the container and did apt show python3-pymysql | 18:52 |
| jrosser | right, so super important line here https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/source_install.yml#L36 | 18:52 |
| jrosser | which says use the python found here https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/source_install.yml#L36 | 18:52 |
| jrosser | oops https://github.com/openstack/openstack-ansible/blob/master/playbooks/defaults/source_install.yml#L32 | 18:53 |
| jrosser | so `source /openstack/venvs/utility-< version >/bin/activate` | 18:53 |
| jrosser | `pip freeze` | 18:53 |
| seanp | i dont seem to have a /openstack on the host or the container | 18:53 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Add whitebox-tempest-plugin support https://review.opendev.org/c/openstack/openstack-ansible-os_tempest/+/771472 | 18:54 |
| mgariepy | jrosser, jamesdenton do we need to backport the neutron stuff to older release ? | 18:54 |
| jrosser | seanp: ok so thats not good | 18:54 |
| seanp | wait, im dumb i see it | 18:54 |
| seanp | looks like there is no a venvs directory inside. i am running the playbooks right now so perhaps that gets recreated and it just hasn't been yet? | 18:56 |
| jrosser | setup-infrastructure.yml should have setup the utility container | 18:57 |
| jrosser | look inside the setup-<blah>.yml | 18:57 |
| jrosser | they just call others | 18:57 |
| jrosser | so you can run openstack-ansible playbooks/utility-install.yml directly | 18:57 |
| * jrosser has to head out | 18:57 | |
| seanp | thanks for the chat, I appreciate it | 18:57 |
| jrosser | utility-install should create that venv and put the galera client stuff in it | 18:58 |
| seanp | cool, i'll check it after the playbooks finish up | 18:58 |
| jamesdenton | jrosser what neutron stuff, specifically? | 19:10 |
| spatel_ | jrosser how do i tell OSA to not use SSL for pip ? | 19:14 |
| spatel_ | its using port 443 default | 19:15 |
| *** jawad_axd has quit IRC | 19:18 | |
| jrosser | jamesdenton: i think it was mgariepy asking..... | 19:23 |
| jamesdenton | oh you're right, sorry! | 19:23 |
| jrosser | spatel_: what are you trying to do with pip not being ssl? | 19:24 |
| spatel_ | We have one secure environment where we are running RHEL 8.0 licensed from Redhat, I am trying to install AIO but during bootstrap aio giving pip SSL validation error, I believe OS not allowing any untrusted SSL certificate | 19:25 |
| spatel_ | I have tried pip install --trusted-host pypi.org --trusted-host files.pythonhosted.org but still getting same error | 19:25 |
| mgariepy | the neutron tests and all. | 19:26 |
| jamesdenton | ahh, ok. i will have to defer that. happy to do it, may just need to add bionic to the mix, no? | 19:27 |
| mgariepy | https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/779928 | 19:28 |
| jamesdenton | doh | 19:29 |
| mgariepy | what i was wondering is that did it failed because of some missing stuff from the other patches. | 19:29 |
| mgariepy | ahha | 19:29 |
| jrosser | spatel_: pypi.org has a proper certificate, so it's either at pypi end not having the necessary intermediates bundled, or it's RHEL not having the right CA certs available for you | 19:29 |
| * mgariepy should start to ask direct questions.. | 19:29 | |
| spatel_ | I think i found my solution created /etc/pip.conf file to ignore cert | 19:29 |
| jamesdenton | i did nothing to address that particular failure. | 19:29 |
| jrosser | spatel_: you've installed whatever package may be necessary on RHEL to have the trusted root certs? | 19:30 |
| mgariepy | i'll do a recheck and debug a bit then. | 19:30 |
| mgariepy | if it fails again and it's not just a blip. | 19:30 |
| jamesdenton | tempest: 'run -l' is not a tempest command | 19:30 |
| jrosser | spatel_: ca-certificates i think? | 19:30 |
| spatel_ | http://paste.openstack.org/show/803483/ | 19:33 |
| *** rh-jelabarre has quit IRC | 19:47 | |
| *** rh-jelabarre has joined #openstack-ansible | 19:52 | |
| jrosser | jamesdenton: mgariepy could you take a look at this if you have a moment https://review.opendev.org/c/openstack/openstack-ansible/+/780012 | 20:04 |
| jamesdenton | LGTM | 20:05 |
| jrosser | ta | 20:06 |
| *** yasemind has quit IRC | 20:10 | |
| admin0 | is multiple glance backend possible ? | 20:34 |
| admin0 | and how to select ? | 20:34 |
| spatel_ | admin0 you can upload imager with specifying backend i believe | 20:35 |
| spatel_ | image* | 20:35 |
| admin0 | how to have rbd and nfs at the same time :) | 20:36 |
| admin0 | in OSA ceph is via user_variables .. and nfs is via user_config with image_hosts block | 20:36 |
| spatel_ | example ? | 20:37 |
| admin0 | makign one | 20:43 |
| admin0 | hold | 20:43 |
| *** ioni has joined #openstack-ansible | 20:46 | |
| *** jamesdenton has quit IRC | 20:53 | |
| *** jamesdenton has joined #openstack-ansible | 20:53 | |
| *** zul has joined #openstack-ansible | 20:56 | |
| admin0 | spatel_, https://gist.githubusercontent.com/a1git/5c7eaca8d52504fafb201e9baf97fc86/raw/849b5060660cabb0fc81051b760191e5594f4908/gistfile1.txt | 21:04 |
| admin0 | that has the current way on OSA for glance backends.. and a link on glance multi backend | 21:05 |
| *** spatel_ has quit IRC | 21:10 | |
| *** spatel has joined #openstack-ansible | 21:10 | |
| admin0 | is glance snapshot possible when using ceph backend ? | 21:19 |
| *** ioni has quit IRC | 21:20 | |
| openstackgerrit | Ebbex proposed openstack/openstack-ansible-os_neutron master: powervm: drop custom code https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/780116 | 21:29 |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: Remove third-party OVS NSH support in favor of built-in support https://review.opendev.org/c/openstack/openstack-ansible-os_neutron/+/780117 | 21:33 |
| *** ioni has joined #openstack-ansible | 21:43 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Clean up code from unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-tests/+/779722 | 21:59 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_ceilometer master: Move ceilometer pip packages from constraints to requirements https://review.opendev.org/c/openstack/openstack-ansible-os_ceilometer/+/779668 | 22:05 |
| openstackgerrit | Merged openstack/openstack-ansible master: Add panko repo to required_projects for distro jobs https://review.opendev.org/c/openstack/openstack-ansible/+/780012 | 22:20 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible master: Disable magnum zero nodes test. https://review.opendev.org/c/openstack/openstack-ansible/+/780124 | 22:28 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Switch default virtualenv to python3 https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/779678 | 22:29 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Remove references to unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/779738 | 22:30 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_magnum master: Use new openstack.cloud collection names https://review.opendev.org/c/openstack/openstack-ansible-os_magnum/+/775917 | 22:30 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Adjust modules path for Neutron test containers https://review.opendev.org/c/openstack/openstack-ansible-tests/+/777091 | 22:31 |
| *** jbadiapa has quit IRC | 22:40 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Clean up code from unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-tests/+/779722 | 22:44 |
| *** spatel has quit IRC | 22:44 | |
| *** mathlin_ has joined #openstack-ansible | 23:08 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-tests master: Clean up code from unsupported operating systems https://review.opendev.org/c/openstack/openstack-ansible-tests/+/779722 | 23:08 |
| *** jonher_ has joined #openstack-ansible | 23:10 | |
| *** mathlin has quit IRC | 23:11 | |
| *** jonher has quit IRC | 23:11 | |
| *** jonher_ is now known as jonher | 23:11 | |
| *** jamesdenton has quit IRC | 23:23 | |
| *** jamesdenton has joined #openstack-ansible | 23:23 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: Add hide_create_volume option to defaults https://review.opendev.org/c/openstack/openstack-ansible-os_horizon/+/777350 | 23:45 |
Generated by irclog2html.py 2.17.2 by Marius Gedminas - find it at https://mg.pov.lt/irclog2html/!