openstackgerrit | Michael Vollman proposed openstack/ansible-config_template master: Compare dict vars to determine changed https://review.openstack.org/582532 | 00:09 |
---|---|---|
*** pmannidi has joined #openstack-ansible | 01:12 | |
*** mrda has joined #openstack-ansible | 02:06 | |
*** mrda has quit IRC | 02:09 | |
*** Bhujay has joined #openstack-ansible | 02:29 | |
*** dave-mccowan has quit IRC | 02:29 | |
*** Bhujay has quit IRC | 02:30 | |
*** Bhujay has joined #openstack-ansible | 02:30 | |
*** dave-mccowan has joined #openstack-ansible | 02:50 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Convert refresh fact to strings https://review.openstack.org/604958 | 02:54 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Make the elasticsearch plugins optional https://review.openstack.org/604867 | 02:55 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Add the pip package hvac to support hashicorp vault https://review.openstack.org/604831 | 03:10 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Fix Kibana dashboard uploading for mirrors and proxies https://review.openstack.org/604827 | 03:10 |
spatel | cloudnull: ^^ | 03:14 |
spatel | you there? | 03:14 |
*** Bhujay has quit IRC | 03:41 | |
*** udesale has joined #openstack-ansible | 03:57 | |
*** mcarden has joined #openstack-ansible | 04:35 | |
*** Bhujay has joined #openstack-ansible | 04:37 | |
*** shyamb has joined #openstack-ansible | 05:14 | |
*** lbragstad has quit IRC | 05:18 | |
*** shyamb has quit IRC | 05:26 | |
*** shyamb has joined #openstack-ansible | 05:31 | |
*** spatel has quit IRC | 05:33 | |
*** pcaruana has joined #openstack-ansible | 05:41 | |
*** chkumar|off is now known as chkumar|ruck | 05:42 | |
*** Bhujay has quit IRC | 06:00 | |
openstackgerrit | Merged openstack/openstack-ansible-os_swift master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604122 | 06:02 |
*** shyamb has quit IRC | 06:05 | |
*** DanyC has joined #openstack-ansible | 06:08 | |
*** shyamb has joined #openstack-ansible | 06:09 | |
*** shyamb has quit IRC | 06:12 | |
*** shyamb has joined #openstack-ansible | 06:13 | |
*** Bhujay has joined #openstack-ansible | 06:14 | |
*** Bhujay has quit IRC | 06:15 | |
*** DanyC has quit IRC | 06:16 | |
*** shyamb has quit IRC | 06:50 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604080 | 07:00 |
hwoarang | spotz: hello. I am now :) | 07:00 |
*** shyamb has joined #openstack-ansible | 07:04 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_nova master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604080 | 07:08 |
evrardjp | morning | 07:16 |
evrardjp | I will try to find cycles for config_template today -- It's been quite a busy couple of weeks :) | 07:16 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_swift master: zuul.d: Update jobs for package installations https://review.openstack.org/604988 | 07:18 |
openstackgerrit | Merged openstack/openstack-ansible-os_blazar master: Define cache_timeout variable https://review.openstack.org/604917 | 07:27 |
*** hamzaachi has joined #openstack-ansible | 07:30 | |
*** shyamb has quit IRC | 07:32 | |
*** shyamb has joined #openstack-ansible | 07:45 | |
*** shardy has joined #openstack-ansible | 07:52 | |
*** tosky has joined #openstack-ansible | 07:54 | |
*** shyamb has quit IRC | 07:56 | |
openstackgerrit | Merged openstack/openstack-ansible-os_glance master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/603133 | 07:59 |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/603139 | 08:07 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/rocky: Allow configuration of startup timeout https://review.openstack.org/604996 | 08:12 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: Allow configuration of startup timeout https://review.openstack.org/604998 | 08:13 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Allow configuration of startup timeout https://review.openstack.org/604999 | 08:13 |
*** DanyC has joined #openstack-ansible | 08:16 | |
arxcruz | mnaser: odyssey4me hey, can you guys take a look at this http://logs.openstack.org/00/603100/27/check/openstack-ansible-functional-ubuntu-bionic/d0479e2/job-output.txt.gz#_2018-09-25_02_18_53_331582 | 08:17 |
arxcruz | i'm using the python_venv_build however it seems it's not creating the venv properly | 08:17 |
*** mrda has joined #openstack-ansible | 08:18 | |
*** pmannidi has quit IRC | 08:35 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_blazar stable/rocky: Define cache_timeout variable https://review.openstack.org/605007 | 08:46 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_blazar stable/rocky: Fix functional tests for Blazar https://review.openstack.org/604813 | 08:48 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_blazar stable/rocky: use include_tasks instead of include https://review.openstack.org/604814 | 08:48 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_blazar stable/rocky: Add the MQ vhost/user creation and configuration https://review.openstack.org/604815 | 08:48 |
odyssey4me | cores - anyon around to review https://review.openstack.org/604626 ? | 08:50 |
*** evrardjp_ has joined #openstack-ansible | 08:50 | |
odyssey4me | arxcruz: taking a look now | 08:50 |
*** evrardjp has quit IRC | 08:53 | |
*** neith has joined #openstack-ansible | 08:53 | |
*** shyamb has joined #openstack-ansible | 08:53 | |
*** priteau has joined #openstack-ansible | 08:54 | |
odyssey4me | arxcruz: so it's doing the install as it would do if you pip installed any other way: http://logs.openstack.org/00/603100/27/check/openstack-ansible-functional-ubuntu-bionic/d0479e2/logs/ara-report/result/f9603dfe-dd11-49f2-8bf5-b7282299bdb9/ | 08:57 |
odyssey4me | arxcruz: mind if I tweak the patch to give some more diagnostics? | 08:57 |
odyssey4me | arxcruz: oh, never mind, I see it | 09:02 |
odyssey4me | I thought I did, then I realised I did not. :/ | 09:04 |
odyssey4me | lemme fire up a test host to make inspection easier | 09:04 |
*** mwe1 has quit IRC | 09:11 | |
*** evrardjp_ is now known as evrardjp | 09:15 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services https://review.openstack.org/604695 | 09:16 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604286 | 09:16 |
*** Emine has joined #openstack-ansible | 09:18 | |
*** dxiri has quit IRC | 09:29 | |
openstackgerrit | Merged openstack/openstack-ansible stable/queens: Update all SHAs for 17.1.2 https://review.openstack.org/604622 | 09:34 |
*** mwe1 has joined #openstack-ansible | 09:36 | |
*** shyamb has quit IRC | 09:38 | |
*** cshen has joined #openstack-ansible | 09:42 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services https://review.openstack.org/604695 | 09:51 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604286 | 09:51 |
*** electrofelix has joined #openstack-ansible | 10:00 | |
openstackgerrit | Merged openstack/openstack-ansible-repo_build stable/rocky: Remove galera_client meta-dependency https://review.openstack.org/604489 | 10:08 |
openstackgerrit | Merged openstack/openstack-ansible stable/rocky: Update all SHAs for 18.0.0 https://review.openstack.org/604619 | 10:09 |
*** cshen has quit IRC | 10:12 | |
openstackgerrit | Merged openstack/openstack-ansible-tests stable/pike: Revert "Revert "Run with KVM if we can in tests"" https://review.openstack.org/604720 | 10:29 |
*** shyamb has joined #openstack-ansible | 10:29 | |
*** dxiri has joined #openstack-ansible | 10:31 | |
*** spatel has joined #openstack-ansible | 10:34 | |
*** spatel has quit IRC | 10:38 | |
openstackgerrit | Merged openstack/openstack-ansible-os_cinder master: Update messaging notification configuration https://review.openstack.org/604131 | 10:42 |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: Disable neutron-vpnaas-agent https://review.openstack.org/604654 | 10:45 |
openstackgerrit | Merged openstack/openstack-ansible stable/ocata: Update all SHAs for 15.1.28 https://review.openstack.org/604626 | 11:01 |
*** gokhani has joined #openstack-ansible | 11:02 | |
*** shyamb has quit IRC | 11:12 | |
*** pcaruana has quit IRC | 11:15 | |
*** udesale has quit IRC | 11:17 | |
spotz | hwoarang: Need to run to the barn but when I set haproxy_ssl: false and openstack_external_ssl: false I get a 503 on horizon. Any thoughts? | 11:27 |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add tags for beats setup tasks https://review.openstack.org/605044 | 11:30 |
arxcruz | odyssey4me: hey, sure, go ahead, sorry, i was at doctor appointment | 11:32 |
odyssey4me | arxcruz: no worries, I found the bug and made a review note | 11:32 |
spotz | hwoarang: openstack_service_publicuri_proto: http dpesn't affect the 503 as it works alone | 11:32 |
spotz | And with that I'll be back! | 11:32 |
*** sum12 has quit IRC | 11:34 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Fix journalbeat installation for mixed environments https://review.openstack.org/605045 | 11:35 |
*** sum12 has joined #openstack-ansible | 11:42 | |
*** shyamb has joined #openstack-ansible | 11:48 | |
arxcruz | odyssey4me: (╯°□°)╯︵ ┻━┻ | 11:57 |
arxcruz | odyssey4me: seriously that's it? | 11:58 |
arxcruz | from where i got this /var/log/openstack ? | 11:58 |
arxcruz | ┻━┻ ︵ \(°□°)/ ︵ ┻━┻ | 11:58 |
odyssey4me | arxcruz: yep, the /openstack/log directory would exist if it was using bare metal - but in this case it's a container, so /openstack/log exists on the host, not in the container | 11:58 |
odyssey4me | so you're not going mad :p that is a path that exists, but it's not the right path ;) | 11:59 |
hwoarang | spotz: hmm no idea right now | 12:07 |
openstackgerrit | Merged openstack/openstack-ansible-os_blazar stable/rocky: Define cache_timeout variable https://review.openstack.org/605007 | 12:29 |
*** shyamb has quit IRC | 12:31 | |
*** strattao has joined #openstack-ansible | 12:31 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-ops master: Add host metadata to core beats output https://review.openstack.org/605059 | 12:35 |
evrardjp | hey -- I'd like to discuss extended maintenance of Ocata at today's meeting | 12:36 |
odyssey4me | evrardjp: ++ | 12:39 |
odyssey4me | As far as I'm concerned, we can stop releasing it. | 12:39 |
evrardjp | I'd like to point to EM tags of upstream projects, then tag EM for us, and keep the branch open | 12:40 |
evrardjp | instead of EOL | 12:40 |
evrardjp | maybe add a commit later to EOL should projects EOL vs keeping a branch open. | 12:41 |
odyssey4me | evrardjp: yep, I'm good with that | 12:41 |
evrardjp | but at least after EM, we are kinda clear about the current state, without preventing extra patches by the community | 12:42 |
odyssey4me | We had a brief discussion at the PTG and agreed much the same. | 12:42 |
evrardjp | oh I missed that part | 12:42 |
evrardjp | was that on the etherpad? I haven't seen it, else I'd have been there. | 12:42 |
evrardjp | :p | 12:42 |
odyssey4me | Yeah, I think you were out at the time - and I guess we might have missed making a note in the etherpad. | 12:42 |
odyssey4me | We agreed to leave tests running as far as possible, but remove them if they're too troublesome - leaving only linting, then if those get too hard to maintain we can change them to a noop. | 12:43 |
evrardjp | well | 12:48 |
evrardjp | I think that if tests break we should close the branch if no-one is willing to fix them | 12:48 |
evrardjp | for me it would even make sense to mark those tests nv when we reach EM | 12:49 |
evrardjp | so that if people want their patch in, we say "it's fine, but fix the thing" | 12:49 |
evrardjp | with no real pressure | 12:50 |
openstackgerrit | Merged openstack/openstack-ansible-os_heat master: Update messaging notification configuration https://review.openstack.org/604348 | 12:55 |
openstackgerrit | Merged openstack/openstack-ansible-os_keystone master: Update messaging configuration https://review.openstack.org/604340 | 12:59 |
*** johnthetubaguy has joined #openstack-ansible | 12:59 | |
*** lbragstad has joined #openstack-ansible | 12:59 | |
*** strattao has quit IRC | 13:07 | |
*** lbragstad has quit IRC | 13:09 | |
vollman | cloudnull: When you have time can you take another look at https://review.openstack.org/#/c/582532/ | 13:17 |
openstackgerrit | Arx Cruz proposed openstack/openstack-ansible-os_tempest master: WIP - Enable stackviz support https://review.openstack.org/603100 | 13:20 |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: V2 driver is needed to work with ODL 9.0 https://review.openstack.org/602086 | 13:20 |
*** lbragstad has joined #openstack-ansible | 13:23 | |
*** lbragstad has quit IRC | 13:24 | |
*** lbragstad has joined #openstack-ansible | 13:24 | |
*** lbragstad has quit IRC | 13:26 | |
odyssey4me | evrardjp: Part of the premise of EM is that the branch stays - but there are no promises for tests. Anyone still using it has to do their own validation. | 13:26 |
*** lbragstad_ has joined #openstack-ansible | 13:26 | |
*** lbragstad_ has quit IRC | 13:26 | |
*** lbragstad has joined #openstack-ansible | 13:27 | |
odyssey4me | It's only there to provide a way for collaborators doing patches downstream to share them upstream, rather than have everyone do their own fixes downstream and never share them | 13:27 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services https://review.openstack.org/604695 | 13:31 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604286 | 13:31 |
noonedeadpunk | hi folks | 13:36 |
noonedeadpunk | evrardjp, is there any estimate for release of 18.0? As I'm going to put my OS into production and wondering if I have a change to upgrade it to rocky frst | 13:37 |
noonedeadpunk | *have a chance | 13:37 |
evrardjp | odyssey4me: that was my point :) | 13:41 |
evrardjp | noonedeadpunk: I would like to discuss this today | 13:41 |
evrardjp | for me, it's green on periodics, so I'd rather release. | 13:42 |
evrardjp | but odyssey4me has concerns and want another bump | 13:42 |
evrardjp | I am fine with both, I just want to listen the concerns before submitting a final rc/release | 13:42 |
evrardjp | I also need to do a release on friday so it should be long from that on | 13:42 |
noonedeadpunk | thanks) I have several weeks to spare, so hope that release will take place by that time) | 13:44 |
odyssey4me | nice to see so much green :) https://review.openstack.org/#/c/604619/ | 13:48 |
odyssey4me | also nice to see the build times are pretty low | 13:48 |
odyssey4me | w00t - mysql-python is totally eliminated in that build :) | 13:50 |
noonedeadpunk | Yeah, that looks great) oh, btw, is there any good way to upgrade from xenial to bionic? As upgrade process for me looks like upgrading lxc_hots, than destroying/re-creating containers, and, hopefully, they should be created with bionic then | 13:51 |
odyssey4me | evrardjp: With https://review.openstack.org/#/c/604619/ merged, that is not the SHA that needs releasing - so we need a new RC, don't we? | 13:52 |
odyssey4me | *that is the sha that needs releasing | 13:52 |
odyssey4me | The last RC was not what we'd like to release - it still has all the mysql-python junk in it. | 13:53 |
evrardjp | let me rephrase that -- you think mysql-python junk is a problem for releasing, and therefore only next release (friday) should be considered as final potential :) | 14:00 |
*** evrardjp has quit IRC | 14:03 | |
*** evrardjp has joined #openstack-ansible | 14:03 | |
odyssey4me | evrardjp: ok, so you'll do another RC request on friday - so we have a few more days for validation? | 14:07 |
odyssey4me | I know that for multi-node tests in master today we're getting failures in the glance role. I've not had a chance to dig into what's going on yet, but the issue may also be present in rocky... we'll have some tests kicked off soon to validate that. | 14:09 |
evrardjp | odyssey4me: I will be on holiday this friday, so it might be even more than that : p | 14:17 |
odyssey4me | evrardjp: I'd rather we did it before you went on holiday then ;) | 14:17 |
evrardjp | I leave on thursday, I can submit the request on that day. | 14:18 |
evrardjp | so we have enough time | 14:19 |
evrardjp | we'll always find bugs, right :) | 14:19 |
evrardjp | the question is, should they prevent a release | 14:19 |
*** vollman has quit IRC | 14:22 | |
*** vollman has joined #openstack-ansible | 14:23 | |
odyssey4me | As far as I know, the current stable/rocky is good enough to go with - perhaps we should do a release request tomorrow, and hope it gets released Thursday. | 14:23 |
odyssey4me | on/by Thursday | 14:23 |
openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/queens: Allow configuration of startup timeout https://review.openstack.org/604998 | 14:24 |
openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/rocky: Allow configuration of startup timeout https://review.openstack.org/604996 | 14:24 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services https://review.openstack.org/604695 | 14:25 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604286 | 14:25 |
canori01 | hey guys, I'm running Ubuntu 16 on my control plane and hypervisors with openstack-ansible queens. Would I be able to upgrade the OS on the metal nodes to Ubuntu 18 without affecting the openstack components running on the venvs? | 14:26 |
mnaser | canori01: not yet | 14:27 |
spotz | hwoarang: Ok interesting wasn't sure if you'd run into it before | 14:27 |
canori01 | mnaser: ah ok. But it will be possible in the future? | 14:28 |
mnaser | canori01: in rocky official release, it should be | 14:28 |
mnaser | but we still haven't tested in palce upgrades and everything | 14:28 |
mnaser | there's a lot of testing to be done about OS upgrades | 14:29 |
*** dmsimard has quit IRC | 14:31 | |
*** dmsimard has joined #openstack-ansible | 14:32 | |
jrosser | we know that the lxc config files will need adjusting, for one thing | 14:33 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services https://review.openstack.org/604695 | 14:33 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604286 | 14:33 |
*** spatel has joined #openstack-ansible | 14:34 | |
spatel | jamesdenton: quick question | 14:34 |
spatel | how do i know remote instance running on what underly technology like DPDK, virtio or SRIOV ? | 14:35 |
spatel | I have third-party remote cloud access, alternative of aws, trying to find how to find out what they are using under the guest VM | 14:36 |
*** aludwar has joined #openstack-ansible | 14:40 | |
*** spatel has quit IRC | 14:40 | |
*** strattao has joined #openstack-ansible | 14:41 | |
*** hamzaachi has quit IRC | 14:45 | |
*** hamzaachi has joined #openstack-ansible | 14:46 | |
*** spatel has joined #openstack-ansible | 14:48 | |
spatel | jamesdenton: ^^ | 14:48 |
spatel | sorry got disconnected, i need to get ZNC to make myself online :) | 14:49 |
jamesdenton | spatel i'm not sure. if it's sr-iov, then your VM would indicate the driver (bnx2x, ixgbevf, etc) va virtio | 14:50 |
jamesdenton | *versus | 14:50 |
*** dxiri has quit IRC | 14:50 | |
spatel | what you will see in DPDK ? (when run ethtool -i eth0 )? | 14:51 |
jamesdenton | virtio | 14:51 |
jamesdenton | but that isn't a good indicator | 14:51 |
*** dxiri has joined #openstack-ansible | 14:51 | |
spatel | I am seeing "driver: virtio_net" in remote cloud provider | 14:51 |
*** hamzaachi has quit IRC | 14:52 | |
spatel | does that means its normal network ? | 14:52 |
mnaser | so | 14:52 |
*** hamzaachi has joined #openstack-ansible | 14:52 | |
jamesdenton | i am not really familiar with AWS networking so I'm not 100% on what you would see | 14:53 |
mnaser | i have a big oopsie | 14:54 |
mnaser | right now if you have hostnames with dots in your ansible inventory | 14:54 |
spatel | This is not aws this is third-party cloud | 14:54 |
mnaser | you end up with hostnames like this: `ctl1-sjc1.vexxhost.us_octavia_server_container-1397ed94` | 14:54 |
jamesdenton | ahh ok | 14:54 |
*** hamzaachi has quit IRC | 14:54 | |
mnaser | should we be converting dots to underscores | 14:55 |
spatel | I am planning to launch service in china and got evaluating clouds in china AWS vs local provider | 14:55 |
mnaser | should we be enforcing no dots in the hostname in openstack_user_config | 14:55 |
*** hamzaachi has joined #openstack-ansible | 14:55 | |
*** hwoarang has quit IRC | 14:56 | |
*** skiedude has joined #openstack-ansible | 14:58 | |
*** hwoarang has joined #openstack-ansible | 15:06 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: AppArmor: Handle required profiles for neutron services https://review.openstack.org/604695 | 15:07 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-os_neutron master: SUSE: Add support for openSUSE Leap 15 https://review.openstack.org/604286 | 15:07 |
cloudnull | mornings | 15:07 |
cloudnull | vollman looking now | 15:07 |
*** udesale has joined #openstack-ansible | 15:12 | |
*** hamzaachi_ has joined #openstack-ansible | 15:14 | |
*** devx has joined #openstack-ansible | 15:14 | |
*** dave-mccowan has quit IRC | 15:14 | |
*** hamzaachi has quit IRC | 15:15 | |
*** hwoarang has quit IRC | 15:17 | |
*** chkumar|ruck is now known as chkumar|off | 15:17 | |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Fix journalbeat installation for mixed environments https://review.openstack.org/605045 | 15:20 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Convert refresh fact to strings https://review.openstack.org/604958 | 15:21 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-lxc_hosts master: tasks: lxc_install_zypper: Use the 'state' option for external repos https://review.openstack.org/605102 | 15:21 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Add tags for beats setup tasks https://review.openstack.org/605044 | 15:24 |
*** strattao has quit IRC | 15:25 | |
*** hwoarang has joined #openstack-ansible | 15:26 | |
spotz | mnaser cloudnull odyssey4me - Has anyone gotten an AIO to run without ssl and a cert and can you share? I get a 503 when I use haproxy_ssl: false and openstack_external_ssl: false though I might have something else wrong. This is queens | 15:27 |
cloudnull | spotz ive not tired in quite awhile | 15:27 |
spotz | cloudnull: hwoarang and logan- had given me those settings but I have no luck with them:( | 15:28 |
spotz | I was gonna finally have a student lab on OSA!!! | 15:29 |
openstackgerrit | Merged openstack/ansible-config_template master: Compare dict vars to determine changed https://review.openstack.org/582532 | 15:30 |
*** strattao has joined #openstack-ansible | 15:32 | |
odyssey4me | spotz: that used to be all that needed to be set, but it seems it doesn't work any more :/ there's a bug somewhere I guess, which someone will have to track down | 15:32 |
spotz | odyssey4me: Yeah I never did find where the 503 was coming from or you know I'd give more info and bug it:( | 15:33 |
odyssey4me | I wonder whether setting 'openstack_external_ssl: false' will help? You'll likely have to redeploy haproxy & horizon | 15:33 |
odyssey4me | and maybe the other services too | 15:34 |
mnaser | 503 seems like some other service is down | 15:34 |
mnaser | so check haproxy state | 15:34 |
*** hamzaachi_ has quit IRC | 15:34 | |
spotz | mnaser possibility of Keystone, that's just bringing up the horizon login | 15:34 |
spotz | let me start with odyssey4me's changes | 15:35 |
*** Leo_m has joined #openstack-ansible | 15:36 | |
*** hwoarang has quit IRC | 15:36 | |
spotz | odyssey4me: that one was already false but I'll give it another shot | 15:37 |
*** dxiri has quit IRC | 15:37 | |
odyssey4me | spotz: it'd be helpful to know whether CLI commands work - just getting a token, then trying each service in turn with something that's unique the the service, eg: glance - list images | 15:37 |
*** dave-mccowan has joined #openstack-ansible | 15:38 | |
spotz | odyssey4me: Ok let me get those settings back in place and will let you know. Looking for the commands:) | 15:38 |
*** hamzaachi has joined #openstack-ansible | 15:40 | |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_tacker master: Update messaging notification configuration https://review.openstack.org/605108 | 15:40 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_designate master: Update messaging notification configuration https://review.openstack.org/605109 | 15:40 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_glance master: Update messaging notification configuration https://review.openstack.org/605110 | 15:40 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_sahara master: Update messaging notification configuration https://review.openstack.org/605111 | 15:40 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_magnum master: Update messaging notification configuration https://review.openstack.org/605112 | 15:40 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_blazar master: Update messaging notification configuration https://review.openstack.org/605113 | 15:41 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_trove master: Update messaging notification configuration https://review.openstack.org/605114 | 15:41 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Make the elasticsearch plugins optional https://review.openstack.org/604867 | 15:42 |
evrardjp | hey | 15:44 |
evrardjp | spotz: maybe an haproxy.cfg + keystone.conf could help us understand what's going on :) | 15:44 |
evrardjp | if you can share those | 15:44 |
spotz | evrardjp: I can go one better:) | 15:45 |
evrardjp | not sure what you meant there--- it works? :D | 15:47 |
*** hwoarang has joined #openstack-ansible | 15:47 | |
spotz | Nope got distracted talking to cmurphy incoming PM:) | 15:49 |
*** wlmbasson has quit IRC | 15:52 | |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_trove master: Update messaging notification configuration https://review.openstack.org/605114 | 15:53 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_blazar master: Update messaging notification configuration https://review.openstack.org/605113 | 15:55 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_magnum master: Update messaging notification configuration https://review.openstack.org/605112 | 15:56 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_sahara master: Update messaging notification configuration https://review.openstack.org/605111 | 15:58 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Add host metadata to core beats output https://review.openstack.org/605059 | 15:59 |
mnaser | cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, bgmccollum, darrenc, JRobinson__, colinmcnamara, thorst, adreznec, eil397, | 15:59 |
mnaser | qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen, ullbeking, mnaser, nicolasbock, jrosser | 15:59 |
mnaser | 60 second warning | 15:59 |
mnaser | :) | 15:59 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_designate master: Update messaging notification configuration https://review.openstack.org/605109 | 15:59 |
cjloader | mnaser: i'm not on that list lol | 16:00 |
spotz | Is it that time already?:) | 16:00 |
spotz | cjloader: It's on the wiki page add yourself:) | 16:00 |
mnaser | cjloader: you can add yourself on the wiki https://wiki.openstack.org/wiki/Meetings/openstack-ansible | 16:00 |
mnaser | ^^ | 16:00 |
spotz | :) | 16:00 |
*** hamzaachi has quit IRC | 16:00 | |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_tacker master: Update messaging notification configuration https://review.openstack.org/605108 | 16:00 |
prometheanfire | o/ | 16:01 |
evrardjp | o/ | 16:01 |
hwoarang | o/ | 16:01 |
mnaser | #startmeeting openstack_ansible_meeting | 16:01 |
openstack | Meeting started Tue Sep 25 16:01:26 2018 UTC and is due to finish in 60 minutes. The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot. | 16:01 |
openstack | Useful Commands: #action #agreed #help #info #idea #link #topic #startvote. | 16:01 |
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
mnaser | round 2 | 16:01 |
openstack | The meeting name has been set to 'openstack_ansible_meeting' | 16:01 |
mnaser | #topic rollcall | 16:01 |
*** openstack changes topic to "rollcall (Meeting topic: openstack_ansible_meeting)" | 16:01 | |
mnaser | o/ ? :) | 16:02 |
hwoarang | o/ | 16:02 |
guilhermesp | o/ | 16:02 |
odyssey4me | o/ | 16:02 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_tacker master: Remove the unnecessary vao https://review.openstack.org/605117 | 16:02 |
mnaser | ok cool lets get rolling | 16:03 |
mnaser | #topic Last week highlights | 16:03 |
*** openstack changes topic to "Last week highlights (Meeting topic: openstack_ansible_meeting)" | 16:03 | |
mnaser | i see some stale items there, i think the only relevant one is evrardjp's | 16:03 |
mnaser | evrardjp: Making Ocata "extended maintenance" (This would add ocata-em tag, not closing the branch). See also: https://governance.openstack.org/tc/resolutions/20180301-stable-branch-eol.html . No real value for us, what do we point to for upstream repos (IMO, the ocata-em upstream tags when available, else the stable branch it is attached to). | 16:03 |
openstackgerrit | weizj proposed openstack/openstack-ansible-os_tacker master: Remove the unnecessary verbose defined https://review.openstack.org/605117 | 16:03 |
mnaser | evrardjp: would you like to expand on that? | 16:03 |
evrardjp | yes | 16:04 |
evrardjp | well I guess we discussed this today with odyssey4me and it was discussed during PTG (sorry to have missed that conversation) | 16:05 |
_d34dh0r53_ | o/ | 16:05 |
evrardjp | There are discussions on the ML about moving projects to EM for ocata | 16:05 |
mnaser | it was a very brief discussion | 16:05 |
*** _d34dh0r53_ is now known as d34dh0r53 | 16:05 | |
evrardjp | I suggest we move said projects to EM as soon as possible, instead of continuing to track stable/ocata | 16:06 |
spotz | For the ops side of the house are we going to be a tag vs branch? | 16:06 |
mnaser | it looks like most maintainers/users dont seem to care | 16:06 |
evrardjp | indeed | 16:06 |
evrardjp | so the advantage of doing so is that we have a reference that's stable and meaningfull - never bumped until someone definitely wants to | 16:07 |
mnaser | so do we just tag ocata-em and call it a day? | 16:07 |
evrardjp | and it won't break anytime should EOL appear and the branch be deleted | 16:07 |
odyssey4me | For me, I'd just like to reach a stage where we update the docs to indicate the status (and provide reference to what it means) - and stop releasing it. | 16:07 |
*** pcaruana has joined #openstack-ansible | 16:07 | |
*** hamzaachi has joined #openstack-ansible | 16:08 | |
evrardjp | mnaser: oh you mean just mark OSA as EM? | 16:08 |
spotz | Yeah my concern is folks looking for the wrong location so definitely want to make sure our docs are good | 16:08 |
evrardjp | and not care about the branches? | 16:08 |
mnaser | no, tag ocata-em and run jobs against ocata-em only | 16:08 |
mnaser | it will break, eventually, inevitebly | 16:08 |
mnaser | my question is | 16:08 |
mnaser | (i should know this answer) | 16:08 |
odyssey4me | It's nice to have the branch there for those of us who'll still need to do patch updates. We have a ton of newton forks thanks to the EOL, and had to do a ton of tooling changes to switch where things pointed. | 16:09 |
evrardjp | you mean for upstream projects or OSA? | 16:09 |
mnaser | if we don't follow stable policy | 16:09 |
mnaser | it's kinda up to us to do what we want | 16:09 |
mnaser | i dont think stable policy works well or makes sense for a deployment project | 16:09 |
odyssey4me | Agreed, which is why we don't follow it. | 16:09 |
mnaser | i really hope no one is doing ocata greenfield deployments :X | 16:09 |
evrardjp | agreed mnaser | 16:09 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Change VM definition in deploy-vm mnaio playbook https://review.openstack.org/602832 | 16:09 |
evrardjp | mnaser: there are ppl doing it though, but we can't do anything for them :p | 16:09 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Use group vars to reduce redundancy in host vars https://review.openstack.org/602834 | 16:10 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Enable setting mnaio disk size by pxe server group https://review.openstack.org/602835 | 16:10 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Make root partition size configurable https://review.openstack.org/602859 | 16:10 |
evrardjp | ahahah | 16:10 |
odyssey4me | The integrated build is pinned, so we don't need to do anything there. We can leave the roles as-is and if they break, we can fix them as needed. | 16:10 |
odyssey4me | I'd suggest removing the periodic tests though. | 16:11 |
evrardjp | ok I will follow odyssey4me /mnaser 's proposition: Next release will be marked as EM instead of usual tag, and the rest stays the same. If someone wants to fix, (s)he can | 16:11 |
evrardjp | I will clean things up: removing periodic testing -- changing the version name | 16:11 |
evrardjp | marking jobs as non voting | 16:11 |
spotz | Ok and give me a heads up and I'll try to get the docs patch up at the same time | 16:11 |
*** shyamb has joined #openstack-ansible | 16:11 | |
evrardjp | we can discuss things in the review | 16:11 |
evrardjp | spotz: you can push a patch already without the date I'd say. | 16:12 |
*** Emine has quit IRC | 16:12 | |
odyssey4me | well, as for non-voting jobs - we know that no-one bothers to check them, so why not just remove them all and make patches just do doc builds and nothing more? | 16:12 |
mnaser | i am in favour of dropping nv jobs. | 16:12 |
mnaser | lets not waste resources | 16:12 |
mnaser | maybe just linters | 16:12 |
odyssey4me | Anyone using an EM project should be doing their own testing. | 16:12 |
mnaser | ++ | 16:12 |
mnaser | well actually | 16:12 |
mnaser | things should still be backported so | 16:13 |
evrardjp | that should be written in a release note then | 16:13 |
mnaser | patches should be good | 16:13 |
evrardjp | maybe we keep the testing up until we can't? | 16:13 |
evrardjp | the branch would still be up so it's fine | 16:13 |
hwoarang | well 'em' gives the impression that someone maintains it. if you drop the jobs, then things start failing so the 'maintenance' is not sure accurate anymore | 16:13 |
mnaser | drop the testing till we cant | 16:13 |
odyssey4me | yeah, the EM should definitely include a release note saying that it's EM and therefore no longer actively tested or developed | 16:13 |
mnaser | means someone has to go out and write a patch to drop the jobs | 16:13 |
mnaser | when hey break | 16:13 |
mnaser | they* | 16:13 |
*** dave-mccowan has quit IRC | 16:13 | |
odyssey4me | yeah, I'm fine with leaving them as-is and removing them piecemeal as they break | 16:14 |
mnaser | i dunno | 16:14 |
hwoarang | there is no good reason why things start failing when the openstack components are pinned | 16:14 |
odyssey4me | I've already done some :p | 16:14 |
evrardjp | hwoarang: that's kinda the idea of EM though: until we can't merge things anymore, we keep branch open, else we close the branch | 16:14 |
mnaser | hwoarang: we've seen plenty of things happen | 16:14 |
mnaser | external dependencies changing url (ms + github stuff) | 16:14 |
mnaser | mariadb changing urls | 16:14 |
mnaser | aaaaaall sort of things happen | 16:14 |
hwoarang | yeah but if the branch is open you need some jobs to get an idea of how terrible the situation is :) | 16:14 |
spotz | evrardjp: We've got docs where it mentions the location which is why if the branch goes away and we become a tag I'd rather wait | 16:15 |
evrardjp | hwoarang: :) | 16:15 |
mnaser | well see the thing is | 16:15 |
mnaser | we dont follow stable policy | 16:15 |
evrardjp | that's true | 16:15 |
mnaser | so we have zero obligation of doing this | 16:15 |
evrardjp | indeed | 16:15 |
mnaser | my question is: is there someone here willing to step up to handle this | 16:15 |
evrardjp | we can close the branch right now if you want : p | 16:15 |
mnaser | because it provides value for their organization | 16:15 |
mnaser | if someone steps up to take care of the jobs, tagging em, etc, i'm all for it | 16:16 |
mnaser | but i dont think a deployment project being in EM makes a whole lot of sense, it does for the actual openstack services | 16:16 |
evrardjp | I would prefer not work on this anymore :p | 16:16 |
hwoarang | then lets not do it :) | 16:16 |
mnaser | we could draft up a small email to ML | 16:16 |
mnaser | and ask if someone wants to step up | 16:16 |
evrardjp | I am not in agreement there -- deployers probably want their branch to live FOREVER | 16:17 |
evrardjp | but they will never get an incentive to upgrade -- which is a bad message :p | 16:17 |
mnaser | against sending an email to ML? | 16:17 |
evrardjp | killing the branch is the ultimate incentive | 16:17 |
mnaser | if someone wants it to live forever, they can pick up the work :-) | 16:17 |
evrardjp | oh no I am for it : ) | 16:17 |
evrardjp | mnaser: well that was the idea of EM :D | 16:17 |
odyssey4me | mnaser: we (rax) need it, and will handle it | 16:17 |
evrardjp | anyway | 16:17 |
mnaser | well there, no need of an ML post | 16:18 |
evrardjp | we spent much time for this, sorry for taking the time | 16:18 |
mnaser | nah, it's fine. | 16:18 |
spotz | Good covos are worth the time | 16:18 |
odyssey4me | we only need a small subset of the roles | 16:18 |
spotz | convos even... | 16:18 |
mnaser | in that case, we can go ahead with EM and given odyssey4me (or someone at rax) will be leading it then i'll leave it up to him/them to decide how they'd like to maintain it | 16:18 |
logan- | i think we could leave gating in place for now and remove nv and periodics | 16:18 |
mnaser | (as long as we all agree on it) | 16:19 |
evrardjp | at least it's discussed and we know the interest of people is there -- we'll clarify the situation outside this meeting, summarize in the ML and take actions. | 16:19 |
odyssey4me | but we would prefer to keep it upstream rather than have to manage a downstream forks, right d34dh0r53 prometheanfire cjloader ? | 16:19 |
cjloader | yes, upstream is better | 16:19 |
evrardjp | mnaser: agreed | 16:19 |
d34dh0r53 | absolutely | 16:19 |
prometheanfire | always | 16:19 |
mnaser | awesome | 16:19 |
evrardjp | understood -- so no EOL -- a path towards EM is better :) | 16:19 |
evrardjp | or no EM but keeping things okayish | 16:20 |
mnaser | so in that case, it's your call to see how best we deal with EM (and where you want to maintain jobs or not) | 16:20 |
mnaser | as long as we have some form of ownership, i'm happy to have it | 16:20 |
mnaser | (shared responsibility is still a thing, we all help each other land stuff, but the bulk of removing any jobs or what not) | 16:20 |
mnaser | cool | 16:21 |
mnaser | ont other fun stuff | 16:21 |
mnaser | any other comments about this? | 16:22 |
*** strattao has quit IRC | 16:22 | |
evrardjp | none | 16:22 |
mnaser | i guess not! | 16:22 |
mnaser | #topic bug triage | 16:23 |
*** openstack changes topic to "bug triage (Meeting topic: openstack_ansible_meeting)" | 16:23 | |
mnaser | #link https://bugs.launchpad.net/openstack-ansible/+bug/1793781 | 16:23 |
openstack | Launchpad bug 1793781 in openstack-ansible "Queens -> Rocky Upgrade breaks cinder/glance" [Undecided,New] | 16:23 |
hwoarang | based on last comment seems like a user config issue? | 16:24 |
mnaser | indeed | 16:24 |
spotz | Yeah so DNF | 16:24 |
spotz | or invalid | 16:24 |
mnaser | quorum on invalid? | 16:24 |
*** shyamb has quit IRC | 16:25 | |
hwoarang | ok | 16:25 |
mnaser | #link https://bugs.launchpad.net/openstack-ansible/+bug/1793389 | 16:25 |
openstack | Launchpad bug 1793389 in openstack-ansible "Upgrade to Ocata: Keystone Intermittent Missing 'options' Key" [Undecided,New] - Assigned to Alex Redinger (rexredinger) | 16:25 |
mnaser | hmm | 16:26 |
mnaser | looks like they pushed a fix | 16:26 |
mnaser | but nothing on master | 16:26 |
mnaser | is alex on irc? | 16:26 |
evrardjp | EM on ocata, it's time:p | 16:26 |
evrardjp | hahah | 16:26 |
mnaser | its a patch that went straight to master | 16:26 |
mnaser | err | 16:26 |
mnaser | straight to stable branches | 16:26 |
mnaser | which means it will regress | 16:26 |
*** udesale has quit IRC | 16:27 | |
hwoarang | true. we should ask for proper backports | 16:27 |
mnaser | d34dh0r53: https://review.openstack.org/#/c/604846/ mind taking off the +2 here because there is no master patch? | 16:27 |
evrardjp | it started in queens apparently: https://review.openstack.org/#/c/604804/1 | 16:27 |
mnaser | and that looks like a keystone bug too | 16:27 |
spotz | Well unless there's no issue with master and it is only a backport? | 16:27 |
d34dh0r53 | my bad, should have looked at that closer | 16:27 |
mnaser | no its an upgrade issue with keystone | 16:28 |
evrardjp | well master is different now | 16:28 |
evrardjp | but it doesn't prevent a master implementation | 16:28 |
mnaser | confirmed/medium and ask for an impl. in master? | 16:29 |
evrardjp | also it's very weird: why only the service tenant, and not the other keystone commands? | 16:29 |
mnaser | it looks like a keystone bug to me honestly | 16:29 |
mnaser | im tempted to put this down as invalid | 16:30 |
evrardjp | or a conf issue | 16:30 |
mnaser | OH | 16:30 |
mnaser | you know what this might be?! | 16:30 |
mnaser | memcache not being flushed | 16:30 |
mnaser | in the upgrade | 16:30 |
mnaser | so the dict it pulls is invalid | 16:30 |
evrardjp | mmm | 16:30 |
evrardjp | we have a restart in it | 16:30 |
mnaser | not during the keystone play | 16:31 |
evrardjp | oh wait | 16:31 |
evrardjp | https://github.com/openstack/openstack-ansible/blob/stable/ocata/scripts/run-upgrade.sh#L185 | 16:31 |
evrardjp | it is before keystone play | 16:31 |
evrardjp | mnaser: I suggest we ask if memcached was properly flushed in the bug, see how it goes? | 16:32 |
odyssey4me | but is the bug reporter using the same upgrade tooling? | 16:32 |
evrardjp | yeah my point odyssey4me | 16:32 |
evrardjp | mark it incomplete until we know how the upgrade was triggered | 16:32 |
d34dh0r53 | I just asked him to join | 16:32 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: MNAIO: Correct README regarding DATA_DISK_DEVICE https://review.openstack.org/604064 | 16:32 |
mnaser | hmm | 16:33 |
cjloader | he's on his way | 16:33 |
mnaser | we dont have much bugs | 16:33 |
*** Alex_Red1nger has joined #openstack-ansible | 16:33 | |
*** strattao has joined #openstack-ansible | 16:33 | |
d34dh0r53 | o/ Alex_Red1nger | 16:34 |
d34dh0r53 | do you need scrollback? | 16:34 |
spotz | o/ | 16:34 |
Alex_Red1nger | \\o | 16:34 |
Alex_Red1nger | Yes please | 16:34 |
mnaser | Alex_Red1nger: we were talking about https://bugs.launchpad.net/openstack-ansible/+bug/1793389 | 16:34 |
openstack | Launchpad bug 1793389 in openstack-ansible "Upgrade to Ocata: Keystone Intermittent Missing 'options' Key" [Undecided,New] - Assigned to Alex Redinger (rexredinger) | 16:34 |
evrardjp | hey Alex_Red1nger , it's fun with bugs time currently : ) | 16:34 |
d34dh0r53 | Alex_Red1nger: pasted it in slack | 16:34 |
spotz | d34dh0r53: boo slack! | 16:34 |
d34dh0r53 | yep, boo slack | 16:34 |
d34dh0r53 | but didn't want to spam this changel | 16:35 |
d34dh0r53 | chanel | 16:35 |
mnaser | cut him some.......slack | 16:35 |
d34dh0r53 | ba dum cha | 16:35 |
Alex_Red1nger | Haha | 16:35 |
cjloader | d34dh0r53: spamalot much? | 16:35 |
d34dh0r53 | that's sir spamalot to you | 16:35 |
Alex_Red1nger | Anyway, this is definitely a keystone bug. | 16:35 |
spotz | hehehe | 16:35 |
Alex_Red1nger | My patch is meant as a work-around to expidite upgrades. | 16:35 |
skiedude | Might I ask what it means when my bug ticket is moved from open to INvalid with no comment of why? | 16:36 |
* spotz notes no nano in our containers is a major bug:) | 16:36 | |
cjloader | spotz: +1 | 16:36 |
mnaser | skiedude: got a link to one? | 16:36 |
skiedude | https://bugs.launchpad.net/openstack-ansible/+bug/1793781 | 16:36 |
openstack | Launchpad bug 1793781 in openstack-ansible "Queens -> Rocky Upgrade breaks cinder/glance" [Undecided,Invalid] | 16:36 |
mnaser | Alex_Red1nger: you were using the upgrade tooling? | 16:36 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: MNAIO: Ensure consistent defaults https://review.openstack.org/604059 | 16:37 |
openstackgerrit | Merged openstack/openstack-ansible-ops master: MNAIO: Disable metering services by default https://review.openstack.org/604034 | 16:37 |
mnaser | skiedude: sorry, i should have added a comment, it looks like you mentioned that it was something with your config so we assumed that it was just something to figure out in your config. | 16:37 |
skiedude | ah ok, well I'm just assuming it is my config, I'm using the basic config options in the test production example, so nothing special | 16:37 |
Alex_Red1nger | mnaser: Yeah, I ran into the bug during execution of run-upgrade.sh | 16:38 |
odyssey4me | Alex_Red1nger: was part of the upgrade process to flush memcache, as done in every stable branch upgrade script? https://github.com/openstack/openstack-ansible/blob/stable/pike/scripts/run-upgrade.sh#L192 | 16:38 |
skiedude | guess its not technically a bug, just wasn't sure where to put for support | 16:38 |
antonym | mnaser: yeah, the error pops up when going from ocata to pike and it happens randomly, sometimes it passes successfully, other times, it just needs another run of the keystone playbook and it goes away | 16:38 |
antonym | (using the run-upgrade.sh) | 16:38 |
mnaser | im assuming the "it needs another run" really is | 16:38 |
odyssey4me | aha, ok thanks for clarifying | 16:38 |
mnaser | stuff getting cleared out of memcache | 16:38 |
odyssey4me | maybe there needs to be some sort of check until it's cleared task? | 16:38 |
antonym | yeah, it was kind of random | 16:39 |
Alex_Red1nger | cacheing does seem like a likely cuplrit, since nothing in the code seems susceptible to a race. | 16:39 |
spotz | skiedude: Best thing it so ask here with the understanding someone might not be available or the ML | 16:39 |
mnaser | yeah im 99% sure its the memcache | 16:39 |
skiedude | understood, wheres a link to the ML? | 16:39 |
spotz | skiedude: I'll PM you so as not to spam:) | 16:40 |
skiedude | thanks! | 16:40 |
odyssey4me | maybe the memcache flush needs to happen within the keystone role rather, because that flush happens while the old system is running | 16:41 |
mnaser | exactly, i'd classify that as a bug in our deployment tooling | 16:41 |
mnaser | more retries is just hoping that luck expires memcache stuff | 16:41 |
odyssey4me | could just have a flag to set, and use that flag in the upgrade script | 16:41 |
mnaser | maybe as a handler | 16:41 |
mnaser | with a delegate_to | 16:41 |
odyssey4me | yep, probably as a handler because that'll fire when the old one is shut down and the new one starts | 16:42 |
mnaser | anytime we restart keystone | 16:42 |
mnaser | we do that | 16:42 |
odyssey4me | that sounds like it'd be too much - and break rolling upgrades | 16:42 |
mnaser | i dunno how much it'd break rolling upgrades | 16:42 |
mnaser | memcache is just stateless | 16:42 |
mnaser | it'll repopulate | 16:42 |
odyssey4me | ok, but doesn't it hold all the tokens and such? | 16:43 |
mnaser | nope, with fernet tokens | 16:43 |
odyssey4me | we've only ever needed this done on a major upgrade as far as I know, so it seems prudent to me to just have a flag and use it during the major upgrade | 16:43 |
mnaser | they dont get stored anywhere actually | 16:43 |
mnaser | with fernet tokens it validates it using the credential files | 16:44 |
odyssey4me | anyway, those are details which can get sorted out in review | 16:44 |
*** spatel has quit IRC | 16:44 | |
mnaser | yeah. | 16:44 |
mnaser | im not opposed to adding more retries if you think it helps | 16:44 |
mnaser | it wont hurt | 16:44 |
mnaser | Alex_Red1nger: just need a patch for master too | 16:44 |
mnaser | if you can do that then we'll be able to push the rest | 16:44 |
odyssey4me | given the cache is for performance, it seems prudent to me not to flush the cache every time you restart keystone - but rather only when needed, otherwise we'd just be slowing the environment down | 16:45 |
mnaser | not opposed to that either, or if we know its a major upgrade, we can figure out the details | 16:45 |
mnaser | Alex_Red1nger: ill mark it as confirmed and we'll take a patch for master before we can land the backported ones | 16:45 |
openstackgerrit | Arx Cruz proposed openstack/openstack-ansible-os_tempest master: WIP - Enable stackviz support https://review.openstack.org/603100 | 16:46 |
mnaser | skiedude: mailing list or irc (outside meeting hours) will be the best place to gather help :) | 16:46 |
mnaser | aka in less than 15 minutes | 16:46 |
mnaser | #link https://bugs.launchpad.net/openstack-ansible/+bug/1791085 | 16:46 |
openstack | Launchpad bug 1791085 in openstack-ansible "OVN Metadata Service Broken" [Undecided,New] - Assigned to James Denton (james-denton) | 16:46 |
Alex_Red1nger | mnaser: OK, I'll move things over. | 16:46 |
*** mmercer has joined #openstack-ansible | 16:46 | |
mnaser | jamesdenton: do we need anytihng about that or just there to track progress? | 16:46 |
jamesdenton | eventually, yes. | 16:47 |
jamesdenton | it's #22 of #100 | 16:47 |
spotz | heehe | 16:47 |
mnaser | so do we mark as wishlist? how do we track wip items usualy? | 16:47 |
jamesdenton | good question. certainly not urgent | 16:48 |
mnaser | i guess confirmed | 16:48 |
odyssey4me | confirm/in-progress I guess - priority probably low/medium | 16:48 |
mnaser | because its confirmed broken. | 16:48 |
mnaser | confirmed/low it is | 16:48 |
mnaser | #link https://bugs.launchpad.net/openstack-ansible/+bug/1782388 | 16:48 |
openstack | Launchpad bug 1782388 in openstack-ansible "Installing Multipath But Not Enabling In Nova Causes Volume Attachment Failures" [Undecided,New] | 16:48 |
jamesdenton | thanks | 16:48 |
mnaser | our trail | 16:48 |
mnaser | i dont see byron around | 16:49 |
mnaser | i guess i can leavei t as is | 16:50 |
mnaser | #topic open discussion | 16:50 |
*** openstack changes topic to "open discussion (Meeting topic: openstack_ansible_meeting)" | 16:50 | |
mnaser | 10 fun minutes if anyone has anything fun | 16:50 |
cjloader | Can I possibly get some eyes on https://review.openstack.org/#/c/556586/? | 16:51 |
cjloader | The designate spec | 16:51 |
odyssey4me | mnaser evrardjp did we want to chat about rocky releasing? | 16:51 |
evrardjp | we can | 16:51 |
mnaser | oh sure | 16:51 |
mnaser | i'll look at that spec soon cjloader | 16:51 |
mnaser | lets see the state of rocky | 16:52 |
mnaser | https://review.openstack.org/#/q/project:%255Eopenstack/openstack-ansible.*+is:open+branch:stable/rocky | 16:52 |
mnaser | we have some open things | 16:52 |
odyssey4me | We chatted a bit earlier. I suggested that we do the final RC tag tomorrow (Wednesday) and ask for the release based on it. JP's on holiday friday. | 16:52 |
evrardjp | mnaser: when I proposed rocky was successfully building in periodics. | 16:52 |
mnaser | im just trying to see if there is something really important to merge | 16:52 |
evrardjp | mnaser: makes sense | 16:53 |
mnaser | but for the most part | 16:53 |
mnaser | they all seem mostly like cleanups | 16:53 |
odyssey4me | All the galera_client deps are gone from rocky, so I'm happy to go ahead | 16:53 |
mnaser | nothing too fundamental and important | 16:53 |
spotz | After the meeting I need to know if we have anache conf overrides:) | 16:53 |
odyssey4me | there are always bugs, and we release often, so I think it's time we released it into the wild | 16:53 |
spotz | apache even | 16:53 |
mnaser | i agree, it's in a good state, nothing pressing | 16:53 |
evrardjp | odyssey4me: I agree there | 16:53 |
evrardjp | just for confirmation | 16:54 |
odyssey4me | So we can check periodics in the morning, and if it's good - we go for it | 16:54 |
evrardjp | another final rc, right? not reusing what's up | 16:54 |
spotz | +1 | 16:54 |
mnaser | ++ i agree | 16:54 |
evrardjp | ok sounds good | 16:54 |
mnaser | yes, whats up is pretty far behind | 16:54 |
mnaser | doesnt have all the galera_client stuff | 16:54 |
mnaser | i think the galera_client stuff has helped drive deploy times so much and made it more stable | 16:54 |
mnaser | very happy about that one | 16:54 |
spotz | mnaser: But it's working well in SJC so far? | 16:54 |
mnaser | wonderfully so | 16:55 |
evrardjp | ok | 16:55 |
spotz | Sweet:) | 16:55 |
mnaser | all my rocky-deploy patches were merged too | 16:55 |
*** mmercer has quit IRC | 16:55 | |
mnaser | any other subjects? :) | 16:55 |
d34dh0r53 | pike | 16:55 |
mnaser | pike release? | 16:55 |
d34dh0r53 | need to get https://review.openstack.org/#/c/604623/ going so that we can get pike updated | 16:55 |
openstackgerrit | Alex Redinger proposed openstack/openstack-ansible-os_keystone master: Increase retries to mitigate intermittent failure https://review.openstack.org/605146 | 16:56 |
mnaser | i think release is on halt right now | 16:56 |
mnaser | because of some issues with ssl? | 16:56 |
mnaser | doug posted something about it a few days ago on ML | 16:56 |
d34dh0r53 | ohh, must have missed that, I'll go look | 16:56 |
mnaser | or maybe not, im not sure | 16:56 |
mnaser | https://review.openstack.org/#/q/project:openstack/releases | 16:57 |
mnaser | i see things merging | 16:57 |
mnaser | d34dh0r53: you can ask in #openstack-release | 16:57 |
*** hamzaachi has quit IRC | 16:57 | |
spotz | I thought the comment there was specific with us and I was gonna blame mhayden | 16:57 |
d34dh0r53 | mnaser: yeah | 16:57 |
odyssey4me | I asked earlier - no response yet | 16:57 |
evrardjp | I think it's fixed now | 16:58 |
evrardjp | the releases issue I mean | 16:58 |
evrardjp | sorry I haven't got the chance to continue on that -- a lot of fire still | 16:58 |
spotz | I can poke Sean | 16:58 |
mnaser | cool | 16:58 |
openstackgerrit | Alex Redinger proposed openstack/openstack-ansible-os_keystone stable/rocky: Increase retries to mitigate intermittent failure https://review.openstack.org/605148 | 16:58 |
mnaser | thats all folks? | 16:59 |
odyssey4me | that's all from me | 17:00 |
d34dh0r53 | yep, I'm good | 17:00 |
mnaser | thanks everyone | 17:00 |
mnaser | #endmeeting | 17:00 |
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC" | 17:00 | |
openstack | Meeting ended Tue Sep 25 17:00:31 2018 UTC. Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4) | 17:00 |
openstack | Minutes: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-09-25-16.01.html | 17:00 |
hwoarang | thank you mnaser | 17:00 |
openstack | Minutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-09-25-16.01.txt | 17:00 |
openstack | Log: http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2018/openstack_ansible_meeting.2018-09-25-16.01.log.html | 17:00 |
mnaser | thanks you! | 17:01 |
*** hwoarang has quit IRC | 17:05 | |
antonym | could i get one more pair of eyes on this: https://review.openstack.org/#/c/597977/ | 17:05 |
spotz | Ok do we have anywhere to overright the rewrite rule in the apache conf?:) | 17:06 |
openstackgerrit | Merged openstack/openstack-ansible master: Remove broken uptime tests during upgrade https://review.openstack.org/601065 | 17:06 |
spotz | This time I didn't get the 503, I suspect as I re-ran the hosrizon role along with haproxy | 17:06 |
*** Alex_Red1nger has quit IRC | 17:07 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Remove broken uptime tests during upgrade https://review.openstack.org/605151 | 17:07 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Remove broken uptime tests during upgrade https://review.openstack.org/605152 | 17:11 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Remove broken uptime tests during upgrade https://review.openstack.org/605153 | 17:12 |
*** priteau has quit IRC | 17:13 | |
odyssey4me | hooray! ansible 2.5.10 will contain the switch to pymysql as a preferred driver for mysql: https://github.com/ansible/ansible/pull/45982 | 17:15 |
*** hwoarang has joined #openstack-ansible | 17:19 | |
mnaser | odyssey4me: w00t, so no galera_client in galera container? | 17:20 |
mnaser | also does anyone which role sets the hostname for containers? | 17:20 |
odyssey4me | mnaser: it'll still be needed, but we can switch the package used by ansible and rest assured it'll work when we switch tp py3 | 17:21 |
odyssey4me | lxc_container_create sets the hostname, etc IIRC | 17:21 |
openstackgerrit | Andy Smith proposed openstack/openstack-ansible master: Add qdrouterd role for oslo.messaging backend deployment https://review.openstack.org/570261 | 17:24 |
mnaser | odyssey4me: i mean we'll be able to drop it from galera_server container but utility might be the only last user? | 17:26 |
mnaser | yeah im trying to find where in lxc_container_create | 17:26 |
mnaser | ah its a handler | 17:26 |
odyssey4me | mnaser: it still lays down the client config, which is fine - meh - the objective is not to drop the client role, but rather to ensure that we can move to py3 when we want to, and don't need to keep using that old lib | 17:27 |
mnaser | odyssey4me: thing is on centos there are a bunch of inconsistent tasks right now with galera_client | 17:27 |
mnaser | that are not idempotent | 17:28 |
odyssey4me | oh really? we should fix that | 17:28 |
mnaser | yeah, i never got around it | 17:29 |
mnaser | https://github.com/openstack/openstack-ansible-galera_client/blob/master/tasks/galera_client_install_yum.yml#L113-L121 | 17:29 |
mnaser | thats one | 17:29 |
*** dariko has joined #openstack-ansible | 17:33 | |
*** shardy has quit IRC | 17:34 | |
*** dxiri has joined #openstack-ansible | 17:38 | |
spotz | hwoarang odyssey4me - FYI Ok the apache config for horizon needs to be overridden I just edited it, and also the cookies have to be turned off in the horizon config | 17:42 |
spotz | We should probably put in overrides and such | 17:42 |
spotz | or track down if we had them and why they don't work | 17:43 |
mgariepy | fun. 3 host freeze when doing upgrade.. | 17:44 |
spotz | mgariepy: out of how many?:) | 17:46 |
odyssey4me | spotz: if you can register a bug for it with the details of your hacks to fix it, then we can figure out a good patch | 17:46 |
odyssey4me | thanks for persisting | 17:46 |
spotz | odyssey4me: I'll get that going, and if you or someone with patience wants to help I'll attempt to patch:) | 17:47 |
spotz | Been so long since I've done an ansible code patch:( | 17:47 |
mgariepy | 1 ctrl and 2 computes | 17:47 |
mgariepy | of about 40ish computes/. | 17:48 |
mgariepy | just when upgrading rabbitmq cluster .. | 17:48 |
odyssey4me | mgariepy: just throw the computer out the window and go home :p | 17:55 |
*** vnogin has joined #openstack-ansible | 17:55 | |
spotz | You know,,, 2 out of 40 aren't bad:) | 18:00 |
spotz | See look on the bright side! | 18:00 |
mgariepy | lol | 18:04 |
mnaser | not that it's relevant for much longer | 18:04 |
mnaser | anyone seen this http://paste.openstack.org/show/730739/ | 18:04 |
mnaser | when stopping a container? | 18:04 |
mgariepy | mnaser, i haven't | 18:06 |
*** vollman has quit IRC | 18:08 | |
*** vnogin has quit IRC | 18:11 | |
*** macza has joined #openstack-ansible | 18:11 | |
spotz | mnaser: I haven't stopped any, I've restarted services and re-run playbooks for my course | 18:23 |
mgariepy | mnaser, which version of lxc ? | 18:31 |
*** DanyC has quit IRC | 18:44 | |
*** DanyC has joined #openstack-ansible | 18:50 | |
*** dxiri has quit IRC | 18:56 | |
*** mmercer has joined #openstack-ansible | 19:06 | |
odyssey4me | ok folks, I'm out for the night - cheerio! | 19:15 |
*** vollman has joined #openstack-ansible | 19:16 | |
*** spatel has joined #openstack-ansible | 19:17 | |
spatel | any idea why wsgi eating all of my memory on infra node and now my swap usage went up | 19:17 |
spotz | night odyssey4me | 19:18 |
*** Leo_m has quit IRC | 19:18 | |
*** Leo_m has joined #openstack-ansible | 19:19 | |
*** DanyC has quit IRC | 19:29 | |
*** electrofelix has quit IRC | 19:32 | |
spatel | admin0: ^^ | 19:32 |
spatel | you there bro? | 19:32 |
spatel | I was waiting for HugePage stuff | 19:33 |
*** DanyC has joined #openstack-ansible | 19:34 | |
*** strattao has quit IRC | 19:38 | |
*** hamzaachi has joined #openstack-ansible | 19:42 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Add additional tests and update setupKibanaDashboard https://review.openstack.org/605194 | 19:42 |
*** dxiri has joined #openstack-ansible | 19:44 | |
*** DanyC has quit IRC | 19:49 | |
*** dariko has quit IRC | 20:00 | |
macza | is there any way to deploy an openstack service not in a venv? | 20:04 |
macza | (with openstack ansible) | 20:07 |
cloudnull | macza you can install using the distro packages within rocky | 20:14 |
macza | ahh dang just in rocky? | 20:19 |
cloudnull | it was new in rocky. | 20:20 |
cloudnull | osa has been a source based install tool since its inception | 20:21 |
macza | gotcha. the issue i'm having is i have a package that doesn't install with pip, looks like apt install is the way to go. any other workarounds? (running ocata) | 20:22 |
cloudnull | however its been extended to do distro things now | 20:22 |
cloudnull | is it like a cinder driver? | 20:23 |
cloudnull | something that extends an openstack stervice ? | 20:23 |
cloudnull | **service | 20:23 |
cloudnull | i've seen folks install things like that using the apt package and then link it into the venv | 20:26 |
*** pcaruana has quit IRC | 20:43 | |
*** DanyC has joined #openstack-ansible | 20:43 | |
macza | yeah its for an ironic driver | 20:45 |
macza | righto, yeah thats all i've seen so i'll give it a shot. Thanks! | 20:48 |
cloudnull | if you need anything on that front, ping out most of us have bouncers and would be happy to help - when we see the message :) | 21:01 |
macza | great thanks :D | 21:05 |
*** skiedude has quit IRC | 21:26 | |
macza | noice it worked, just dpkg -x the .deb and move the files in the python dir over to the venv python dir. that was easier than i expected | 21:32 |
logan- | macza: yeah, for a little more resilient option you can symlink the module into the venv like https://github.com/openstack/openstack-ansible-os_nova/blob/1c222d60b35189db90506554a80f24d881451c37/tasks/drivers/kvm/nova_compute_kvm_install_source.yml#L37-L56 | 21:35 |
*** spatel has quit IRC | 21:36 | |
macza | ohhh nice nice thanks | 21:42 |
*** hamzaachi has quit IRC | 21:44 | |
*** hamzaachi has joined #openstack-ansible | 21:44 | |
*** hamzaachi has quit IRC | 21:55 | |
*** hamzaachi has joined #openstack-ansible | 21:56 | |
*** hamzaachi has quit IRC | 21:56 | |
*** hamzaachi has joined #openstack-ansible | 21:56 | |
*** DanyC has quit IRC | 21:58 | |
*** hamzaachi has quit IRC | 22:00 | |
*** ram5391__ has joined #openstack-ansible | 22:08 | |
ram5391__ | not new to openstack, but first time openstack-ansible newb here. I am trying to run the setup-hosts playbook, and I'm getting a weird error: File "/opt/openstack-ansible/osa_toolkit/generate.py", line 896, in _check_same_ip_to_multiple_host ip = _value['ip'] KeyError: 'ip' | 22:23 |
ram5391__ | any ideas? | 22:23 |
*** dxiri has quit IRC | 22:28 | |
openstackgerrit | Merged openstack/openstack-ansible-os_neutron master: zuul: Switch Xenial jobs to Bionic https://review.openstack.org/604297 | 22:29 |
*** Leo_m has quit IRC | 22:43 | |
*** jralbert has joined #openstack-ansible | 22:45 | |
*** jralbert has quit IRC | 22:54 | |
*** vnogin has joined #openstack-ansible | 23:04 | |
*** spatel has joined #openstack-ansible | 23:07 | |
*** vnogin has quit IRC | 23:10 | |
*** tosky has quit IRC | 23:11 | |
*** spatel has quit IRC | 23:12 | |
*** vollman has quit IRC | 23:13 | |
*** macza has quit IRC | 23:17 | |
*** macza has joined #openstack-ansible | 23:17 | |
*** ram5391__ has quit IRC | 23:18 | |
*** dave-mccowan has joined #openstack-ansible | 23:20 | |
*** macza has quit IRC | 23:22 | |
*** vnogin has joined #openstack-ansible | 23:25 | |
*** vnogin has quit IRC | 23:30 | |
*** vnogin has joined #openstack-ansible | 23:45 | |
*** vnogin has quit IRC | 23:50 | |
*** jralbert has joined #openstack-ansible | 23:52 | |
jralbert | I've installed an OpenStack deployment with OSA, and it's generated a set of public endpoints by IP (https://100.200.200.300:5000, say); but the SSL certificate I've got to secure the domain name those IPs are mapped to doesn't match, since it's specifying a domain name rather than an IP. This results in SSL errors when folks try to use the API interfaces. How do OSA deployers normally handle this? | 23:58 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!