| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Update repo_server role to remove pypi reverse proxy https://review.openstack.org/585735 | 00:05 |
|---|---|---|
| *** vnogin has quit IRC | 00:05 | |
| *** hamzy has joined #openstack-ansible | 00:09 | |
| *** cshen has joined #openstack-ansible | 00:19 | |
| *** cshen has quit IRC | 00:24 | |
| *** gyee has quit IRC | 00:36 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-nspawn_hosts master: Add route when required on the local table https://review.openstack.org/588406 | 02:19 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-ops master: Update index retention policy to ensure its an int https://review.openstack.org/588389 | 02:21 |
| *** dave-mccowan has quit IRC | 02:35 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_cinder master: Resolve cinder config deprecation warnings https://review.openstack.org/588127 | 02:58 |
| *** dxiri has joined #openstack-ansible | 03:08 | |
| openstackgerrit | Merged openstack/openstack-ansible stable/queens: Update repo_server role to remove pypi reverse proxy https://review.openstack.org/585735 | 03:09 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update nspawn container create https://review.openstack.org/588430 | 03:23 |
| *** udesale has joined #openstack-ansible | 03:31 | |
| *** dxiri has quit IRC | 03:41 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Update index retention policy to ensure its an int https://review.openstack.org/588389 | 03:48 |
| *** hwoarang has quit IRC | 03:52 | |
| *** poopcat has quit IRC | 04:07 | |
| *** dxiri has joined #openstack-ansible | 04:21 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible master: Update nspawn container create https://review.openstack.org/588430 | 04:25 |
| *** cshen has joined #openstack-ansible | 04:29 | |
| *** cshen has quit IRC | 04:34 | |
| *** cshen has joined #openstack-ansible | 04:35 | |
| *** udesale has quit IRC | 04:35 | |
| *** viks_ has joined #openstack-ansible | 04:37 | |
| *** cshen has quit IRC | 04:40 | |
| *** viks_ has quit IRC | 04:42 | |
| *** udesale has joined #openstack-ansible | 04:55 | |
| *** cshen has joined #openstack-ansible | 04:55 | |
| *** cshen has quit IRC | 05:00 | |
| *** czunker has joined #openstack-ansible | 05:11 | |
| *** pmannidi has joined #openstack-ansible | 05:13 | |
| *** dxiri has quit IRC | 05:14 | |
| *** shyambiradar has joined #openstack-ansible | 05:17 | |
| *** pradiprwt has quit IRC | 05:17 | |
| *** cshen has joined #openstack-ansible | 05:30 | |
| *** cshen has quit IRC | 05:34 | |
| *** shyambiradar has quit IRC | 05:41 | |
| *** shyambiradar has joined #openstack-ansible | 05:50 | |
| openstackgerrit | wangqi proposed openstack/openstack-ansible-lxc_hosts master: Add the project source code repository in README https://review.openstack.org/587030 | 06:28 |
| *** chason has joined #openstack-ansible | 06:43 | |
| evrardjp | good morning | 06:52 |
| *** shyambiradar has quit IRC | 06:54 | |
| *** shyambiradar has joined #openstack-ansible | 06:58 | |
| *** cshen has joined #openstack-ansible | 06:58 | |
| *** gillesMo has joined #openstack-ansible | 06:58 | |
| *** chason has quit IRC | 07:01 | |
| evrardjp | odyssey4me: I would prefer smoke testing if we can -- or using ansible modules | 07:01 |
| *** chason has joined #openstack-ansible | 07:02 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_monasca-agent master: Add Ubuntu Bionic 18.04 support https://review.openstack.org/586933 | 07:02 |
| kaiokmo | mnaser: bionic passing on https://review.openstack.org/#/c/586933/ | 07:03 |
| kaiokmo | morning evrardjp | 07:04 |
| *** chason has quit IRC | 07:08 | |
| *** pmannidi has quit IRC | 07:16 | |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Add support for CentOS 7 https://review.openstack.org/588456 | 07:24 |
| *** tosky has joined #openstack-ansible | 07:26 | |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Add support for openSUSE https://review.openstack.org/588462 | 07:37 |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Add support for CentOS 7 https://review.openstack.org/588456 | 07:40 |
| *** chason has joined #openstack-ansible | 07:43 | |
| *** shyambiradar has quit IRC | 07:44 | |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Add support for openSUSE https://review.openstack.org/588462 | 07:45 |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Switch to using project-templates https://review.openstack.org/588464 | 07:49 |
| evrardjp | hello kaiokmo :) | 07:52 |
| *** Bhujay has joined #openstack-ansible | 07:56 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] use original cache prep script on bionic https://review.openstack.org/588466 | 08:03 |
| *** Bhujay has quit IRC | 08:05 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_glance master: Add bionic to galaxy_info metadata https://review.openstack.org/588264 | 08:06 |
| *** cshen has quit IRC | 08:26 | |
| odyssey4me | evrardjp: sure, but smoke testing isn't working either - and we have a ton of patches waiting to merge, some of which fix things (like logging, rabbitmq, etc) | 08:37 |
| odyssey4me | if you look carefully at the experimental check on that smoke testing patch, it failed tempest | 08:37 |
| odyssey4me | ultimately, all I'm proposing is a temporary stop-gap to allow patches to continue moving while we figure out a better option | 08:37 |
| *** shyambiradar has joined #openstack-ansible | 08:38 | |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Add support for CentOS 7 https://review.openstack.org/588456 | 08:38 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] use original cache prep script on bionic https://review.openstack.org/588466 | 08:38 |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Add support for openSUSE https://review.openstack.org/588462 | 08:41 |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Add support for CentOS 7 https://review.openstack.org/588456 | 08:42 |
| *** electrofelix has joined #openstack-ansible | 08:49 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] Update to bionic 18.04.1 base image https://review.openstack.org/588466 | 08:57 |
| *** DanyC has quit IRC | 09:04 | |
| odyssey4me | jrosser evrardjp could I get another review for https://review.openstack.org/588362 please - I'd like to get that ported back ASAP | 09:04 |
| *** DanyC has joined #openstack-ansible | 09:04 | |
| jrosser | odyssey4me: done | 09:07 |
| odyssey4me | tyvm | 09:07 |
| *** DanyC has quit IRC | 09:09 | |
| *** chason has quit IRC | 09:10 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: Update to bionic 18.04.1 base image https://review.openstack.org/588466 | 09:19 |
| jrosser | odyssey4me: based on a sample of 1 that might fix the lxc cache prep - can you keep an eye on it? ^ | 09:19 |
| * jrosser away | 09:19 | |
| odyssey4me | jrosser: yep, will do | 09:26 |
| *** chason has joined #openstack-ansible | 09:28 | |
| evrardjp | odyssey4me: I am fine with the blacklist, I didn't know it was that easy to bring in. | 09:32 |
| evrardjp | I'd have put the cinder volume backup in it | 09:32 |
| evrardjp | jrosser: what's in the .1 image? | 09:33 |
| evrardjp | just curious : ) | 09:33 |
| evrardjp | odyssey4me: fine for me for the backport btw | 09:33 |
| evrardjp | odyssey4me: should I continue my healthcheck work? | 09:34 |
| evrardjp | I have the impression that those healthchecks could then be moved into the respective roles :) | 09:35 |
| *** shyambiradar has quit IRC | 09:35 | |
| evrardjp | or plays | 09:35 |
| *** vnogin has joined #openstack-ansible | 09:35 | |
| odyssey4me | evrardjp: the health check has operator value, so even if it's not used for gating, it's useful - we could also use it for gating with or without tempest - so yes, continue it! | 09:36 |
| evrardjp | ok | 09:36 |
| evrardjp | Well | 09:36 |
| evrardjp | funny story | 09:36 |
| *** shyambiradar has joined #openstack-ansible | 09:36 | |
| evrardjp | it failed today with timeout -- so I think it's not only tempest. It's a real thing we have. | 09:36 |
| odyssey4me | but yes, I am a fan of the idea of putting some sort of health check into the roles | 09:36 |
| odyssey4me | well yes, so there are two issues - one is the tempest test failing, perhaps due to load or some other issue | 09:37 |
| odyssey4me | another is that cinder is failing, and while we haven't pinpointed why, we do know that the removal of all the rabbitmq things fixes it | 09:37 |
| evrardjp | odyssey4me: so you mean rollback to old rabbitmq things ? | 09:38 |
| odyssey4me | so I'm thinking we kill the failing tempest test, get the log and rabbitmq patches merged, then we have a working set again | 09:38 |
| evrardjp | that's worth pursuing | 09:38 |
| evrardjp | probably a wrong var | 09:38 |
| odyssey4me | evrardjp: nope, this patch fixes things - https://review.openstack.org/585504 | 09:38 |
| evrardjp | what do you mean by get the log and rabbitmq patches merged? | 09:38 |
| odyssey4me | right now there's something in the rabbit bits broken - so we need to get https://review.openstack.org/585504 merged to fix it | 09:38 |
| odyssey4me | also, the log gathering is broken - so we need to get https://review.openstack.org/587708 merged to fix that | 09:39 |
| evrardjp | I've seen for the log gathering | 09:39 |
| evrardjp | do you want me to test the rabbitmq patch below mine to see it works better? | 09:39 |
| odyssey4me | 'below mine' ? | 09:40 |
| odyssey4me | I've verified that it works on a test node, as has jrosser. | 09:40 |
| evrardjp | odyssey4me: below my healthchecks | 09:41 |
| odyssey4me | So, the quickest way for us to get the integrated repo moving again is to get https://review.openstack.org/588360 merged. | 09:41 |
| evrardjp | to see how the healthchecks cinder patches behaves | 09:41 |
| evrardjp | ok | 09:41 |
| evrardjp | I voted positively | 09:41 |
| evrardjp | then we move the content of this patch into blacklist things | 09:42 |
| evrardjp | (with the blacklist patch in) | 09:42 |
| evrardjp | we backport the whole thing | 09:42 |
| evrardjp | well | 09:42 |
| evrardjp | it's not mandatory, but I think it would be a good idea | 09:42 |
| odyssey4me | I'm not sure I understand the point of moving the tests we've remarked out into the blacklist. If they're not in the whitelist then that works just fine. | 09:43 |
| evrardjp | yeah that's true | 09:43 |
| odyssey4me | Why do you want to backport those changes - queens and back seems fine to me? | 09:43 |
| evrardjp | we never needed one | 09:43 |
| evrardjp | I think blacklist is just a nice feature | 09:43 |
| evrardjp | the example is what was done for cinder volumes | 09:44 |
| evrardjp | we should just follow devstack | 09:44 |
| odyssey4me | yeah, it does make it easier to remove tests if you need to | 09:44 |
| evrardjp | so that would be a blacklist | 09:44 |
| odyssey4me | well, I find myself thinking that we should perhaps just use devstack's tempest instead | 09:44 |
| evrardjp | it is just out of luck that the blacklist removed ALL the tests from that scenario | 09:44 |
| evrardjp | odyssey4me: it's gonna move to ansible anyway | 09:45 |
| evrardjp | : ) | 09:45 |
| odyssey4me | or make our role good for setting tempest up and all that, but not for running it - running it should not actually be done via ansible because the output is unreadable | 09:45 |
| evrardjp | odyssey4me: so.. in my healthchecks I consider two things | 09:45 |
| evrardjp | whether install of tempest has been done (then skip the resource creation) | 09:45 |
| odyssey4me | but I also like using the 'smoke' tests - it's really simple to maintain | 09:46 |
| evrardjp | or not | 09:46 |
| *** shyambiradar has quit IRC | 09:46 | |
| evrardjp | yeah I don't know the contents | 09:46 |
| evrardjp | it's probably better than using os modules | 09:46 |
| evrardjp | ansible os modules* | 09:46 |
| evrardjp | but I thought: hey | 09:46 |
| evrardjp | why not having ansible os modules in gates | 09:46 |
| evrardjp | and smoke in periodics | 09:46 |
| odyssey4me | every project designates its own 'smoke' tests with a label, so basically they're saying this is a minimal canary test to verify the service | 09:47 |
| odyssey4me | so we could literally just use 'smoke' everywhere | 09:47 |
| *** vnogin has quit IRC | 09:47 | |
| evrardjp | ok | 09:47 |
| evrardjp | I think it's silly to continue with current tests anyway | 09:47 |
| kaiokmo | evrardjp: about the 18.04.1 image: https://bugs.launchpad.net/ubuntu/+source/apt/+bug/1773992 | 09:48 |
| openstack | Launchpad bug 1773992 in apt (Ubuntu) "apt-key adv should gpgconf --kill all the things after execution" [Medium,Fix released] - Assigned to Julian Andres Klode (juliank) | 09:48 |
| evrardjp | kaiokmo: thanks for the info | 09:48 |
| kaiokmo | np | 09:48 |
| odyssey4me | evrardjp: yeah, that's certainly a topic for the PTG | 09:48 |
| evrardjp | odyssey4me: let's start the etherpad for the PTG conversations | 09:51 |
| evrardjp | https://etherpad.openstack.org/p/osa-denver-PTG-planning | 09:51 |
| evrardjp | woops | 09:51 |
| evrardjp | wrong one | 09:51 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Allow tags to be used for MQ tasks https://review.openstack.org/588196 | 09:54 |
| odyssey4me | evrardjp: ^ what do you think about that adjustment after your feedback? | 09:55 |
| evrardjp | odyssey4me: let me review that quick -- I will give you an etherpad later, sorry for the wrong link | 09:56 |
| evrardjp | odyssey4me: looks far more readable now | 09:57 |
| evrardjp | lgtm | 09:58 |
| odyssey4me | ok, we see if it passes tests - if it does, then I'll remove -w and we can get a move on with those patches | 09:58 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Allow tags to be used for MQ tasks https://review.openstack.org/588196 | 09:59 |
| odyssey4me | sorry - one minor adjustment to prevent a patch storm later | 09:59 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Allow tags to be used for MQ tasks https://review.openstack.org/588190 | 10:00 |
| odyssey4me | jrosser evrardjp if you guys have some time, I'd appreciate reviews for https://goo.gl/k9cCfF | 10:01 |
| *** chason has quit IRC | 10:06 | |
| *** chason has joined #openstack-ansible | 10:07 | |
| *** cshen has joined #openstack-ansible | 10:08 | |
| *** chason has quit IRC | 10:12 | |
| odyssey4me | evrardjp: shall we vote this through? https://review.openstack.org/588466 | 10:12 |
| jrosser | odyssey4me: perhaps the release note should be referenced in the commit? | 10:15 |
| jrosser | https://wiki.ubuntu.com/BionicBeaver/ReleaseNotes/ChangeSummary/18.04.1 | 10:16 |
| jrosser | evrardjp: there are the changes in 18.04.1 ^ | 10:16 |
| evrardjp | cores and anyone else: if you want to fill this PTG etherpad that would be great: https://etherpad.openstack.org/p/osa-stein-ptg | 10:16 |
| odyssey4me | Not essential for me, but it is usually good to include 'why' in the commit message. | 10:17 |
| kaiokmo | evrardjp: link the etherpad here for future reference https://wiki.openstack.org/wiki/PTG/Stein/Etherpads :) | 10:19 |
| evrardjp | I was updating all the refs to it, slowly :0 | 10:20 |
| evrardjp | :) | 10:20 |
| evrardjp | thanks for the link | 10:20 |
| evrardjp | it won't make me search in my emails hahah | 10:20 |
| *** vnogin has joined #openstack-ansible | 10:20 | |
| evrardjp | odyssey4me: the WHY is the only reason we have commit messages, IMO | 10:21 |
| evrardjp | :p | 10:21 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: [TEST] bionic https://review.openstack.org/586635 | 10:21 |
| odyssey4me | jrosser: so yeah, if there's a specific reason why you've opted for .1 for the image, usually better to call iit out | 10:22 |
| jrosser | odyssey4me: lets see if that 18.04.1 image makes any difference https://review.openstack.org/#/c/586635/4 (if i've wired it right) | 10:22 |
| odyssey4me | if it's a specific bug fix, note that - otherwise you can just justify it by saying the old one doesn't work and this one does :p | 10:22 |
| odyssey4me | depends-on is supposed to be done without the /#/c/ ... so it should be https://review.openstack.org/588466 | 10:23 |
| odyssey4me | it does work with the rest, but infra has asked that we try not to do it with the extra things | 10:23 |
| odyssey4me | can't remember why | 10:24 |
| jrosser | ah right - i'll try to remember that | 10:24 |
| jrosser | just got into the habit of pasting url from browser | 10:24 |
| kaiokmo | same | 10:24 |
| *** DanyC has joined #openstack-ansible | 10:24 | |
| *** DanyC has quit IRC | 10:29 | |
| *** DanyC has joined #openstack-ansible | 10:32 | |
| odyssey4me | jrosser: FYI if you're the second core reviewer on a patch you can add +w too once you've approved a patch | 10:32 |
| jrosser | ok - i was a little unsure of the etiquette there | 10:33 |
| jrosser | if that did/didnt require a 3rd name | 10:33 |
| *** bradm_ has quit IRC | 10:33 | |
| odyssey4me | nah if there're two +2's then +w is appropriate | 10:33 |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Add tempest test blacklist capability https://review.openstack.org/588362 | 10:34 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/queens: Add tempest test blacklist capability https://review.openstack.org/588505 | 10:34 |
| *** cshen has quit IRC | 10:36 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest stable/pike: Add tempest test blacklist capability https://review.openstack.org/588508 | 10:37 |
| *** bradm has joined #openstack-ansible | 10:37 | |
| jrosser | odyssey4me: does fixing typos in commit messages force stuff to be reckecked or is it smart? | 10:38 |
| odyssey4me | changing the commit message will cause a recheck | 10:39 |
| jrosser | well this is very odd - the lxc cache prep works here https://review.openstack.org/#/c/588466/ but i just watched the console here and it fails https://review.openstack.org/#/c/586635/ | 10:44 |
| odyssey4me | is it actually pulling that dependent patch in? | 10:46 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Do no use tempest https://review.openstack.org/587544 | 10:49 |
| *** cshen has joined #openstack-ansible | 10:50 | |
| *** shyambiradar has joined #openstack-ansible | 10:55 | |
| *** madorn has quit IRC | 10:57 | |
| *** madorn has joined #openstack-ansible | 10:58 | |
| *** vnogin has quit IRC | 10:59 | |
| *** vnogin has joined #openstack-ansible | 11:05 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Do no use tempest https://review.openstack.org/587544 | 11:07 |
| *** czunker has quit IRC | 11:07 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_tempest master: Disable tempest.scenario.test_minimum_basic temporarily https://review.openstack.org/588360 | 11:07 |
| evrardjp | jrosser: so much green: https://review.openstack.org/#/c/588466/4 | 11:10 |
| evrardjp | hahah | 11:10 |
| evrardjp | jrosser: might want to move lxc_hosts bionic to voting? | 11:10 |
| *** savvas has joined #openstack-ansible | 11:11 | |
| *** DanyC has quit IRC | 11:12 | |
| *** DanyC has joined #openstack-ansible | 11:13 | |
| *** shyambiradar has quit IRC | 11:15 | |
| *** shyambiradar has joined #openstack-ansible | 11:15 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Cleanup duplicate 'when' https://review.openstack.org/588354 | 11:17 |
| *** DanyC has quit IRC | 11:17 | |
| openstackgerrit | Merged openstack/openstack-ansible-pip_install master: Allow the role to only configure pip, not install it https://review.openstack.org/587840 | 11:24 |
| jrosser | evrardjp: i'm still not convinced that the role tests work | 11:25 |
| jrosser | evrardjp: see here - https://review.openstack.org/#/c/586635/ that pattern exhibits in many many places | 11:26 |
| openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Update to bionic 18.04.1 base image https://review.openstack.org/588466 | 11:27 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: [TEST] bionic https://review.openstack.org/586635 | 11:34 |
| *** shyambiradar has quit IRC | 11:34 | |
| *** shyambiradar has joined #openstack-ansible | 11:35 | |
| *** ansmith has quit IRC | 11:45 | |
| jrosser | odyssey4me: i'm not sure i see anything in the logs about depends-on being applied, even when i'm pretty sure its worked | 11:46 |
| *** savvas has quit IRC | 11:59 | |
| *** zul has joined #openstack-ansible | 12:01 | |
| *** savvas has joined #openstack-ansible | 12:08 | |
| *** shyambiradar has quit IRC | 12:10 | |
| *** rmart04 has joined #openstack-ansible | 12:14 | |
| *** savvas has quit IRC | 12:21 | |
| odyssey4me | jrosser: well, you might find it by SHA - but you're more likely to see it via resulting task changes or whatever - in this case a different image being downloaded | 12:23 |
| odyssey4me | anyway, it's merged now | 12:23 |
| odyssey4me | evrardjp can we merge https://review.openstack.org/588191 now so that I can get on with doing all the role changes again | 12:28 |
| evrardjp | odyssey4me: ok | 12:32 |
| evrardjp | bypassing things | 12:32 |
| odyssey4me | tyvm | 12:32 |
| *** czunker has joined #openstack-ansible | 12:35 | |
| openstackgerrit | James Denton proposed openstack/openstack-ansible master: [WIP] Adds haproxy endpoints for networking-ovn support https://review.openstack.org/584069 | 12:43 |
| odyssey4me | morning jamesdenton - FYI the integrated built tests for master should no longer have the tempest failures | 12:45 |
| jamesdenton | oh good. i was beating my head trying to figure out why | 12:45 |
| openstackgerrit | Florian Haas proposed openstack/openstack-ansible stable/queens: Drop --tags=haproxy_server-config from run-upgrade.sh https://review.openstack.org/588531 | 12:45 |
| evrardjp | haha | 12:45 |
| jamesdenton | but, i did discover i was missing a few things for tests, so maybe it was better that way :D | 12:46 |
| evrardjp | jrosser: it didn't | 12:48 |
| evrardjp | check the current run start of the log | 12:48 |
| evrardjp | vs the time the other patch was merged: | 12:48 |
| evrardjp | https://review.openstack.org/#/c/588466/ merged at 13:27. Current log is http://logs.openstack.org/35/586635/5/check/openstack-ansible-functional-ubuntu-bionic/66087d4/job-output.txt.gz | 12:49 |
| evrardjp | jrosser: little trick: abandon and reopen. Use the depends-on too : ) | 12:49 |
| evrardjp | or be a little patient : D | 12:50 |
| evrardjp | I mean | 12:50 |
| evrardjp | meh I can't properly speak | 12:50 |
| evrardjp | If you edit the commit-message with a depends-on it will force things, and re-trigger gating, which should do the trick | 12:50 |
| odyssey4me | losing your ability to speak is a skill learned when working from home | 12:51 |
| openstackgerrit | James Denton proposed openstack/openstack-ansible-os_neutron master: [WIP] Adds networking-ovn support https://review.openstack.org/584067 | 12:54 |
| odyssey4me | evrardjp: if only people would listen to you the first time ;) | 12:56 |
| odyssey4me | bummer, there was a brilliant cartoon showing the evolution of a person working from home - I thought it was xkcd, but I can't seem to find it | 12:59 |
| jamesdenton | i feel like i'm letting myself go in some regards | 12:59 |
| jamesdenton | been WFH for a year now | 12:59 |
| *** nicolasbock has joined #openstack-ansible | 13:00 | |
| odyssey4me | did find this gem though: https://xkcd.com/1075/ | 13:01 |
| odyssey4me | haha, this is spot on: http://theoatmeal.com/comics/working_home | 13:02 |
| odyssey4me | 'The horrible degradation of social skills' is the thing I was looking for | 13:02 |
| odyssey4me | "English is speak becoming hardness." :D | 13:03 |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Switch to using project-templates https://review.openstack.org/588464 | 13:04 |
| jamesdenton | pretty spot on | 13:04 |
| evrardjp | aha | 13:05 |
| * odyssey4me just discovered https://www.explainxkcd.com/ | 13:05 | |
| evrardjp | jamesdenton: you're one year in you said? :D | 13:06 |
| jamesdenton | Yes, one year in. I'm still holding on to my humanity.. still try to shower semi-regularly | 13:07 |
| evrardjp | odyssey4me: it's a good friday then | 13:07 |
| odyssey4me | the comments here, so good: https://www.reddit.com/r/xkcd/comments/3tan6w/xkcd_1605_dna/ | 13:09 |
| odyssey4me | jamesdenton: if you haven't grown a beard yet, you're still grooming | 13:09 |
| evrardjp | jamesdenton: when you said 1 year, I was precisely on the 1 year image. It was priceless. | 13:09 |
| jamesdenton | oh i've been working the beard for years now. It's no rip-van-winkle beard, though | 13:10 |
| *** vnogin has quit IRC | 13:10 | |
| odyssey4me | jamesdenton: When we next meet, I expect to find you looking akin to Hagrid. | 13:10 |
| jamesdenton | I do have to deal with commoners in this town semi-regularly | 13:10 |
| jamesdenton | hah | 13:10 |
| evrardjp | I need sleep I read "I do have to deal with coroners in this town" | 13:11 |
| jamesdenton | hmm | 13:12 |
| evrardjp | that was super weird. | 13:12 |
| jamesdenton | get some rest :D | 13:12 |
| *** ansmith has joined #openstack-ansible | 13:12 | |
| odyssey4me | evrardjp: perhaps you're living in a cowboy western fantasy | 13:12 |
| evrardjp | odyssey4me: in space? | 13:13 |
| evrardjp | odyssey4me: like cowboy bebop? | 13:13 |
| odyssey4me | evrardjp: no coroners in that tale | 13:14 |
| evrardjp | or Firefly | 13:14 |
| evrardjp | odyssey4me: well, there is IIRC. | 13:15 |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca master: Add support for CentOS 7 https://review.openstack.org/588545 | 13:16 |
| evrardjp | that was a good show. | 13:16 |
| odyssey4me | yeah | 13:17 |
| odyssey4me | Black Lagoon is similar and pretty good. | 13:17 |
| *** DanyC has joined #openstack-ansible | 13:18 | |
| *** suggestable has joined #openstack-ansible | 13:18 | |
| odyssey4me | evrardjp jrosser shall we? https://review.openstack.org/585504 | 13:20 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Prevent common MQ task set from synchronizing https://review.openstack.org/588191 | 13:20 |
| odyssey4me | jrosser: also a good patch needing another review: https://review.openstack.org/585378 | 13:20 |
| evrardjp | odyssey4me: yup watched it too. | 13:21 |
| evrardjp | I think the coroner is in Black Lagoon though. | 13:21 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Replace tempest with healtchecks https://review.openstack.org/587544 | 13:22 |
| odyssey4me | evrardjp: yes, I think that's right - the style of Cowboy Bebop is much more focused on the humour, whereas in Black Lagoon it's more gritty | 13:23 |
| * odyssey4me likes dem healt checks | 13:23 | |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Replace tempest with healtchecks https://review.openstack.org/587544 | 13:25 |
| evrardjp | odyssey4me: yeah I am thinking healthchecks should be simple to read, and easy to execute/teardown | 13:26 |
| *** lbragstad has quit IRC | 13:26 | |
| evrardjp | also I think it's closer to our users. I would expect more users running things with ansible rather that run tempest :p | 13:26 |
| odyssey4me | evrardjp: mind upgrading your vote here? https://review.openstack.org/#/c/587870/1 | 13:27 |
| evrardjp | tempest is a great tool for devs | 13:27 |
| odyssey4me | evrardjp: perhaps you're missing my intent with the comment | 13:27 |
| evrardjp | ? | 13:27 |
| odyssey4me | healt checks are very healty | 13:28 |
| evrardjp | haha | 13:28 |
| * odyssey4me wonders what being healty is all about | 13:28 | |
| evrardjp | I se | 13:28 |
| odyssey4me | :p | 13:28 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible master: Replace tempest with healthchecks https://review.openstack.org/587544 | 13:28 |
| odyssey4me | Sorry, it's friday. It's been a long week. | 13:28 |
| evrardjp | Friday? | 13:29 |
| odyssey4me | :p | 13:30 |
| evrardjp | jamesdenton: you go to the ptg by any chance? | 13:31 |
| odyssey4me | evrardjp: jamesdenton doesn't leave his room, except to get supplies | 13:32 |
| evrardjp | a room full of supplies odyssey4me ? | 13:32 |
| odyssey4me | that'd be supplies-ing | 13:33 |
| evrardjp | http://gph.is/29cBCaY | 13:33 |
| evrardjp | haha | 13:33 |
| * odyssey4me blames mhayden | 13:33 | |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca master: Add support for CentOS 7 https://review.openstack.org/588545 | 13:33 |
| evrardjp | plecisely1 | 13:34 |
| evrardjp | s/1/!/ | 13:34 |
| odyssey4me | omg laughing so hard right now | 13:34 |
| evrardjp | :) | 13:35 |
| jamesdenton | evrardjp no i did not go to the PTG. I'm not l33t enough | 13:38 |
| *** ansmith has quit IRC | 13:40 | |
| odyssey4me | jamesdenton: UR l337 d4wG | 13:40 |
| * odyssey4me puts himself to bed | 13:40 | |
| jamesdenton | heh | 13:41 |
| jamesdenton | I hope to be in Berlin, though | 13:41 |
| *** ansmith has joined #openstack-ansible | 13:44 | |
| cloudnull | mornings | 13:52 |
| jamesdenton | ++ | 13:53 |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix gate log collection https://review.openstack.org/587708 | 13:56 |
| *** czunker has quit IRC | 13:59 | |
| evrardjp | jamesdenton: I am very sad. | 14:01 |
| evrardjp | let's drink some beverages in Berlin then! | 14:02 |
| jamesdenton | let's! | 14:02 |
| jamesdenton | first round is on me | 14:02 |
| * odyssey4me orders a double of Dalmore 62 Single Highland Malt Scotch (Matheson 1942) | 14:09 | |
| odyssey4me | totally kidding | 14:09 |
| jamesdenton | Dalmore 62 Single Highland Malt Scotch (Matheson 2018) | 14:11 |
| odyssey4me | let's see - one Dalmore 62 Single Highland Malt Scotch (Matheson 1942) @ $58,000 - is 16 one-and-a-half ounce shots, making it $3,625 per (american) shot | 14:13 |
| odyssey4me | in case you're all wondering: https://moneyinc.com/most-expensive-whiskey-bottles/ | 14:15 |
| * odyssey4me continues muttering to himself | 14:16 | |
| jamesdenton | You're getting Cutty Sark and you're gonna like it | 14:16 |
| odyssey4me | hahahaha | 14:16 |
| *** rpittau has quit IRC | 14:18 | |
| odyssey4me | Alright, I think it's time to call it a day for me. It's friday, and the weather's lovely. Someone chase evrardjp into the w/end. | 14:20 |
| odyssey4me | Cheers folks! | 14:20 |
| cloudnull | take care odyssey4me | 14:21 |
| jamesdenton | enjoy the weekend | 14:21 |
| *** DanyC has quit IRC | 14:22 | |
| *** DanyC has joined #openstack-ansible | 14:22 | |
| openstackgerrit | Kaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca master: Add support for openSUSE https://review.openstack.org/588584 | 14:29 |
| *** dxiri has joined #openstack-ansible | 14:38 | |
| evrardjp | good weekend odyssey4me | 14:44 |
| d34dh0r53 | evrardjp: go away :) | 14:51 |
| d34dh0r53 | evrardjp: enjoy your weekend! | 14:51 |
| *** FrankZhang has joined #openstack-ansible | 14:52 | |
| evrardjp | d34dh0r53: I still have meetings and all | 14:52 |
| d34dh0r53 | evrardjp: ohh, bummer man | 14:53 |
| d34dh0r53 | I'm pretty sure it's against the Geneva Convention to schedule meetings on Friday afternoon | 14:53 |
| evrardjp | that's fine my last one starts in 6 minutes and should only last 1h if it doesn't exceed its planned time (unlikely though) | 14:53 |
| evrardjp | haha | 14:54 |
| evrardjp | I smiled d34dh0r53 ! | 14:54 |
| d34dh0r53 | evrardjp: good :) | 14:54 |
| guilhermesp | take care odyssey4me !! | 14:56 |
| *** cshen has quit IRC | 14:58 | |
| *** dxiri has quit IRC | 14:58 | |
| eumel8 | o/ | 15:01 |
| eumel8 | is there a way for a list of ip addresses in the same network sort by the last octed? | 15:03 |
| *** spatel has joined #openstack-ansible | 15:08 | |
| *** ullbeking has quit IRC | 15:21 | |
| *** ullbeking has joined #openstack-ansible | 15:22 | |
| *** ullbeking has quit IRC | 15:22 | |
| *** ullbeking has joined #openstack-ansible | 15:23 | |
| *** ullbeking has quit IRC | 15:23 | |
| *** ullbeking has joined #openstack-ansible | 15:23 | |
| *** ullbeking has quit IRC | 15:24 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Remove the unnecessary space https://review.openstack.org/582814 | 15:25 |
| *** ullbeking has joined #openstack-ansible | 15:25 | |
| *** ullbeking has quit IRC | 15:25 | |
| openstackgerrit | Merged openstack/openstack-ansible master: Remove all MQ vhost/user and DB create tasks https://review.openstack.org/585504 | 15:25 |
| *** ullbeking has joined #openstack-ansible | 15:25 | |
| *** ullbeking has quit IRC | 15:25 | |
| jamesdenton | TFW the gate fails on something other than your patch | 15:28 |
| bgmccollum | M-m-m-m-m-m-m-erged...! | 15:29 |
| openstackgerrit | Merged openstack/openstack-ansible master: Change the osa wrapper from a heredoc to a file https://review.openstack.org/582633 | 15:29 |
| cloudnull | eumel8 in ansible, probably not. there is the ipaddr filter which can do some of that but probably not specifically what you want. | 15:37 |
| *** vnogin has joined #openstack-ansible | 15:37 | |
| cloudnull | in python you could do that given the list of ips and simply calling sorted | 15:37 |
| *** vnogin has quit IRC | 15:38 | |
| eumel8 | cloudnull: yeah, I saw it. also a shell task could do this with sort -n -t . -k 4,4 but nothing in jinja | 15:40 |
| cloudnull | ++ | 15:41 |
| devx | whats the best way to update the /etc/hosts file? | 15:42 |
| cloudnull | devx probably lineinfile | 15:42 |
| devx | sounds good | 15:43 |
| mnaser | morning everyone | 15:43 |
| mnaser | kaiokmo: nice job on the merge :) | 15:43 |
| kaiokmo | thanks mnaser | 15:44 |
| guilhermesp | yeah indeed! kaiokmo is doing a great job while I'm finishing some stuff out of monasca scope | 15:44 |
| guilhermesp | I will come back porting grafana asap | 15:44 |
| kaiokmo | there's still work to do on monasca role and monasca-agent too | 15:44 |
| openstackgerrit | Merged openstack/openstack-ansible master: Do not install linux-image-extra by default https://review.openstack.org/585378 | 15:45 |
| kaiokmo | for now I'm focusing on add support for centos and opensuse on both monasca and monasca-agent | 15:45 |
| jamesdenton | Any suggestions on pinning down the issue for timeouts on openstack-ansible-deploy-aio_lxc-ubuntu-xenial check? | 15:52 |
| mnaser | jamesdenton: i think there was a proposed check that odyssey4me pushed up to disable the check that has been timing out frequently | 15:54 |
| jamesdenton | thanks mnaser. Would this be it? https://review.openstack.org/#/c/588360/ | 15:58 |
| mnaser | yes sir | 15:58 |
| bgmccollum | jamesdenton yeah thats the one, it merged a few hours ago. when was your last recheck? | 15:58 |
| mnaser | thats the one | 15:58 |
| jamesdenton | 2-3 hrs ago | 15:58 |
| eumel8 | mnaser: as the upcoming PTL I have some proposals for you to review: https://review.openstack.org/#/c/586867/ https://review.openstack.org/#/c/586866/ https://review.openstack.org/#/c/586774/ | 15:59 |
| bgmccollum | jamesdenton doesn't look like that check even made it to the tempest bits...so probably unrelated. | 16:00 |
| eumel8 | don't know if you have a list on etherpad. won't pass the queue | 16:00 |
| bgmccollum | has anyone though about task time regression testing? | 16:00 |
| bgmccollum | seems like we have the data | 16:00 |
| -openstackstatus- NOTICE: The infra team is renaming projects in Gerrit. There will be a short ~10 minute Gerrit downtime in a few minutes as a result. | 16:01 | |
| mnaser | eumel8: that's interesting, i think we'll have to add something to release time to update the branch there in `_horizon_translations_pull` | 16:01 |
| eumel8 | ok | 16:03 |
| mnaser | eumel8: do you happen to have an extra few cycles to add a change into https://docs.openstack.org/openstack-ansible/latest/contributor/periodic-work.html#development-cycle-checklist under "After creating a new stable branch:" ? | 16:03 |
| mnaser | as a note under "For all the repos, update the eventual static files refering to master/previous branch name" | 16:03 |
| mnaser | if you don't, i can do it but it'd be a ton of help if you had a few spare cycles :) | 16:04 |
| mnaser | that way wee don't end up deploying from master translation and break things | 16:04 |
| bgmccollum | jamesdenton under `setup-infrastructure.yml` the task `repo_build : Clone git repositories` took 43 minutes...which isn't normal... | 16:04 |
| devx | cloudnull have you tried to run macvlan in conjuction with netplan? i know it doesn't supported but I was wondering if there is a better way than using networkd-dispatch scripts :( | 16:04 |
| *** gyee has joined #openstack-ansible | 16:09 | |
| jamesdenton | thanks bgmccollum. have to step away but will check that out again | 16:10 |
| cloudnull | devx everything i've been doing with networkd is in this role https://github.com/openstack/ansible-role-systemd_networkd | 16:12 |
| *** ivve has joined #openstack-ansible | 16:12 | |
| cloudnull | the issue i had with macvlan yesterday is resolved. the route add trick worked a treat :) | 16:12 |
| cloudnull | the basic network setup i've been testing with is here http://paste.openstack.org/show/727250 | 16:14 |
| cloudnull | ^ look ma, no bridges! | 16:14 |
| cloudnull | and here's a fully configured node http://paste.openstack.org/show/727251 which is a compute/infra host | 16:15 |
| cloudnull | only the brq that neutron creates. | 16:15 |
| cloudnull | http://paste.openstack.org/show/727252/ | 16:15 |
| *** suggestable has quit IRC | 16:20 | |
| *** udesale has quit IRC | 16:20 | |
| cloudnull | and the contianers / vms http://paste.openstack.org/show/727254/ | 16:20 |
| devx | @clou | 16:20 |
| *** cshen has joined #openstack-ansible | 16:20 | |
| cloudnull | dogs and cats, living together :) | 16:20 |
| devx | cloudnull i will check it out thanks! | 16:21 |
| * mnaser twitches | 16:21 | |
| mnaser | no gerrit | 16:21 |
| mnaser | what do | 16:21 |
| *** FrankZhang has quit IRC | 16:22 | |
| cloudnull | WAT?! | 16:23 |
| cloudnull | gerrit is down ? | 16:23 |
| kaiokmo | back again | 16:23 |
| cloudnull | wooooo, crisis averted | 16:23 |
| cloudnull | hahaha | 16:23 |
| kaiokmo | infra team is updating things in gerrit | 16:23 |
| cloudnull | makes sense. | 16:25 |
| *** rmart04 has left #openstack-ansible | 16:26 | |
| *** cshen has quit IRC | 16:33 | |
| cloudnull | anyone seen this error in the neutron logs http://paste.openstack.org/show/727256/ ? | 16:39 |
| cloudnull | doesn't seem to be causing any failures. but its spamming the logs | 16:39 |
| evrardjp | meetings over! I am done for today and the week-end. I will try to work on the release toolkit this week-end if I got 5 minutes. | 16:48 |
| jrosser | cloudnull: my rocky/bionic AIO was totally full of neutron log spam but i didnt cat chance to check it out yet | 16:48 |
| evrardjp | everyone: have a nice week-end. | 16:48 |
| jrosser | o/ have a good one evrardjp | 16:49 |
| cloudnull | take care evrardjp | 16:49 |
| *** openstackgerrit has quit IRC | 16:49 | |
| *** openstackgerrit has joined #openstack-ansible | 16:51 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules https://review.openstack.org/582324 | 16:51 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Execute image setup against octavia_service_setup_host https://review.openstack.org/588165 | 16:51 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Execute flavor setup against octavia_service_setup_host https://review.openstack.org/588166 | 16:51 |
| openstackgerrit | Merged openstack/openstack-ansible-os_horizon master: fix execution of horizon_translations_update.yml https://review.openstack.org/586866 | 16:53 |
| *** cshen has joined #openstack-ansible | 16:55 | |
| *** gillesMo has quit IRC | 16:59 | |
| *** cshen has quit IRC | 17:01 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Execute network setup against octavia_service_setup_host https://review.openstack.org/588174 | 17:16 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Make the project home link in next line https://review.openstack.org/584587 | 17:16 |
| jamesdenton | bgmccollum any hints on where you found that task duration? | 17:21 |
| bgmccollum | jamesdenton it was this change, right? -- https://review.openstack.org/#/c/584069/6 | 17:22 |
| jamesdenton | yes | 17:22 |
| bgmccollum | http://logs.openstack.org/69/584069/6/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/c9d95e3/logs/ara-report/ | 17:22 |
| bgmccollum | I saw setup-infrastructure.yml took 72 minutes, so clicked into that playbook, and sorted the tasks by duration... | 17:23 |
| jamesdenton | ahh ok, i was looking at plays not tasks. | 17:23 |
| bgmccollum | yeah, the clones should only be about 5-10 minutes in my experience, so something was definitely wrong. i kicked off a recheck already... | 17:24 |
| jamesdenton | oh thanbk you | 17:24 |
| bgmccollum | 👍 | 17:24 |
| bgmccollum | would be nice to see some task time averaging / regressing testing | 17:25 |
| -openstackstatus- NOTICE: Project renames and review.openstack.org downtime are complete without any major issue. | 17:27 | |
| jrosser | bgmccollum: if you fancy this could be applied to the repo git clone https://review.openstack.org/#/c/588372/ | 17:29 |
| jrosser | that was my plan to give that a try but not had time to wire it in yet | 17:29 |
| * bgmccollum clicks | 17:30 | |
| jrosser | it works locally but i've messed up installing the pip packages in the gate i think | 17:30 |
| jrosser | and it gives 10x or more speed increase on git cloning, so long as the repos and underlying network are up to it | 17:31 |
| bgmccollum | really should have called it git_fireball_mode | 17:31 |
| jrosser | thats only used during bootstrap-ansible as it stands, but theres no reason why the same thing can't fit into the repo build as well | 17:32 |
| *** ullbeking has joined #openstack-ansible | 17:33 | |
| *** ullbeking has quit IRC | 17:33 | |
| *** ullbeking has joined #openstack-ansible | 17:35 | |
| bgmccollum | might be able to get some parallelism out of using delegate_to? | 17:36 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] check if gpg agent is running, and can be made to run https://review.openstack.org/588629 | 17:43 |
| openstackgerrit | Byron McCollum proposed openstack/openstack-ansible master: [TEST] Parallelize Git Clones https://review.openstack.org/588630 | 17:47 |
| spatel | guys can you help me to pint point my Queens horizon issue | 17:47 |
| spatel | its extremely slow | 17:47 |
| jrosser | bgmccollum: that whole play targets localhost | 17:48 |
| spatel | I have test basic stuff | 17:48 |
| spatel | memcache etc.. they all looks good | 17:48 |
| bgmccollum | jrosser so, the delegate_to should parallelize each with_item...if ansible still behaves that way... | 17:49 |
| spatel | Did you guys experience slowness in your Queens deployment? | 17:49 |
| openstackgerrit | Merged openstack/openstack-ansible master: Allow flexible tag for Rabbit monitoring user https://review.openstack.org/579536 | 17:51 |
| spatel | my "nova list" taking 3 to 4 second | 17:54 |
| spatel | does that means its not horizon issue? | 17:54 |
| jrosser | spatel: horizon makes a ton of calls to the underlying APIs | 17:54 |
| bgmccollum | spatel -- try "openstack --timing server list" and see which calls are slow... | 17:55 |
| jrosser | so if you see the cli being slow too then it's probably not something within horizon | 17:55 |
| bgmccollum | spatel these are the results from my queens AIO from the utility container -- http://paste.openstack.org/show/727271/ | 17:58 |
| bgmccollum | ranges from 2.25s to 0.9s | 17:58 |
| spatel | bgmccollum: here is the output http://paste.openstack.org/show/727272/ | 17:58 |
| bgmccollum | and that AIO is a VM itself... | 17:59 |
| bgmccollum | let me compare to my pike... | 17:59 |
| spatel | I have metal and with 40 core and 32G mem | 18:00 |
| spatel | my pike was extremely fast compare to current Queens so something is wrong | 18:00 |
| bgmccollum | my pike is faster, but its running on metal, compared to queens in vm -- http://paste.openstack.org/show/727273/ | 18:03 |
| spatel | jrosser: I understand but this is extremely slow.. hard to watch this slowness | 18:03 |
| bgmccollum | not sure the cause of the differences you are seeing... | 18:03 |
| spatel | anybody using queen who can verify | 18:04 |
| spatel | i was very happy with pike but then i upgrade and now i am here stuck | 18:04 |
| openstackgerrit | Merged openstack/openstack-ansible master: Simplify bootstrap-ansible.sh https://review.openstack.org/583905 | 18:05 |
| openstackgerrit | Merged openstack/openstack-ansible stable/queens: Drop --tags=haproxy_server-config from run-upgrade.sh https://review.openstack.org/588531 | 18:05 |
| spatel | What i should look for slowness ? | 18:05 |
| spatel | Can you give me some tip or hints i should look | 18:05 |
| *** electrofelix has quit IRC | 18:06 | |
| bgmccollum | Probably some MySQL tuning that could be done, but I'm far from an expert on that | 18:07 |
| spatel | any thing i should look in mysql ? like any query etc..? | 18:08 |
| bgmccollum | like i said, not an expert. | 18:08 |
| spatel | REDHAT Document saying: When you click on admin tab, in backgroud it access/list all configured API and if there is any delay in API response then you will observe delay in horizon admin tab. Check how much time it take from OpenStack CLI to fetch the data. For ex: nova list , cinder list etc. | 18:08 |
| cloudnull | welp that was a nice rabbit hole. https://github.com/openstack/neutron/blob/master/neutron/services/trunk/drivers/linuxbridge/agent/trunk_plumber.py#L123-L156 - seems neutron is working as expected. RE: http://paste.openstack.org/show/727256 | 18:11 |
| openstackgerrit | Byron McCollum proposed openstack/openstack-ansible master: [TEST] Parallelize Git Clones https://review.openstack.org/588630 | 18:12 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] check if gpg agent is running, and can be made to run https://review.openstack.org/588629 | 18:18 |
| *** openstackgerrit has quit IRC | 18:19 | |
| spatel | bgmccollum: what kind of LB you have ? | 18:19 |
| spatel | F5 or Haproxy? | 18:19 |
| bgmccollum | haproxy | 18:19 |
| spatel | what is the box configuration? | 18:19 |
| bgmccollum | Queens? Or Pike? | 18:19 |
| spatel | in Production metal | 18:20 |
| bgmccollum | Queens in a VM | 18:20 |
| bgmccollum | Pike is a Ryzen 7 1700 / 32GB Memory | 18:20 |
| spatel | possible my haproxy is slow | 18:20 |
| spatel | because all API call flying over LB | 18:21 |
| * mhayden rips threads | 18:24 | |
| jamesdenton | duuuuuuude this DPDK config just keeps getting better and better.... | 18:26 |
| jamesdenton | </s> | 18:26 |
| * bgmccollum has that sinking feeling its going to timeout | 18:41 | |
| bgmccollum | photo finish | 18:41 |
| *** coreywright has quit IRC | 18:42 | |
| *** openstackgerrit has joined #openstack-ansible | 18:45 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] check if gpg agent is running, and can be made to run https://review.openstack.org/588629 | 18:45 |
| spatel | beam.smp eating lots of CPU on infra* nodes | 18:47 |
| spatel | is that rabittmq ? | 18:47 |
| spatel | is that normal for idle cluster? | 18:48 |
| *** coreywright has joined #openstack-ansible | 18:54 | |
| spatel | bgmccollum: does it normal ? | 18:57 |
| *** cshen has joined #openstack-ansible | 18:57 | |
| *** cshen has quit IRC | 19:02 | |
| *** cshen has joined #openstack-ansible | 19:09 | |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Move role setup into service setup tasks https://review.openstack.org/588175 | 19:09 |
| openstackgerrit | Merged openstack/openstack-ansible-os_octavia master: Execute security group setup against octavia_service_setup_host https://review.openstack.org/588176 | 19:09 |
| bgmccollum | spatel -- A Pike Lab with 40 Cores has a load average of 0.15, with rabbit bouncing around 35% of a single core | 19:17 |
| spatel | 31.3 0.8 3:20.88 beam.smp | 19:17 |
| spatel | 31% | 19:17 |
| spatel | Do you feel like your horizon is slow? | 19:18 |
| bgmccollum | no | 19:18 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] check if gpg agent is running, and can be made to run https://review.openstack.org/588629 | 19:19 |
| spatel | bgmccollum: can you tell me is this looks good to you? http://paste.openstack.org/show/727277/ | 19:20 |
| spatel | i have these setting in my use_variable | 19:20 |
| bgmccollum | i really don't mess with any of those, i just use the defaults | 19:22 |
| bgmccollum | cant really speak on when or why to change any of them | 19:23 |
| spatel | Hmm! | 19:24 |
| spatel | i think i should remove all those setting and try | 19:25 |
| spatel | to see how it works | 19:25 |
| spatel | bgmccollum: in short you have user_variable empty? | 19:26 |
| bgmccollum | can i ask why you changed these from the defaults? | 19:28 |
| spatel | to control CPU resources | 19:29 |
| spatel | i want to to increase them on demand | 19:29 |
| spatel | but now i am going to comment them out and going to run playbook to see what it does | 19:29 |
| *** mhayden has quit IRC | 19:32 | |
| *** mhayden has joined #openstack-ansible | 19:33 | |
| *** cshen has quit IRC | 19:33 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] check if gpg agent is running, and can be made to run https://review.openstack.org/588629 | 19:39 |
| spatel | Also i am planning to move my haproxy to F5 | 19:40 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Cleanup files and templates using smart sources https://review.openstack.org/588647 | 19:40 |
| cloudnull | mnaser ^ if you're around mind having a loot at that ? | 19:41 |
| mnaser | cloudnull: lookin | 19:41 |
| cloudnull | thanks ! | 19:41 |
| cloudnull | was trying to copy a lot of what you had started elsewhere. | 19:42 |
| jrosser | cloudnull: i am closing in on why bionic lxc cache prep fails - i might need your help later | 19:43 |
| cloudnull | i'm around for a while longer. let me know. | 19:44 |
| cloudnull | happy to help make that go | 19:44 |
| jrosser | ok, cool, thanks | 19:44 |
| logan- | cloudnull: suggestion in there for user friendliness | 19:51 |
| mnaser | haha wow | 19:51 |
| cloudnull | ++ logan- will do | 19:51 |
| mnaser | cloudnull: same comment as logan- alongside a few other things | 19:51 |
| mnaser | cloudnull: please ping when you push a revision, i can have a look at it right away | 19:52 |
| cloudnull | ++ | 19:52 |
| * cloudnull revising | 19:52 | |
| mnaser | logan-: mind rebasing ?https://review.openstack.org/#/c/582272/ | 19:52 |
| logan- | ah yep, one sec. thanks mnaser | 19:53 |
| jrosser | cloudnull: so this lxc-cache prep business seems to be failing for gpg related reasons, and i've thrown in a bunch of stuff here to try to figure it out https://review.openstack.org/#/c/588629/ | 19:54 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Move get-ansible-role-requirements to scripts https://review.openstack.org/582271 | 19:54 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Use an absolute path for the role requirements file https://review.openstack.org/582272 | 19:54 |
| jrosser | cloudnull: this is useful to see http://logs.openstack.org/29/588629/3/check/openstack-ansible-functional-ubuntu-bionic/389dde6/logs/host/lxc-cache-prep-commands.log.txt.gz | 19:55 |
| jrosser | and i have a hunch it is caused by this http://logs.openstack.org/29/588629/5/check/openstack-ansible-functional-ubuntu-bionic/d911d08/logs/host/lxc-cache-prep-commands.log.txt.gz | 19:55 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Use ZUUL_SRC_PATH to pass the path to Zuul git sources https://review.openstack.org/582273 | 19:56 |
| jamesdenton | bgmccollum no dice. bummer. | 19:56 |
| spatel | I just compare my queens with my LAB machine which is running on VMware that is super fast compare to my production :( | 20:03 |
| bgmccollum | jamesdenton look like it was in the middle of setting up tempest...almost made it. same thing happened to mine. | 20:03 |
| spatel | what a painful | 20:03 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Cleanup files and templates using smart sources https://review.openstack.org/588647 | 20:03 |
| jamesdenton | alright, well. thanks for the assist. I have another one failing on galera repo build. The mirror is missing the package. oy vey | 20:04 |
| cloudnull | spatel: queens in vmware is faster or slower? | 20:05 |
| *** cshen has joined #openstack-ansible | 20:05 | |
| cloudnull | logan- mnaser updated that pr | 20:05 |
| cloudnull | jrosser looking at that log | 20:05 |
| spatel | queens in vmware running faster | 20:05 |
| spatel | cloudnull: ^^ | 20:05 |
| cloudnull | is queens in prod now too ? | 20:05 |
| spatel | cloudnull: but on my production where we have lots of core running super slow | 20:05 |
| cloudnull | or still pike | 20:05 |
| cloudnull | ah is that a hardware issue? | 20:06 |
| spatel | I am all queens (I have upgraded pike) | 20:06 |
| cloudnull | nice! | 20:06 |
| spatel | I have 3 physical infra nodes | 20:06 |
| spatel | 40 core 32G memory SSD | 20:06 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Use ZUUL_SRC_PATH to pass the path to Zuul git sources https://review.openstack.org/582273 | 20:07 |
| *** savvas has joined #openstack-ansible | 20:07 | |
| cloudnull | jrosser I see - E: Can not write log (Is /dev/pts mounted?) - posix_openpt (19: No such device) | 20:09 |
| cloudnull | maybe that's related? | 20:09 |
| savvas | hey guys, to deploy Magnum or Octavia, how would I make sure the containers get created and the files downloaded to the repo server? | 20:09 |
| jrosser | cloudnull: i figure that somethings changed very recently that now means extra stuff needs to be mounted in the chroot to make the cache prep script work | 20:10 |
| jrosser | if you diff the xenial/bionic prep scripts they are not quite the same, gpg related | 20:10 |
| cloudnull | jrosser is so we can `mknod -m 0666 /dev/pts/{0..5} c 136 $INT` | 20:11 |
| spatel | when i click on "instance" tab my browser wheel just spinning even i can see all contents on page | 20:11 |
| spatel | cloudnull: ^^ | 20:11 |
| cloudnull | spatel do the CLI clients return fast? | 20:12 |
| mnaser | logan-: what does 3pci stand for? | 20:12 |
| spatel | cloudnull: is there anyway or plugin i can install on browser to see where its getting stuck | 20:12 |
| logan- | mnaser: 3rd party ci | 20:12 |
| mnaser | damn i was trying to figure that out for the longest time. | 20:12 |
| spatel | cloudnull: CLI is fast | 20:12 |
| cloudnull | spatel chrome as the developer panel | 20:12 |
| cloudnull | if the CLI is fast I'd suspect something in path making it slow | 20:12 |
| mnaser | cloudnull: regarding that change, my concern is that, what if the user ran ansible once with overrides, then ran it again without them | 20:13 |
| mnaser | the overrides won't be removed | 20:13 |
| spatel | yes.. something is wrong... | 20:13 |
| cloudnull | mnaser i see | 20:13 |
| mnaser | so to remove the overrides would require actually just deleting the lines in the file | 20:13 |
| jrosser | cloudnull: i think that gpg-agent wants to make stuff in /run/user/0/gnupg | 20:14 |
| mnaser | cloudnull: maybe we can always download them but we download them from the virtualenv rather than /etc.. im not sure :X | 20:14 |
| cloudnull | yea I think that's a side effect of not carrying the templates. | 20:15 |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: ssh-key should land in $HOME https://review.openstack.org/588652 | 20:15 |
| cloudnull | I guess I could case those files and make a remote backup before mucking with them | 20:15 |
| xgerman_ | ^^ might fix Octavia gates | 20:16 |
| cloudnull | when no override is present, copy remote from the backup file | 20:16 |
| spatel | cloudnull: do you think it could be DNS ? | 20:17 |
| mnaser | cloudnull: i think that might make sense | 20:17 |
| spatel | why horizon depend on DNS ? | 20:17 |
| cloudnull | what's tracepath tell you ? | 20:17 |
| cloudnull | too many hops ? | 20:18 |
| cloudnull | jrosser That would make some sense | 20:18 |
| cloudnull | we can try adding the new devices in the chroot to https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/templates/prep-scripts/_container_sys_setup.sh.j2 | 20:18 |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-lxc_hosts master: [TEST] check if gpg agent is running, and can be made to run https://review.openstack.org/588629 | 20:19 |
| jrosser | cloudnull: ^ that may be bogus but lets see | 20:19 |
| jrosser | just mkdir -p /run/users/0 | 20:20 |
| cloudnull | http://paste.openstack.org/show/727295/ | 20:20 |
| cloudnull | something like that would create those devices. | 20:20 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Move get-ansible-role-requirements to scripts https://review.openstack.org/582271 | 20:21 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Use an absolute path for the role requirements file https://review.openstack.org/582272 | 20:21 |
| openstackgerrit | Logan V proposed openstack/openstack-ansible master: Use ZUUL_SRC_PATH to pass the path to Zuul git sources https://review.openstack.org/582273 | 20:21 |
| spatel | cloudnull: check this out http://paste.openstack.org/show/727296/ | 20:21 |
| spatel | cloudnull: do you think 3 second is slow? | 20:22 |
| cloudnull | spatel that seems normal | 20:31 |
| spatel | I have shutdown infra-02 to see what is happening | 20:32 |
| spatel | i hate browser spinning wheel :( | 20:34 |
| *** ansmith has quit IRC | 20:34 | |
| spatel | i got 504 gateway timeout error | 20:34 |
| spatel | look like my HAproxy still sending request to down node | 20:34 |
| spatel | that is not good | 20:35 |
| spatel | how do i check haproxy status for down node? | 20:35 |
| jamesdenton | hatop? | 20:36 |
| jamesdenton | or check the logs | 20:36 |
| openstackgerrit | German Eichberger proposed openstack/openstack-ansible-os_octavia master: ssh-key should land in $HOME https://review.openstack.org/588652 | 20:36 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Cleanup files and templates using smart sources https://review.openstack.org/588647 | 20:37 |
| cloudnull | mnaser how about that? | 20:37 |
| spatel | /var/log/haproxy/ is empty | 20:37 |
| jamesdenton | /var/log/haproxy.log | 20:39 |
| spatel | crap!! this is very odd | 20:45 |
| spatel | i should down infra-02 and my mysql is down | 20:45 |
| spatel | 01 & 03 showing mysql is dead | 20:45 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Cleanup files and templates using smart sources https://review.openstack.org/588647 | 20:45 |
| spatel | oh! wait.. | 20:46 |
| spatel | i think i am on wrong node | 20:46 |
| spatel | phew!! | 20:46 |
| cloudnull | logan- mnaser updated with a couple comments. logan- good catch on the recursive option . | 20:46 |
| spatel | jamesdenton: there is no log file /var/log/haproxy.log | 20:47 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Cleanup files and templates using smart sources https://review.openstack.org/588647 | 20:51 |
| cloudnull | and that should resolve the last two idempotentcy issues. | 20:51 |
| jamesdenton | spatel maybe syslog would see it, then. not sure | 20:52 |
| spatel | i did check in syslog and its not there | 20:52 |
| openstackgerrit | Merged openstack/openstack-ansible master: Normalise containers-lxc-* playbook structure https://review.openstack.org/586226 | 20:53 |
| openstackgerrit | Merged openstack/openstack-ansible master: Add openstack client to Ansible venv https://review.openstack.org/582496 | 20:55 |
| spatel | if this thing won't get fix then i have to go back to pike :( | 20:56 |
| spatel | i can't just keep fixing stuff everyday, just tired of this thing | 20:57 |
| spatel | my BOSS going to kick me out :) | 20:57 |
| spatel | I am going to try tonight otherwise i am planning to re-install everything | 20:58 |
| cloudnull | spatel what's down? | 20:58 |
| jamesdenton | I did a Pike to Queens upgrade last week and it wasn't super bad. Had some galera wonkiness but thats about it. Probably my fault | 20:58 |
| cloudnull | is the galera cluster up? | 20:58 |
| spatel | I am just trying to find out why Horizon is slow | 20:58 |
| spatel | no galera is happy | 20:58 |
| spatel | that was my mistake | 20:59 |
| spatel | i was looking into wrong box | 20:59 |
| cloudnull | ok | 20:59 |
| jamesdenton | Slow is relative. Is everything functional at the moment? | 20:59 |
| cloudnull | ^ | 20:59 |
| spatel | Do you want to take a look i can get you on shared screen | 20:59 |
| spatel | Everything is working fine... i can create VM etc.. | 20:59 |
| cloudnull | im not in a place to do that atm | 20:59 |
| jamesdenton | me either, about to hop on a call | 21:00 |
| spatel | but its just painful slow.. | 21:00 |
| jamesdenton | like.. 10 secs? 1 min? | 21:00 |
| cloudnull | are you seeing anything in the error log? | 21:00 |
| cloudnull | timeouts ? | 21:00 |
| spatel | I am going to look into logs now to see... | 21:00 |
| spatel | going to look into horizon log first | 21:00 |
| cloudnull | was the cluster responding at roughly the same speed as it was on pike? | 21:00 |
| bgmccollum | Can I get a +W ? -- https://review.openstack.org/#/c/587229/ | 21:00 |
| * cloudnull looking | 21:01 | |
| cloudnull | done. | 21:01 |
| bgmccollum | Finally got through the gauntlet | 21:01 |
| bgmccollum | Cheers! | 21:01 |
| spatel | cloudnull: in my LAB queen is fast enough compare to production one.. | 21:01 |
| spatel | i am surprised why...?? | 21:02 |
| spatel | LAB machine is running on VMWare | 21:02 |
| cloudnull | in the same datacenter? | 21:02 |
| spatel | yes | 21:02 |
| spatel | same datacenter | 21:02 |
| spatel | even before pike was running very fast on same hardware | 21:02 |
| spatel | I am thinking i should bootstrap and run all playbook again | 21:03 |
| cloudnull | shouldn't hurt . | 21:03 |
| spatel | but first let me find logs | 21:03 |
| cloudnull | maybe something is in a funky state post upgrade | 21:03 |
| cloudnull | I'd pore through the logs and see if there's anything obvious | 21:04 |
| jamesdenton | and just to confirm... CLI clients operate as expected? | 21:04 |
| spatel | CLI is working fine | 21:04 |
| cloudnull | also -- https://github.com/openstack/openstack-ansible-ops/tree/master/elk_metrics_6x :) | 21:04 |
| cloudnull | good for log processing :P | 21:04 |
| jamesdenton | have you tried restarting horizon containers? | 21:05 |
| spatel | cloudnull: thanks but at present i need to fix this issue, i may later add this in production | 21:05 |
| spatel | jamesdenton: not yet | 21:05 |
| jamesdenton | may be worth a shot | 21:05 |
| cloudnull | memcached can cause issues like this | 21:05 |
| jamesdenton | ^^ | 21:05 |
| cloudnull | maybe you need to up the memory limit | 21:06 |
| spatel | i am running all those setting default | 21:06 |
| cloudnull | trying upping them | 21:07 |
| cloudnull | https://github.com/openstack/openstack-ansible-memcached_server/blob/master/defaults/main.yml#L46 | 21:07 |
| cloudnull | https://github.com/openstack/openstack-ansible-memcached_server/blob/master/defaults/main.yml#L51 | 21:07 |
| spatel | let me try couple of stuff and see | 21:08 |
| spatel | i will report here whatever i find or not find... | 21:08 |
| cloudnull | spatel what's the memory on your infra nodes? | 21:09 |
| spatel | 32G | 21:09 |
| spatel | http://paste.openstack.org/show/727308/ | 21:10 |
| cloudnull | if you do want to up the memory usage, `openstack-ansible memcached-install.yml -e memcached_connections=8192 -e memcached_memory=10240` | 21:11 |
| cloudnull | that would double the connections and ste the cached memory to 10G | 21:12 |
| cloudnull | up from 8G in your case. | 21:12 |
| spatel | hmm! but i have 32G so is that enough to set that limit? | 21:12 |
| spatel | I am surprised i have 4G memory on LAB machine and they are running fast :) | 21:13 |
| cloudnull | better: `openstack-ansible memcached-install.yml -e memcached_connections=8192 -e memcached_memory=10240 -e memcached_threads=8` | 21:13 |
| spatel | something else going on here | 21:13 |
| cloudnull | lab has fewer nodes? | 21:13 |
| spatel | in LAB i have same setup like production 3 infra node 3 compute 3 ceph | 21:13 |
| spatel | all running on VMware | 21:13 |
| cloudnull | if you dont want to up the memory limit you can omit that setting | 21:14 |
| spatel | i am gona try everything to see what is wrong | 21:14 |
| mnaser | cloudnull: any reason you did a copy using command but then later with remote_src after? | 21:15 |
| cloudnull | if it's fast in one environment, and slow in another I'd suspect either something is wrong in the environment or something in the path to the environment is slow (bad routes, misconfigured switches, bad cable, etc) | 21:15 |
| cloudnull | mnaser I only wanted that copy to run once. | 21:15 |
| *** savvas has quit IRC | 21:16 | |
| cloudnull | which is why I added the creates arg | 21:16 |
| cloudnull | however if there's a way to do the same with the copy module I'd gladly do that instead | 21:16 |
| * cloudnull might need to tell that command to skip lint | 21:17 | |
| spatel | hmm! | 21:17 |
| *** cshen has quit IRC | 21:17 | |
| spatel | tailing horizon logs and other browser accessing horizon - nothing in logs | 21:19 |
| spatel | [pid 10589] (70007)The timeout specified has expired: [client 172.28.0.8:42494] AH01581: Timeout while writing data for URI /static/dashboard/css/9cd30430f096.css to the client, referer: https://10.30.2.9/project/instances/ | 21:20 |
| spatel | just notice this error | 21:21 |
| spatel | 10.30.2.9 is my external LB ip | 21:21 |
| spatel | Restarting horizon service | 21:23 |
| cloudnull | what about the api from outside the environment | 21:23 |
| cloudnull | is that slow ? | 21:23 |
| spatel | systemctl restart httpd just hung on Infra-03 | 21:24 |
| spatel | all other node quickly restart httpd | 21:24 |
| spatel | it took 2 minute to restart httpd on that node | 21:26 |
| spatel | let me dig into that | 21:27 |
| spatel | on other nodes its took 3 second | 21:27 |
| cloudnull | maybe infra3 was responding but had a hung process | 21:27 |
| spatel | i am thinking i should shutdown that node and see how horizon behaving | 21:28 |
| spatel | now restart happened quick | 21:30 |
| *** pcaruana has quit IRC | 21:38 | |
| spatel | I am running developer tool and its showing TTFB - took 15 second, means i got reply back after 15 second and then it took 16 second to download contents | 21:50 |
| *** cshen has joined #openstack-ansible | 21:51 | |
| spatel | I am planning to shutdown 2 nodes so its to troubleshoot with single node | 21:51 |
| *** KeithMnemonic has quit IRC | 21:53 | |
| *** cshen has quit IRC | 21:55 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Cleanup files and templates using smart sources https://review.openstack.org/588647 | 22:05 |
| cloudnull | ^ sorry mnaser logan- needed another pr, we still offer deployments with dragonflow and vpnaas so i still need those rootwrap files | 22:06 |
| cloudnull | but all the rest are still gone :) | 22:06 |
| *** greatgatsby has joined #openstack-ansible | 22:14 | |
| spatel | cloudnull: what is the best way to re-install everything here ? | 22:14 |
| spatel | just destroy all container and re-run all playbook? | 22:14 |
| *** spatel has quit IRC | 22:22 | |
| cloudnull | yes. | 22:26 |
| cloudnull | openstack-ansible contianers-lxc-destroy.yml | 22:26 |
| cloudnull | then rerun the playbooks | 22:27 |
| *** nicolasbock has quit IRC | 22:43 | |
| *** tosky has quit IRC | 23:04 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_neutron master: Cleanup files and templates using smart sources https://review.openstack.org/588647 | 23:05 |
| openstackgerrit | Merged openstack/openstack-ansible master: Cleanup duplicate 'when' https://review.openstack.org/588354 | 23:06 |
| openstackgerrit | Merged openstack/openstack-ansible master: Fix Bootstrap AIO Passing Multiple BOOTSTRAP_OPTS https://review.openstack.org/587229 | 23:06 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: [TEST] check if gpg agent is running, and can be made to run https://review.openstack.org/588629 | 23:09 |
| openstackgerrit | Tony Fontenay proposed openstack/openstack-ansible-lxc_container_create master: CentOS : Fix TASK lxc_container_create : Execute first script https://review.openstack.org/588680 | 23:13 |
| openstackgerrit | Byron McCollum proposed openstack/openstack-ansible stable/queens: Fix Bootstrap AIO Passing Multiple BOOTSTRAP_OPTS https://review.openstack.org/588839 | 23:24 |
| openstackgerrit | Byron McCollum proposed openstack/openstack-ansible stable/pike: Fix Bootstrap AIO Passing Multiple BOOTSTRAP_OPTS https://review.openstack.org/588840 | 23:25 |
| *** ullbeking has quit IRC | 23:41 | |
| *** ullbeking has joined #openstack-ansible | 23:41 | |
| *** ullbeking has joined #openstack-ansible | 23:41 | |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!