| osnaya | already checked the validity of syntax for user_secrets.yml and user_variables.yml syntax thru YAML Lint | 00:00 |
|---|---|---|
| osnaya | @evrardjp can you please give any clues on the error above? | 00:03 |
| osnaya | @evrardjp can you please give any clues on the error above? | 00:05 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 00:06 |
| cloudnull | osnaya: is there a "---" at the top of those files ? | 00:08 |
| osnaya | @cloudnull yes ... is that a problem? | 00:13 |
| *** gunix has left #openstack-ansible | 00:17 | |
| osnaya | @cloudnull I believe --- in the beginning is expected though optional. What about ... at the end of the file (is that optional or must), currently I don't have that in both of my files... | 00:23 |
| *** chyka has quit IRC | 00:28 | |
| osnaya | @cloudnull passed that error... found a typo.... fixed. will continue... thx | 00:36 |
| *** lbragstad has quit IRC | 00:39 | |
| openstackgerrit | Merged openstack/ansible-hardening master: Add check to ClamAV task to prevent simeltaneous content updates https://review.openstack.org/550268 | 00:42 |
| *** zerick has quit IRC | 00:56 | |
| *** zerick_ has joined #openstack-ansible | 00:56 | |
| *** SerenaFeng has joined #openstack-ansible | 00:57 | |
| *** SerenaFeng has quit IRC | 01:01 | |
| *** osnaya has quit IRC | 01:01 | |
| *** woodard has joined #openstack-ansible | 01:16 | |
| *** udesale has joined #openstack-ansible | 01:56 | |
| *** udesale_ has joined #openstack-ansible | 02:00 | |
| *** udesale has quit IRC | 02:02 | |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 02:03 |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible master: [TEST] Update Ansible to 2.5.0rc1 https://review.openstack.org/501814 | 02:04 |
| *** ANKITA has joined #openstack-ansible | 02:41 | |
| *** jamesdenton has joined #openstack-ansible | 02:42 | |
| openstackgerrit | ShangXiao proposed openstack/openstack-ansible-openstack_hosts master: Update the old http links in docs https://review.openstack.org/550673 | 03:06 |
| *** udesale_ has quit IRC | 03:31 | |
| openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 04:03 |
| *** fusmu has joined #openstack-ansible | 04:08 | |
| *** fusmu has quit IRC | 04:13 | |
| cloudnull | evenings all | 04:15 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 04:17 |
| *** dave-mccowan has quit IRC | 04:26 | |
| *** radeks has joined #openstack-ansible | 04:38 | |
| *** jappleii__ has joined #openstack-ansible | 04:42 | |
| *** fusmu has joined #openstack-ansible | 04:43 | |
| *** jappleii__ has quit IRC | 04:43 | |
| *** threestrands_ has quit IRC | 04:44 | |
| *** udesale_ has joined #openstack-ansible | 04:45 | |
| *** fusmu has quit IRC | 04:47 | |
| *** lhinds has quit IRC | 04:58 | |
| *** portante has quit IRC | 04:58 | |
| *** pabelanger has quit IRC | 04:58 | |
| *** threestrands has joined #openstack-ansible | 05:00 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 05:07 |
| *** poopcat1 has quit IRC | 05:09 | |
| *** karthi has joined #openstack-ansible | 05:14 | |
| *** threestrands has quit IRC | 05:25 | |
| cloudnull | logan-: re the "__libc_fork THREAD_GETMEM" issue we've recently been seeing | 05:33 |
| cloudnull | I recently came across https://lists.linuxcontainers.org/pipermail/lxc-users/2017-June/013493.html | 05:33 |
| cloudnull | and then http://manpages.ubuntu.com/manpages/bionic/man7/namespaces.7.html | 05:33 |
| cloudnull | IDK if this will come across as double, so sorry for the spam if so... bouncer just rebooted. | 05:35 |
| cloudnull | logan-: re the "__libc_fork THREAD_GETMEM" issue we've recently been seeing | 05:35 |
| cloudnull | I recently came across https://lists.linuxcontainers.org/pipermail/lxc-users/2017-June/013493.html | 05:36 |
| cloudnull | and then http://manpages.ubuntu.com/manpages/bionic/man7/namespaces.7.html | 05:36 |
| cloudnull | from bionic which shows quite a few new namespace params we could tune / manage in the kernel | 05:36 |
| cloudnull | once we get to bionic, however it would seem the THREAD_MEM issue is tightly related to clone | 05:37 |
| *** ansmith has quit IRC | 05:37 | |
| cloudnull | so to resolve this in earlier kernels we might be able to simply bump the pid_max (/proc/sys/kernel/pid_max) to 64k on infra nodes (nodes running containers) to resolve this issue. | 05:38 |
| cloudnull | all that said, it looks like a bug in glibc https://sourceware.org/bugzilla/show_bug.cgi?id=15392 | 05:53 |
| openstack | sourceware.org bug 15392 in nptl "Linux, setns, PID namespaces, fork: assert() about pid inequality hit sporadically" [Minor,Resolved: fixed] - Assigned to unassigned | 05:53 |
| cloudnull | so there may just be no way around it, which may have also been the source of the lxc-attach hang we've seen before and now using nsenter we're just seeing the assertion error instead of silently failing. | 05:55 |
| *** pcaruana has joined #openstack-ansible | 05:57 | |
| cloudnull | fixed in 2.25 we have 2.23 in xenial http://paste.openstack.org/show/694602/ | 05:58 |
| *** karthi has quit IRC | 06:03 | |
| *** masber has joined #openstack-ansible | 06:03 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 06:06 |
| cloudnull | ^ added a retry when the bug is encountered | 06:08 |
| *** pcaruana has quit IRC | 06:08 | |
| cloudnull | logan-: thanks again for finding and sharing the link to https://sourceware.org/bugzilla/show_bug.cgi?id=21386 I think that closes the loop on that for now :) | 06:09 |
| openstack | sourceware.org bug 21386 in nptl "Assertion in fork for distinct parent PID is incorrect" [Normal,Resolved: fixed] - Assigned to fweimer | 06:09 |
| *** karthi has joined #openstack-ansible | 06:20 | |
| *** chyka has joined #openstack-ansible | 06:23 | |
| *** chyka has quit IRC | 06:27 | |
| *** karthi has quit IRC | 06:37 | |
| *** karthi has joined #openstack-ansible | 06:37 | |
| *** jamesdenton has quit IRC | 06:44 | |
| *** jwitko_ has quit IRC | 06:44 | |
| *** masber has quit IRC | 06:55 | |
| *** eumel8_ has joined #openstack-ansible | 06:57 | |
| *** jwitko_ has joined #openstack-ansible | 07:00 | |
| *** eumel8_ has quit IRC | 07:01 | |
| *** clone99 has joined #openstack-ansible | 07:03 | |
| *** SimAloo has quit IRC | 07:04 | |
| *** Fritzmen has quit IRC | 07:06 | |
| *** gus has quit IRC | 07:14 | |
| cloudnull | odyssey4me: mnaser: looks like the changes for gate clean up has worked | 07:15 |
| cloudnull | however it also looks like changes upstream in the ceph ansible roles is breaking things | 07:15 |
| cloudnull | http://logs.openstack.org/42/550542/2/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/1b57d55/job-output.txt.gz#_2018-03-07_21_01_12_636644 | 07:15 |
| *** gus has joined #openstack-ansible | 07:15 | |
| cloudnull | -cc andymccr ^ | 07:15 |
| *** sar has joined #openstack-ansible | 07:19 | |
| *** Fritzmen has joined #openstack-ansible | 07:23 | |
| *** masber has joined #openstack-ansible | 07:23 | |
| *** karthi has quit IRC | 07:31 | |
| *** admin0 has joined #openstack-ansible | 07:39 | |
| *** pmannidi has quit IRC | 07:49 | |
| *** holser__ has joined #openstack-ansible | 07:50 | |
| *** ANKITA has quit IRC | 07:53 | |
| *** armaan has quit IRC | 07:56 | |
| *** armaan has joined #openstack-ansible | 07:56 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info https://review.openstack.org/550542 | 07:59 |
| *** pcaruana has joined #openstack-ansible | 08:04 | |
| *** gaoyan has joined #openstack-ansible | 08:12 | |
| *** gaoyan has quit IRC | 08:12 | |
| *** chyka has joined #openstack-ansible | 08:13 | |
| *** karthi has joined #openstack-ansible | 08:17 | |
| *** mbuil has joined #openstack-ansible | 08:17 | |
| *** chyka has quit IRC | 08:17 | |
| *** gkadam has joined #openstack-ansible | 08:27 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Add ceph-ansible library path https://review.openstack.org/550747 | 08:31 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Add ceph-ansible library path https://review.openstack.org/550749 | 08:33 |
| odyssey4me | andymccr cloudnull evrardjp ^ should do the trick - will wait for gate confirmation before combining them | 08:33 |
| *** lkoranda has quit IRC | 08:42 | |
| *** pcaruana has quit IRC | 08:43 | |
| *** fusmu has joined #openstack-ansible | 08:46 | |
| *** holser__ has quit IRC | 08:49 | |
| *** pcaruana has joined #openstack-ansible | 08:52 | |
| *** lkoranda has joined #openstack-ansible | 08:52 | |
| *** radeks has quit IRC | 08:58 | |
| *** fusmu has quit IRC | 08:59 | |
| *** holser__ has joined #openstack-ansible | 08:59 | |
| *** fusmu has joined #openstack-ansible | 09:00 | |
| *** pcaruana has quit IRC | 09:02 | |
| *** epalper has joined #openstack-ansible | 09:02 | |
| *** lkoranda has quit IRC | 09:02 | |
| *** shardy has joined #openstack-ansible | 09:03 | |
| *** holser__ has quit IRC | 09:03 | |
| *** holser__ has joined #openstack-ansible | 09:03 | |
| *** holser__ has quit IRC | 09:07 | |
| *** holser__ has joined #openstack-ansible | 09:07 | |
| *** lkoranda has joined #openstack-ansible | 09:12 | |
| *** pcaruana has joined #openstack-ansible | 09:15 | |
| *** SerenaFeng has joined #openstack-ansible | 09:21 | |
| *** SerenaFeng has quit IRC | 09:26 | |
| *** lkoranda has quit IRC | 09:30 | |
| *** jwitko_ has quit IRC | 09:31 | |
| *** pcaruana has quit IRC | 09:32 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Add ceph-ansible library path https://review.openstack.org/550747 | 09:36 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Add ceph-ansible library path https://review.openstack.org/550749 | 09:36 |
| Taseer | odyssey4me: Hi ! is zuul back to normal ? | 09:36 |
| *** lkoranda has joined #openstack-ansible | 09:39 | |
| *** pabelanger has joined #openstack-ansible | 09:41 | |
| *** lhinds has joined #openstack-ansible | 09:41 | |
| *** portante has joined #openstack-ansible | 09:41 | |
| odyssey4me | Taseer no, the tests are still broken for the integrated gate... some upstream changes in ceph-ansible have broken us, so we've got two issues at once. Working on a fix. | 09:43 |
| Taseer | odyssey4me: ok, thanks.. | 09:44 |
| *** ANKITA has joined #openstack-ansible | 09:45 | |
| *** pcaruana has joined #openstack-ansible | 09:45 | |
| *** Sha0000 has joined #openstack-ansible | 09:59 | |
| *** shardy is now known as shardy_afk | 09:59 | |
| *** jwitko_ has joined #openstack-ansible | 09:59 | |
| *** epalper has quit IRC | 10:03 | |
| *** epalper has joined #openstack-ansible | 10:03 | |
| *** Sha0000 has quit IRC | 10:08 | |
| *** karthi has quit IRC | 10:10 | |
| *** radeks has joined #openstack-ansible | 10:14 | |
| andymccr | odyssey4me: good catch, thats pretty sucky | 10:21 |
| *** electrofelix has joined #openstack-ansible | 10:28 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and include ceph-ansible library path https://review.openstack.org/550542 | 10:33 |
| *** karthi has joined #openstack-ansible | 10:40 | |
| *** karthi has quit IRC | 10:44 | |
| *** karthi has joined #openstack-ansible | 10:44 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 10:49 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Unpin ceph-ansible and add ceph-ansible library path https://review.openstack.org/550749 | 10:51 |
| gokhan_ | hi folks, is it possible to create multiple venvs in a role ? or I am trying wrong things:( I tried it and then run repo-build.yml but it does not create any venvs. | 10:52 |
| odyssey4me | gokhan_ no, not with the current tooling | 10:53 |
| odyssey4me | I mean, the role could create more than one - but the repo build can't | 10:53 |
| evrardjp | gokhan_: I think the right answer depends on your use case | 11:03 |
| evrardjp | what are you trying to achieve? | 11:03 |
| *** epalper has quit IRC | 11:04 | |
| *** epalper has joined #openstack-ansible | 11:05 | |
| gokhan_ | odyssey4me, ok thanks. evrardjp, I want to install my notification service on horizon containers. I tried it with changing horizon role and on there also tried to create a new venv for my notification service | 11:06 |
| odyssey4me | gokhan_ better to create a role specifically for that, then just have it execute against the horizon containers | 11:06 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 11:08 |
| evrardjp | gokhan_: there is an alternative to what odyssey4me said | 11:08 |
| evrardjp | Have a way to override the packages that need installing into the horizon venv | 11:09 |
| evrardjp | this way you'll build them into the repo build, and use them into the venv | 11:09 |
| evrardjp | but that needs to be pip installable | 11:09 |
| gokhan_ | odyssey4me, ok you mean create a role for myservice and then in env.d directory define it belongs to dashboard containers | 11:11 |
| *** kysse_ is now known as kysse | 11:12 | |
| evrardjp | gokhan_: yes | 11:12 |
| gokhan_ | evrardjp odyssey4me, ok thanks I will try first way :) | 11:14 |
| *** chhagarw has joined #openstack-ansible | 11:15 | |
| *** chhavi__ has joined #openstack-ansible | 11:15 | |
| odyssey4me | gokhan_ you won't need an env.d entry at all, unless you need to create more groups for the service | 11:15 |
| evrardjp | fair point | 11:16 |
| odyssey4me | if you just need to install something into the horizon containers, then your playbook just needs to use the horizon group | 11:16 |
| odyssey4me | for the repo build to prepare a venv, you'll need this in your role: https://github.com/openstack/openstack-ansible-os_horizon/blob/master/defaults/main.yml#L331-L335 | 11:17 |
| odyssey4me | and you'll need to ensure that the role name is prefixed by os_ | 11:17 |
| gokhan_ | odyssey4me, ok now I exactly got it :) thanks a lot :) | 11:21 |
| openstackgerrit | wangqi proposed openstack/openstack-ansible-os_sahara master: Update links in README https://review.openstack.org/550784 | 11:24 |
| *** udesale__ has joined #openstack-ansible | 11:25 | |
| *** udesale_ has quit IRC | 11:27 | |
| *** karthi has quit IRC | 11:31 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 11:36 |
| *** udesale__ has quit IRC | 11:36 | |
| mnaser | morning | 11:38 |
| *** karthi has joined #openstack-ansible | 11:39 | |
| evrardjp | morning mnaser | 11:39 |
| * mnaser is still sick from Dublin :( | 11:40 | |
| evrardjp | mnaser: same. Fever is gone though, but I still feel a little dizzy | 11:40 |
| evrardjp | you? | 11:40 |
| evrardjp | too much guiness? :p | 11:41 |
| mnaser | I didn’t drink at all actually! It was just a flu or cold or whatever it is | 11:43 |
| mnaser | Throat, congested, always tired | 11:43 |
| mnaser | And I can’t escape the snow. https://usercontent.irccloud-cdn.com/file/LfZ1JNn5/1520509421.JPG | 11:43 |
| evrardjp | haha it seems so | 11:44 |
| evrardjp | nothing is blocked in your place though :p | 11:44 |
| *** karthi has quit IRC | 11:44 | |
| evrardjp | cloudnull: could you ping me when you're here? | 11:45 |
| hwoarang | seems like the latest openstack sdk has issues with self-signed certs | 11:45 |
| hwoarang | https://bugs.launchpad.net/python-openstacksdk/+bug/1754302 | 11:45 |
| openstack | Launchpad bug 1754302 in OpenStack SDK "openstacksdk-0.12.0 breaks with self-signed certificates" [Undecided,New] | 11:45 |
| evrardjp | oh :( | 11:45 |
| evrardjp | great | 11:45 |
| hwoarang | fyi... we may have to adjust requiremetns or something | 11:45 |
| evrardjp | yeah | 11:45 |
| evrardjp | add a pin | 11:45 |
| evrardjp | is that bumped into requirements ? | 11:45 |
| mnaser | I don’t think that will take too long to fix | 11:47 |
| evrardjp | for us it's a one liner. | 11:49 |
| evrardjp | :) | 11:49 |
| evrardjp | but not worth having a one liner if that gets fixed quick upstream | 11:49 |
| evrardjp | hwoarang: where did you see that? | 11:50 |
| hwoarang | in the opnfv xci with queens | 11:50 |
| hwoarang | but it should be visible in AIO/queens too i think | 11:50 |
| hwoarang | since we have self-signed certificates there | 11:50 |
| hwoarang | you can try 'openstack network list' for example | 11:51 |
| mnaser | The reason I think it’ll be fixed quick is that I only can assume every project is broken right now. | 11:51 |
| evrardjp | hwoarang: we have other issues in queens right now | 11:51 |
| evrardjp | that's why we didn't see it | 11:52 |
| evrardjp | hwoarang: will check because queens should be following the proper u-c, and therefore shouldn't bump like that | 11:52 |
| evrardjp | mnaser: yes that's what I understood with your comment. But in stable branches, u-c are computed, and we don't bump things litely | 11:53 |
| evrardjp | lightly* | 11:53 |
| *** ANKITA has quit IRC | 11:53 | |
| evrardjp | hwoarang: https://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt#L411 | 11:53 |
| evrardjp | that's not normal we are pulling 0.12 | 11:54 |
| evrardjp | in q | 11:54 |
| evrardjp | where did you see that? | 11:54 |
| evrardjp | :D | 11:54 |
| evrardjp | maybe you found THE thing I was looking for a while. | 11:54 |
| hwoarang | hmm | 11:54 |
| hwoarang | i wonder why we pullsed 0.12.0 | 11:55 |
| hwoarang | *pulled | 11:55 |
| *** shardy_afk is now known as shardy | 11:59 | |
| evrardjp | exactly | 12:00 |
| evrardjp | if you have a log, that would be great | 12:00 |
| *** jamesdenton has joined #openstack-ansible | 12:01 | |
| *** jwitko_ has quit IRC | 12:04 | |
| evrardjp | thanks mbuil for being core on os_neutron, os_tacker, and os_congress | 12:06 |
| evrardjp | I should say congratulations! | 12:08 |
| *** radeks has quit IRC | 12:12 | |
| hwoarang | that's great news! | 12:13 |
| odyssey4me | hmm, we won't see it in our AIO/tests because we use the internal endpoint - not public (where the cert is) | 12:14 |
| evrardjp | odyssey4me: maybe but it's still bad if you exceed upper constraints of the branch :p | 12:14 |
| mbuil | evrardjp: thanks. I will try to help as much as possible | 12:17 |
| hwoarang | yep no clue why the upper constraints is not being respected | 12:17 |
| hwoarang | will look into it | 12:17 |
| *** Sha0000 has joined #openstack-ansible | 12:24 | |
| * fdegir congratulates mbuil as well | 12:24 | |
| *** SmearedBeard has joined #openstack-ansible | 12:25 | |
| evrardjp | thanks ofc to previous ones I didn't advertise on the channel: mugsie now core on openstack-ansible-os_designate, and mnaser now core on the roles of the telemetry stack | 12:26 |
| *** portante_ has joined #openstack-ansible | 12:27 | |
| mnaser | :) | 12:27 |
| *** masuberu has joined #openstack-ansible | 12:27 | |
| *** pabelanger_ has joined #openstack-ansible | 12:27 | |
| *** lhinds|out has joined #openstack-ansible | 12:27 | |
| *** pabelanger has quit IRC | 12:29 | |
| *** Smeared_Beard has joined #openstack-ansible | 12:29 | |
| fdegir | mnaser: it was nice meeting you last week | 12:30 |
| *** portante has quit IRC | 12:30 | |
| *** portante_ is now known as portante | 12:30 | |
| fdegir | mnaser: and I must say I'm impressed with the level of support you are providing to ODL folks | 12:30 |
| *** masber has quit IRC | 12:31 | |
| *** lhinds has quit IRC | 12:31 | |
| *** SmearedBeard has quit IRC | 12:32 | |
| mnaser | fdegir: oh, I was hoping to ask about you, we didn’t get a chance to formally meet! | 12:32 |
| fdegir | mnaser: I was the guy who stood during foundation infra ci/cd and complained all the time | 12:33 |
| mnaser | fdegir: thank you :) if you ever need anything at all, please feel free to reach out! | 12:33 |
| mnaser | fdegir: I figured just as much! :p | 12:33 |
| openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/newton: Update all SHAs for 14.2.17 https://review.openstack.org/550813 | 12:34 |
| fdegir | mnaser: will keep your offer in mind, thanks | 12:34 |
| mnaser | fdegir: we’re very “if our customers stuff isn’t working, then our stuff isn’t working either” .. no problem, anytime :) | 12:34 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:08 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:09 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:10 |
| *** admin0 has quit IRC | 13:10 | |
| *** pabelanger_ is now known as pabelanger | 13:10 | |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:13 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:14 |
| *** udesale has joined #openstack-ansible | 13:24 | |
| *** woodard has quit IRC | 13:25 | |
| *** woodard has joined #openstack-ansible | 13:25 | |
| *** holser__ has quit IRC | 13:27 | |
| *** holser__ has joined #openstack-ansible | 13:28 | |
| *** karthi has joined #openstack-ansible | 13:29 | |
| *** udesale has quit IRC | 13:31 | |
| *** udesale has joined #openstack-ansible | 13:31 | |
| *** gameon has joined #openstack-ansible | 13:36 | |
| *** SerenaFeng has joined #openstack-ansible | 13:36 | |
| *** karthi has quit IRC | 13:36 | |
| hwoarang | mnaser: do you plan to submit a spec for binary installations? | 13:41 |
| mnaser | hwoarang: need to find a bit of time to do that, if you'd like to draft up the first steps of it, please feel free! | 13:41 |
| hwoarang | the topic highly interests me but i am super busy so i wanted to check. i will prob ping you end of next week again and start drafting something up if you haven't done it already | 13:42 |
| mhayden | buenos dias | 13:47 |
| *** dave-mccowan has joined #openstack-ansible | 13:48 | |
| openstackgerrit | Ramon Orru proposed openstack/openstack-ansible-ops master: Fixing typo https://review.openstack.org/550838 | 13:49 |
| openstackgerrit | Ramon Orru proposed openstack/openstack-ansible-ops master: Using cluster_metrics host as default output https://review.openstack.org/550839 | 13:49 |
| openstackgerrit | Ramon Orru proposed openstack/openstack-ansible-ops master: Moving telegraf-plugins to drop them properly https://review.openstack.org/550840 | 13:49 |
| *** gameon has quit IRC | 13:50 | |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Remove kernel modules: scsi_dh + x_tables https://review.openstack.org/549754 | 13:53 |
| *** lbragstad has joined #openstack-ansible | 13:54 | |
| *** kstev has joined #openstack-ansible | 13:57 | |
| *** karthi has joined #openstack-ansible | 13:57 | |
| *** kstev1 has joined #openstack-ansible | 14:01 | |
| *** kstev has quit IRC | 14:01 | |
| *** karthi has quit IRC | 14:02 | |
| *** Sha0000 has quit IRC | 14:03 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-openstack_hosts stable/queens: Remove kernel modules: scsi_dh + x_tables https://review.openstack.org/550845 | 14:06 |
| mhayden | hwoarang: still trying to figure out why https://review.openstack.org/#/c/550102/ fails on SUSE | 14:07 |
| mhayden | something about the /etc/cron.d/sysstat is not working right -- i thought maybe the permissions were wrong | 14:08 |
| mhayden | it keeps trying to set something for that cron file other than the content of the file itself, because the checksums match | 14:08 |
| mhayden | for centos, it was that it expects different file perms | 14:08 |
| mhayden | but i'm using 0644 for suse | 14:08 |
| hwoarang | hmm | 14:10 |
| mhayden | hwoarang: i'm spinning up an opensuse instance on my cloud to gander | 14:11 |
| mhayden | making openstack_hosts idempotent has been -- less than fun | 14:12 |
| odyssey4me | mhayden hwoarang it seems prudent to port https://review.openstack.org/#/q/topic:bug/1750665+(status:open+OR+status:merged) back to queens/pike - your thoughts? | 14:13 |
| hwoarang | mhayden: ExecStart=/bin/ln -fs /etc/sysstat/sysstat.cron /etc/cron.d/sysstat | 14:13 |
| hwoarang | sneaky | 14:13 |
| hwoarang | that's in the systemd service file | 14:13 |
| mhayden | odyssey4me: agreed | 14:13 |
| mhayden | hwoarang: oh wait what now? | 14:13 |
| mhayden | do we even need the cron file for opensuse? | 14:13 |
| hwoarang | odyssey4me: yep | 14:14 |
| mhayden | odyssey4me: you want to mash buttons or should i? | 14:14 |
| odyssey4me | if mhayden can review that galera_server one, then we can port them back in a batch | 14:14 |
| odyssey4me | I'm happy to port them combined once the galera_server one is merged | 14:15 |
| mhayden | done | 14:15 |
| *** SerenaFeng has quit IRC | 14:15 | |
| *** throwsb1 has joined #openstack-ansible | 14:15 | |
| hwoarang | mhayden: probably not because we symlink it from elsewhere and we delete the symlink when the service is stopped | 14:15 |
| hwoarang | don't know why it's like that | 14:15 |
| hwoarang | :/ | 14:15 |
| hwoarang | mhayden: maybe you can change the task a bit to 'state: link' for suse? | 14:16 |
| *** SerenaFeng has joined #openstack-ansible | 14:16 | |
| hwoarang | possibly a new task... | 14:16 |
| hwoarang | mhayden: wait, you can put the template file in /etc/sysstat/sysstat.cron | 14:17 |
| hwoarang | instead of /etc/cron.d/. then it should work fine | 14:17 |
| *** Sha000000 has joined #openstack-ansible | 14:17 | |
| mhayden | hwoarang: so something in systemd does the linking for you? | 14:19 |
| mhayden | wow, that would have taken me a lot of digging to find | 14:19 |
| hwoarang | yep the systemd service symlinks the cron file from /etc/sysstat/ to /etc/cron.d/ | 14:19 |
| mhayden | okay, i can do that | 14:20 |
| hwoarang | that doesn't seem right but it is what it is ;p | 14:20 |
| *** ansmith has joined #openstack-ansible | 14:21 | |
| * mhayden scurries off to test | 14:22 | |
| mhayden | hwoarang: what's the default permissions on /etc/sysstat/sysstat.cron on your box? | 14:27 |
| hwoarang | 644 | 14:27 |
| *** armaan has quit IRC | 14:33 | |
| *** armaan has joined #openstack-ansible | 14:33 | |
| mhayden | hwoarang: Idempotence test: pass | 14:38 |
| mhayden | AND THERE WAS MUCH REJOICING | 14:38 |
| hwoarang | sweet :) | 14:38 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-openstack_hosts master: Make role idempotent https://review.openstack.org/550102 | 14:38 |
| mhayden | hwoarang: ^^ | 14:38 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Fix openstack_host_module_file typo https://review.openstack.org/550549 | 14:39 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-openstack_hosts stable/queens: Fix openstack_host_module_file typo https://review.openstack.org/550852 | 14:39 |
| *** jwitko has joined #openstack-ansible | 14:39 | |
| evrardjp | mhayden: :) | 14:42 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server master: vars: Switch to galera HTTP server on all distros https://review.openstack.org/549171 | 14:44 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550853 | 14:46 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550854 | 14:46 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Allow Galera package downloads over HTTP https://review.openstack.org/550856 | 14:50 |
| mhayden | evrardjp: just replied in https://review.openstack.org/550102 | 14:50 |
| *** sar has quit IRC | 14:50 | |
| mhayden | cloudnull: if you get time to look at https://review.openstack.org/550135 -- that'd be great :) | 14:51 |
| mhayden | evrardjp: i am happy to break up the openstack_hosts idempotency review into multiple patches if it makes things easier | 14:52 |
| *** ThomasS has quit IRC | 14:52 | |
| evrardjp | mhayden: I am just surprised | 14:52 |
| mhayden | surprised at the poor patch quality? | 14:53 |
| mhayden | :) | 14:53 |
| openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client stable/pike: Allow Galera package downloads over HTTP https://review.openstack.org/550857 | 14:53 |
| evrardjp | mhayden: I am surprised we can't do this in an idempotent manner | 14:53 |
| evrardjp | we should have a thing that's omitting giving filename | 14:54 |
| *** masber has joined #openstack-ansible | 14:56 | |
| evrardjp | mhayden: my understanding was: If you remove repo X you have multiple choices: | 14:57 |
| evrardjp | without filename it would remove it from anywhere | 14:57 |
| evrardjp | with filename it would remove it from filename | 14:57 |
| evrardjp | the second item of the _package_repos list is maybe wrong | 14:58 |
| *** masuberu has quit IRC | 14:59 | |
| evrardjp | so you're telling me with filename it removes it from anywhere? | 14:59 |
| evrardjp | that would explain the break of idempotency | 14:59 |
| evrardjp | let me read | 14:59 |
| *** lhinds|out is now known as lhinds | 15:02 | |
| evrardjp | that's not what I wanted to say | 15:02 |
| odyssey4me | it may be better to stats the file, then use the conditional to say delete any source by that name unless it's the right file name | 15:02 |
| evrardjp | I wanted to say | 15:02 |
| evrardjp | "please allow me to read the apt_repository code real quick" | 15:02 |
| *** hamzy has quit IRC | 15:05 | |
| *** esberglu has joined #openstack-ansible | 15:10 | |
| mhayden | haha | 15:11 |
| mhayden | evrardjp: the problem i had is that the task was removing the queens UCA repo no matter what filename it was in | 15:11 |
| mhayden | so if you say "remove queens repo from file called com_ubuntu_whatever", it will remove that repo from any file it finds | 15:12 |
| mhayden | so the task was removing the queens repo from the new uca file | 15:12 |
| mhayden | then adding it right back | 15:12 |
| mhayden | so it always showed as changed | 15:12 |
| mhayden | perhaps that's a bug in apt_repository | 15:12 |
| odyssey4me | mhayden can we make it smarter using a stat to check whether the right filename exists, then to disable the removal task if thee right file exists? or something to that effect | 15:13 |
| mhayden | odyssey4me: i just added a task that removes those files :) | 15:13 |
| mhayden | so if they're not there, it gets skipped | 15:13 |
| odyssey4me | otherwise perhaps we should do the complicated thing we do in the galera_client repo | 15:13 |
| mhayden | and the right repo gets added right after | 15:13 |
| *** kstev1 has quit IRC | 15:14 | |
| evrardjp[m] | exactly what i meant :) | 15:15 |
| cloudnull | evrardjp: ping | 15:16 |
| cloudnull | mhayden: looking | 15:16 |
| cloudnull | odyssey4me: those prs look good to me, are you going to combine them ? | 15:17 |
| hwoarang | mhayden: should ests/roles/bootstrap-host/vars/redhat.yml in the integration repo switch to Queens? | 15:18 |
| hwoarang | *tests/roles/bootstrap-host/vars/redhat.yml | 15:18 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Simplify SELinux check https://review.openstack.org/550215 | 15:19 |
| odyssey4me | cloudnull the pike patches are combined - the queens patches already have the first set merged, so no combining required | 15:21 |
| *** masber has quit IRC | 15:22 | |
| evrardjp | mhayden: I think your patch is nice, and I won't block it based on the fact we can make it better. | 15:25 |
| odyssey4me | how gracious ;) | 15:26 |
| evrardjp | lol | 15:27 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: tests: bootstrap-host: Switch to Queens repo for SUSE and Red Hat https://review.openstack.org/550870 | 15:27 |
| evrardjp | do I speak like an *** all the time, and you are just very patient/friendly with me? | 15:28 |
| evrardjp | I am trying you know | 15:28 |
| *** woodard has quit IRC | 15:28 | |
| mhayden | evrardjp: i just read your comments with a french accent and then i'm all good | 15:29 |
| odyssey4me | roflmao | 15:29 |
| *** woodard has joined #openstack-ansible | 15:29 | |
| evrardjp | mhayden: :) | 15:30 |
| *** hamzy has joined #openstack-ansible | 15:30 | |
| d34dh0r53 | lmao | 15:30 |
| * mhayden hugs evrardjp | 15:31 | |
| mhayden | i'm going to miss you guys :| | 15:31 |
| mhayden | even d34dh0r53 | 15:31 |
| mhayden | yes, even d34dh0r53 | 15:31 |
| d34dh0r53 | awww :(... | 15:32 |
| * mhayden still needs to write that openstack-dev email but he keeps putting it off | 15:32 | |
| mhayden | my eyes get wet when i try to write it | 15:33 |
| *** kstev has joined #openstack-ansible | 15:33 | |
| mhayden | evrardjp: but no, you don't talk like an *** | 15:33 |
| mhayden | you're just very direct, and that frightens some americans :) | 15:33 |
| *** Sha000000 has quit IRC | 15:34 | |
| mhayden | but i like direct people | 15:34 |
| mhayden | like when hughsaunders reviews my patch and says "this part here is rubbish" | 15:34 |
| mhayden | it drives the point home -- i can feel what he's feeling ;) | 15:35 |
| *** hamzy has quit IRC | 15:35 | |
| mhayden | hwoarang: opensuse's red bash prompt for root is intimidating ;) | 15:36 |
| shananigans | Anyway I can get someone else to check this one out? https://review.openstack.org/#/c/550539/ I just had someone else hit me up with networking issues on the gateway network for osa-ops mnaio deploys. | 15:38 |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: test-prepare-host: Switch package state to 'present' on openSUSE https://review.openstack.org/550878 | 15:39 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_client stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550854 | 15:40 |
| *** hamzy has joined #openstack-ansible | 15:41 | |
| hwoarang | mhayden: lol ;p | 15:41 |
| * hwoarang senses that mhayden is going somewhere... | 15:42 | |
| spotz | shananigans: looking | 15:42 |
| shananigans | Thanks | 15:42 |
| spotz | shananigans: done | 15:43 |
| *** Smeared_Beard has quit IRC | 15:43 | |
| *** chhagarw has quit IRC | 15:44 | |
| *** chhavi__ has quit IRC | 15:44 | |
| *** chhagarw has joined #openstack-ansible | 15:44 | |
| openstackgerrit | Merged openstack/openstack-ansible-plugins stable/queens: Reduce interactions by nearly 50% https://review.openstack.org/550156 | 15:44 |
| *** chhavi__ has joined #openstack-ansible | 15:44 | |
| *** woodard has quit IRC | 15:47 | |
| *** woodard has joined #openstack-ansible | 15:47 | |
| openstackgerrit | Merged openstack/openstack-ansible-ops master: Fix broken linuxbridge-agent config for the flat network in osa-ops mnaio https://review.openstack.org/550539 | 15:48 |
| *** Leo_m_ has quit IRC | 15:49 | |
| *** SmearedBeard has joined #openstack-ansible | 15:52 | |
| *** electrofelix has quit IRC | 15:52 | |
| *** woodard has quit IRC | 15:54 | |
| *** woodard has joined #openstack-ansible | 15:54 | |
| *** SmearedBeard has quit IRC | 15:58 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: [WIP] Simplify nodepool variable gathering https://review.openstack.org/550881 | 15:59 |
| *** kstev has quit IRC | 15:59 | |
| *** udesale has quit IRC | 15:59 | |
| *** kstev has joined #openstack-ansible | 16:02 | |
| *** pcaruana has quit IRC | 16:06 | |
| mhayden | logan-: you need a few of these in the DC now https://www.servethehome.com/lenovo-thinksystem-sd650-water-cooled-dense-hpc-applications/ | 16:08 |
| *** ThomasS has joined #openstack-ansible | 16:12 | |
| *** SmearedBeard has joined #openstack-ansible | 16:14 | |
| openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: test-prepare-host: Switch package state to 'present' on openSUSE https://review.openstack.org/550878 | 16:18 |
| *** woodard has quit IRC | 16:18 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common SystemD init role https://review.openstack.org/466179 | 16:21 |
| hwoarang | mhayden: can you merge https://review.openstack.org/#/c/548641/ with https://review.openstack.org/#/c/550870/ ? | 16:22 |
| hwoarang | mine does redhat + suse at once ;p | 16:22 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 16:23 |
| mhayden | hwoarang: looking | 16:23 |
| mhayden | hwoarang: why don't i just abandon mine | 16:24 |
| *** vnogin has joined #openstack-ansible | 16:24 | |
| hwoarang | yeah whatever works | 16:26 |
| mhayden | hwoarang: i just abandoned mine | 16:28 |
| openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550853 | 16:29 |
| *** Leo_m has joined #openstack-ansible | 16:30 | |
| *** Smeared_Beard has joined #openstack-ansible | 16:31 | |
| *** RandomTech has joined #openstack-ansible | 16:32 | |
| *** SmearedBeard has quit IRC | 16:32 | |
| mnaser | odyssey4me: wanna recheck https://review.openstack.org/#/c/550542/ perhaps? | 16:37 |
| *** Leo_m has quit IRC | 16:41 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 16:41 |
| *** Leo_m has joined #openstack-ansible | 16:42 | |
| *** chyka has joined #openstack-ansible | 16:43 | |
| *** prometheanfire has quit IRC | 16:43 | |
| mhayden | so if i download ansible.sqlite.txt.gz, sqlite3 complains about it being correupt | 16:50 |
| *** RandomTech has quit IRC | 16:50 | |
| mhayden | trying to generate an ARA report from a completed job | 16:51 |
| openstackgerrit | zhongshengping proposed openstack/openstack-ansible-os_trove stable/pike: Remove Trove's support for Heat https://review.openstack.org/550905 | 16:52 |
| *** ygl has joined #openstack-ansible | 16:55 | |
| ygl | hi all | 16:55 |
| ygl | i am facing a problem when doing a AIO install on a vm | 16:55 |
| ygl | can someone help me please | 16:55 |
| *** armaan has quit IRC | 16:55 | |
| *** RandomTech has joined #openstack-ansible | 16:56 | |
| cloudnull | ygl: what are you seeing ? | 16:56 |
| ygl | cloudnull: when I do a bootstrap like this "scripts/bootstrap-aio.sh" it is throwing this error | 16:57 |
| ygl | cloudnull: TASK [bootstrap-host : Fail if there is not enough space available in /] | 16:57 |
| ygl | cloudnull: fatal: [localhost]: FAILED! => { assertion": "(host_root_space_available_bytes | int) >= (host_data_disk_min_size_bytes | int)\n", | 16:57 |
| ygl | cloudnull: however the scripts/bootstrap-ansible.sh is scucessful | 16:58 |
| ygl | cloudnull: but there is 13 GB of space left in '/' partition | 16:58 |
| ygl | cloudnull: is this a bug ? | 16:59 |
| *** woodard has joined #openstack-ansible | 16:59 | |
| *** woodard has quit IRC | 16:59 | |
| cloudnull | I believe the base requirement is 64G of space for an AIO | 16:59 |
| * cloudnull looking | 16:59 | |
| ygl | cloudnull: is it ? | 17:00 |
| *** woodard has joined #openstack-ansible | 17:00 | |
| ygl | cloudnull: but they haven't mentioned here https://docs.openstack.org/openstack-ansible/queens/contributor/quickstart-aio.html | 17:00 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/3ce37a347adb343fe6f493724b22c4846a1163a1/tests/roles/bootstrap-host/tasks/check-requirements.yml#L69-L82 | 17:02 |
| cloudnull | and | 17:03 |
| cloudnull | https://github.com/openstack/openstack-ansible/blob/25b671e344f0f71a99406eedccf749f42e8fd9ec/tests/roles/bootstrap-host/defaults/main.yml#L213 | 17:03 |
| cloudnull | looks like 50G | 17:03 |
| ygl | cloudnull: ok let me increase the disk size and try again | 17:03 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts stable/queens: Remove kernel modules: scsi_dh + x_tables https://review.openstack.org/550845 | 17:03 |
| *** chyka_ has joined #openstack-ansible | 17:04 | |
| *** vnogin has quit IRC | 17:07 | |
| *** chyka has quit IRC | 17:07 | |
| *** gkadam has quit IRC | 17:12 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Archive ARA report on successful jobs https://review.openstack.org/550956 | 17:16 |
| *** fusmu has quit IRC | 17:17 | |
| *** eumel8 has joined #openstack-ansible | 17:22 | |
| *** epalper has quit IRC | 17:23 | |
| *** holser__ has quit IRC | 17:24 | |
| *** mbuil has quit IRC | 17:26 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Archive ARA report on successful jobs https://review.openstack.org/550962 | 17:29 |
| *** ivve has joined #openstack-ansible | 17:31 | |
| *** SerenaFeng has quit IRC | 17:45 | |
| RandomTech | hey is anyone here able to help me troubleshoot an issue with running the playbooks | 17:46 |
| RandomTech | "galera_server : Restart mysql fall back" is failing and im not sure why | 17:46 |
| *** ivve has quit IRC | 17:55 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Update the test path for plugins https://review.openstack.org/549204 | 17:56 |
| *** armaan has joined #openstack-ansible | 17:56 | |
| *** radeks has joined #openstack-ansible | 17:59 | |
| *** holser__ has joined #openstack-ansible | 18:03 | |
| *** jwitko_ has joined #openstack-ansible | 18:06 | |
| *** jwitko_ has quit IRC | 18:08 | |
| *** jwitko_ has joined #openstack-ansible | 18:08 | |
| odyssey4me | cloudnull mind giving https://review.openstack.org/#/q/topic:bug/1750665-stable/pike+(status:open+OR+status:merged) a nudge? | 18:08 |
| RandomTech | anyone here familar with the galera install? | 18:09 |
| odyssey4me | ygl https://docs.openstack.org/openstack-ansible/queens/contributor/quickstart-aio.html says pretty clearly in the requirements that 50G is required | 18:09 |
| odyssey4me | 50G free | 18:09 |
| *** jwitko has quit IRC | 18:10 | |
| *** radeks has quit IRC | 18:13 | |
| *** jwitko_ has quit IRC | 18:13 | |
| *** chhagarw has quit IRC | 18:15 | |
| *** chhavi__ has quit IRC | 18:15 | |
| *** radeks has joined #openstack-ansible | 18:18 | |
| *** hamza21 has joined #openstack-ansible | 18:18 | |
| *** Smeared_Beard has quit IRC | 18:18 | |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: Improve idempotency https://review.openstack.org/550135 | 18:22 |
| *** ygl has quit IRC | 18:26 | |
| *** Leo_m_ has joined #openstack-ansible | 18:29 | |
| *** Leo_m has quit IRC | 18:32 | |
| *** Leo_m_ has quit IRC | 18:33 | |
| *** Fritzmen has quit IRC | 18:47 | |
| *** jwitko has joined #openstack-ansible | 18:49 | |
| RandomTech | hey odyssey4me do you have a moment? | 18:55 |
| odyssey4me | RandomTech some, what's up? | 18:55 |
| RandomTech | im having an issue with the galera container during setup-infrastructure.yml that im having trouble figuring out | 18:56 |
| *** poopcat has joined #openstack-ansible | 18:56 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 18:59 |
| RandomTech | heres a link with the failed task and the error i found in galera_server_error.log odyssey4me : http://paste.openstack.org/show/695625/ | 19:00 |
| RandomTech | i seperated them with a dashed line | 19:00 |
| *** woodard has quit IRC | 19:00 | |
| RandomTech | if you could take a look it would be really appriciated | 19:00 |
| *** Fritzmen has joined #openstack-ansible | 19:00 | |
| RandomTech | weve been having trouble with this error for a few days now | 19:01 |
| odyssey4me | RandomTech what tag/release/branch are you using? | 19:02 |
| RandomTech | we are attempting to use pike | 19:02 |
| RandomTech | following the instructions here: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/ | 19:02 |
| RandomTech | weve been at this for a few months now honestly | 19:03 |
| odyssey4me | RandomTech there was a version of mariadb which was borked, but we patched that up real quick - you might have been caight in the middle somewhere | 19:04 |
| RandomTech | will we need to reinstall the os? or will just pulling down osa again work? | 19:04 |
| odyssey4me | if you do 'git log' in /opt/openstack-ansible then what's the top-most SHA? | 19:04 |
| *** woodard has joined #openstack-ansible | 19:05 | |
| odyssey4me | also, do "grep -r '^openstack_release' * and let me know the version it gives | 19:06 |
| RandomTech | what does SHA stand for again? | 19:07 |
| odyssey4me | the SHA is the long hex, something like: commit f94c4b90629bb34638035e575596feea0b14fe63 | 19:08 |
| RandomTech | here you go: http://paste.openstack.org/show/695640/ | 19:09 |
| RandomTech | i sperated tem by a dashed line again | 19:09 |
| odyssey4me | RandomTech yep, you're hitting this issue: https://github.com/openstack/openstack-ansible/commit/0e0819bb1c3782045c8a539bf04f4e92d019224d | 19:11 |
| odyssey4me | RandomTech better to checkout 16.0.9, then rebootstrap-ansible | 19:12 |
| RandomTech | so pull down 16.0.9 and then rerun bootstrap? | 19:12 |
| odyssey4me | you'll have to destroy the galera_server containers if there's no data in there you care about... otherwise you'll have to uninstall the existing packages and remove the repositories | 19:13 |
| odyssey4me | basically the mariadb version used is very broken when used in a cluster | 19:13 |
| RandomTech | im fine with running lxc-containers destroy | 19:13 |
| RandomTech | this things never been setup fully | 19:13 |
| odyssey4me | it does take some time to get the initial config right for your use-case | 19:14 |
| RandomTech | i definately figured that out | 19:14 |
| odyssey4me | that's why we recommend having a good test environment where you can wipe and rebuild quickly | 19:14 |
| RandomTech | sadly we do not | 19:14 |
| RandomTech | it can take us a few hours to reinstall but its fairly doable | 19:15 |
| odyssey4me | if you have a single host, with 64GB RAM and some disk - then you can use https://github.com/openstack/openstack-ansible-ops/tree/master/multi-node-aio | 19:15 |
| *** SmearedBeard has joined #openstack-ansible | 19:15 | |
| odyssey4me | more memory is better, of course | 19:15 |
| RandomTech | sadly im having to reuse old blades that fell out of a previose cluster | 19:17 |
| RandomTech | your saying we should reinstall though? | 19:17 |
| RandomTech | if so we can do that itll just take time | 19:17 |
| odyssey4me | RandomTech no, just ditching the galera_server containers and rebuilding them will be fine | 19:18 |
| RandomTech | oh okay | 19:18 |
| odyssey4me | assuming the install stopped there, even the client won't be installed anywhere else | 19:18 |
| RandomTech | oh yay odyssey4me i noticed the documentation is having me pull 16.0.8 should i pull 16.0.9 instead? | 19:18 |
| odyssey4me | RandomTech odd, I guess the docs didn't publish quite right - where're you seeing that? | 19:19 |
| RandomTech | here: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/deploymenthost.html | 19:19 |
| RandomTech | the page is listed as 16.0.9 but says to pull 16.0.8 | 19:20 |
| RandomTech | ive noticed this with previose versions as well | 19:20 |
| RandomTech | heres a better link odyssey4me : https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/deploymenthost.html#install-the-source-and-dependencies | 19:21 |
| odyssey4me | RandomTech hmm, that's a bug if it's been consistent like that | 19:21 |
| RandomTech | i think ive brought it up before but was told to just use the one listed | 19:21 |
| odyssey4me | RandomTech ah ok - I understand how this happened | 19:23 |
| odyssey4me | this was released in the last 24 hours, and not a single patch has merged since | 19:23 |
| odyssey4me | the docs are published after any merge | 19:23 |
| odyssey4me | so this is usually a brief state | 19:23 |
| RandomTech | i should be fine pulling 16.0.9 then? | 19:24 |
| odyssey4me | yes, absolutely | 19:24 |
| RandomTech | just destroyed containers, deleted /opt/openstack-ansible/ and pulled the new one | 19:26 |
| RandomTech | running the new bootstrap now | 19:27 |
| RandomTech | thanks again odyssey4me. hopefully it works correctly now | 19:28 |
| * odyssey4me hopes so too :) | 19:28 | |
| RandomTech | now that ive run bootstrap i should be able to start running setup-hosts.yml again correct? | 19:29 |
| odyssey4me | RandomTech yep | 19:30 |
| RandomTech | sounds good :) | 19:30 |
| odyssey4me | cloudnull I'm still seeing disk space problems on some tests, quite randomly it seems - the host has 80GB, and it seems the fail is when doing things in containers | 19:31 |
| odyssey4me | do we have any machinectl info for the integrated build job logs | 19:31 |
| *** woodard has quit IRC | 19:35 | |
| *** woodard has joined #openstack-ansible | 19:36 | |
| *** prometheanfire has joined #openstack-ansible | 19:41 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Archive ARA report on successful jobs https://review.openstack.org/550962 | 19:43 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Archive ARA report on successful jobs https://review.openstack.org/550956 | 19:44 |
| jrosser | any ideas on this? local test failure in os_keystone 'vagrant up ubuntu1604' http://paste.openstack.org/show/695690/ | 19:46 |
| evrardjp | jrosser: your role is named openstack-ansible-plugins instead of plugins? It depends on your git clone I guess? | 19:48 |
| jrosser | well - i just cloned the repo off github, did a little tweak and tried to test it in vagrant | 19:49 |
| jrosser | just to be super clear its the openstack-ansible-os_keystone test i'm trying | 19:50 |
| *** holser__ has quit IRC | 19:51 | |
| cloudnull | jrosser: if testing master this was a recent issue we just resolved. https://review.openstack.org/#/c/549204/ | 19:52 |
| evrardjp | jrosser: yup see ^ | 19:52 |
| odyssey4me | jrosser https://review.openstack.org/549204 just merged - remove tests/common and re-run run_tests | 19:52 |
| evrardjp | vagrant destroy; vagrant up | 19:52 |
| jrosser | ooh right yes that looks like it | 19:53 |
| jrosser | thanks! | 19:53 |
| *** radeks_ has joined #openstack-ansible | 19:57 | |
| *** radeks has quit IRC | 19:59 | |
| RandomTech | well i need to get going odyssey4me, if i remember ill tell you how it went | 20:01 |
| odyssey4me | RandomTech hope it turns out bettwr this time - have a great evening! | 20:02 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 20:04 |
| *** RandomTech has quit IRC | 20:05 | |
| *** radeks__ has joined #openstack-ansible | 20:07 | |
| *** radeks_ has quit IRC | 20:09 | |
| *** flemingo has joined #openstack-ansible | 20:15 | |
| *** admin0 has joined #openstack-ansible | 20:18 | |
| *** radeks__ has quit IRC | 20:22 | |
| *** flemingo_ has joined #openstack-ansible | 20:25 | |
| *** flemingo has quit IRC | 20:25 | |
| *** flemingo_ has quit IRC | 20:25 | |
| *** flemingo has joined #openstack-ansible | 20:26 | |
| *** hw_wutianwei has quit IRC | 20:31 | |
| *** hw_wutianwei has joined #openstack-ansible | 20:32 | |
| mhayden | cloudnull / odyssey4me thanks for those quick looksees on those ARA patches ;) | 20:32 |
| *** Leo_m has joined #openstack-ansible | 20:35 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 20:40 |
| *** Leo_m has quit IRC | 20:40 | |
| *** Leo_m has joined #openstack-ansible | 20:40 | |
| *** woodard has quit IRC | 20:46 | |
| *** lucasxu has joined #openstack-ansible | 20:46 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 20:46 |
| *** throwsb1 has quit IRC | 20:47 | |
| *** sar has joined #openstack-ansible | 20:47 | |
| *** sawblade6 has joined #openstack-ansible | 20:50 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_client master: [WIP] Make galera_client role idempotent https://review.openstack.org/551001 | 20:51 |
| *** ansmith has quit IRC | 20:53 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_client master: [WIP] Make galera_client role idempotent https://review.openstack.org/551001 | 21:04 |
| *** masber has joined #openstack-ansible | 21:05 | |
| *** lucasxu has quit IRC | 21:09 | |
| *** prometheanfire has quit IRC | 21:12 | |
| *** prometheanfire has joined #openstack-ansible | 21:17 | |
| openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Only try to stop services that exist https://review.openstack.org/551010 | 21:18 |
| openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Make role idempotent https://review.openstack.org/550102 | 21:21 |
| *** eumel8 has quit IRC | 21:24 | |
| *** Leo_m_ has joined #openstack-ansible | 21:24 | |
| *** eumel8 has joined #openstack-ansible | 21:25 | |
| *** Leo_m has quit IRC | 21:26 | |
| *** holser__ has joined #openstack-ansible | 21:27 | |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_client master: Make galera_client role idempotent https://review.openstack.org/551001 | 21:28 |
| *** holser__ has joined #openstack-ansible | 21:29 | |
| *** eumel8 has quit IRC | 21:33 | |
| logan- | dang mhayden. wonder how much those weigh re: https://www.servethehome.com/lenovo-thinksystem-sd650-water-cooled-dense-hpc-applications/ | 21:35 |
| openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 21:36 |
| mhayden | logan-: 5 pounds? | 21:40 |
| *** sar has quit IRC | 21:45 | |
| *** threestrands has joined #openstack-ansible | 21:47 | |
| *** hamzy has quit IRC | 21:57 | |
| *** hamza21 has quit IRC | 22:00 | |
| *** kstev has quit IRC | 22:03 | |
| *** vnogin has joined #openstack-ansible | 22:08 | |
| *** holser___ has joined #openstack-ansible | 22:08 | |
| *** jra has joined #openstack-ansible | 22:10 | |
| jra | So OSA creates rsyslog containers for the service containers to syslog to; if I already have a nice highly-available infrastructure-grade syslog concentrator service set up, could I not define log_hosts and cause the service containers to log directly to that instead? | 22:11 |
| *** vnogin has quit IRC | 22:12 | |
| *** holser__ has quit IRC | 22:12 | |
| *** holser___ has quit IRC | 22:15 | |
| jrosser | jra: https://docs.openstack.org/openstack-ansible-rsyslog_client/latest/ | 22:22 |
| jra | jrosser: Thanks! | 22:22 |
| *** masber has quit IRC | 22:25 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 22:28 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: test-prepare-host: Switch package state to 'present' on openSUSE https://review.openstack.org/550878 | 22:31 |
| openstackgerrit | Merged openstack/openstack-ansible-tests master: test-log-collect.sh: Collect networkd information https://review.openstack.org/549764 | 22:31 |
| *** admin0 has quit IRC | 22:33 | |
| *** armaan has quit IRC | 22:39 | |
| *** armaan has joined #openstack-ansible | 22:39 | |
| *** esberglu_ has joined #openstack-ansible | 22:40 | |
| *** ansmith has joined #openstack-ansible | 22:41 | |
| *** Leo_m_ has quit IRC | 22:41 | |
| *** esberglu has quit IRC | 22:43 | |
| *** armaan has quit IRC | 22:49 | |
| *** armaan has joined #openstack-ansible | 22:50 | |
| jra | jrosser: so I know these are very elementary questions, but I'm just getting my bearings with OSA: once I've added an rsyslog_client_user_defined_targets stanza to user_variables, should I re-run setup-everything.yml with --tags=rsyslog to have that take effect? | 22:54 |
| *** masber has joined #openstack-ansible | 22:54 | |
| *** Leo_m has joined #openstack-ansible | 22:56 | |
| *** esberglu_ has quit IRC | 22:59 | |
| *** esberglu has joined #openstack-ansible | 23:00 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Convert role to use a common systemd init role https://review.openstack.org/551028 | 23:00 |
| jrosser | jra: rather than give you possibly bogus advice, i'd start here http://codesearch.openstack.org/?q=rsyslog_client&i=nope&files=&repos= | 23:02 |
| *** esberglu has quit IRC | 23:04 | |
| jrosser | you can see there all the places rsyslog_client gets used, and also that the tag 'rsyslog' might help you target an ansible run more accurately that just rerunning everything | 23:05 |
| jrosser | so it looks like you are on the right track | 23:06 |
| jra | Yeah, I found that tag; I guess I'm just wondering whether there's a general pattern in OSA for applying these kinds of targeted updates as opposed to just re-running everything. Running with tags=rsyslog still runs a pile of stuff, and doing the setup-hosts.yml run with tags=rsyslog seems to want to also restarge the lxc containers, which I don't really want to do. | 23:07 |
| jrosser | there are also rsyslog_client-install and rsyslog_client-config tags | 23:09 |
| jrosser | however others are better placed than me to comment on a general pattern in OSA | 23:09 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 23:13 |
| cloudnull | jra: that tag should work to update only rsyslog globally. | 23:14 |
| cloudnull | in general I will use a tag like that on a specific service when updating the user_variables | 23:15 |
| cloudnull | something like `openstack-ansible repo-server.yml --tags=rsyslog` | 23:15 |
| cloudnull | etc | 23:15 |
| cloudnull | if the change your making will impact everything you can run setup-everything with the tag and it'll do the tagged actions in all of the required places. | 23:16 |
| jra | cloudnull: that's how I expected things to work based on my non-OSA ansible experience, but it seems like there are an awful lot of "always"-tagged tasks that also run | 23:17 |
| cloudnull | yes | 23:17 |
| jra | so if I do "openstack-ansible --tags=rsyslog setup-hosts.yml", the playbook actually fails outright | 23:17 |
| cloudnull | there are quite a few always tasks | 23:17 |
| cloudnull | what is it failing on ? | 23:18 |
| jra | LXC image staging, it looks like | 23:18 |
| cloudnull | ah yea. i see. | 23:18 |
| *** esberglu has joined #openstack-ansible | 23:18 | |
| * cloudnull just confirmed that | 23:18 | |
| jra | fatal: [host04]: FAILED! => {"failed": true, "msg": "the field 'args' has an invalid value, which appears to include a variable that is undefined. The error was: 'lxc_images' is undefined\n\nThe error appears to have been in '/etc/ansible/roles/lxc_hosts/tasks/lxc_cache_prestage.yml': line 66, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n# download | 23:19 |
| cloudnull | it does fail in lxc-hosts.yml. that's a bummer. | 23:19 |
| jra | I feel like that shouldn't be an always task | 23:20 |
| cloudnull | if i comment that playbook out it seems to go | 23:20 |
| jra | dang | 23:20 |
| * cloudnull looking | 23:20 | |
| cloudnull | i think there's a missing fact that needs to be passed on | 23:20 |
| * cloudnull trying setup-infrastructure.yml with that tag now | 23:21 | |
| jra | yeah, this is always the hazard with tag-isolated runs, it's non-trivial to design stand-alone play paths | 23:21 |
| cloudnull | ++ | 23:21 |
| jra | but a full OSA run in my dev environment takes literally 3.5hrs, so I'm kinda trying to avoid that... :) | 23:22 |
| cloudnull | the tag works in infra | 23:23 |
| jra | nice | 23:23 |
| *** esberglu has quit IRC | 23:23 | |
| cloudnull | granted my test cluster is only 5 nodes | 23:23 |
| cloudnull | but it should convey the same | 23:24 |
| * cloudnull trying setup-openstack.yml | 23:24 | |
| cloudnull | setup-openstack.yml worked too | 23:26 |
| cloudnull | so we have a bug in setup-hosts. | 23:26 |
| cloudnull | jra: idk if you have a moment, but mind raising an issue for that ? | 23:30 |
| jra | cloudnull: definitely, I'll do that | 23:31 |
| jra | thanks for your help! | 23:31 |
| *** threestrands_ has joined #openstack-ansible | 23:33 | |
| *** jra has quit IRC | 23:36 | |
| *** threestrands has quit IRC | 23:36 | |
| *** jra has joined #openstack-ansible | 23:36 | |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Fix role when running with isolated tags https://review.openstack.org/551032 | 23:37 |
| cloudnull | jra: ^ | 23:37 |
| cloudnull | with that conditional tags in isolation works with setup-hosts | 23:37 |
| *** chyka has joined #openstack-ansible | 23:47 | |
| *** chyka_ has quit IRC | 23:48 | |
| jra | aha, so it's already in the works | 23:54 |
| jra | cloudnull: oh I see, and you've just authored the change. Thanks! | 23:54 |
| cloudnull | yea it should make it go , if you want to pull that in to try it out and review the pr it'd be appreciated | 23:55 |
| cloudnull | but local tests seem to be all ok now | 23:55 |
| jra | I'll give it a go | 23:55 |
| cloudnull | that was the only change i need to apply to get `openstack-ansible setup-everything.yml --tags rsyslog` working | 23:56 |
| cloudnull | but YMMV given that my test cloud is not all that big or complex | 23:56 |
| openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Convert role to use a common systemd init role https://review.openstack.org/551028 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!
