osnaya | already checked the validity of syntax for user_secrets.yml and user_variables.yml syntax thru YAML Lint | 00:00 |
---|---|---|
osnaya | @evrardjp can you please give any clues on the error above? | 00:03 |
osnaya | @evrardjp can you please give any clues on the error above? | 00:05 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 00:06 |
cloudnull | osnaya: is there a "---" at the top of those files ? | 00:08 |
osnaya | @cloudnull yes ... is that a problem? | 00:13 |
*** gunix has left #openstack-ansible | 00:17 | |
osnaya | @cloudnull I believe --- in the beginning is expected though optional. What about ... at the end of the file (is that optional or must), currently I don't have that in both of my files... | 00:23 |
*** chyka has quit IRC | 00:28 | |
osnaya | @cloudnull passed that error... found a typo.... fixed. will continue... thx | 00:36 |
*** lbragstad has quit IRC | 00:39 | |
openstackgerrit | Merged openstack/ansible-hardening master: Add check to ClamAV task to prevent simeltaneous content updates https://review.openstack.org/550268 | 00:42 |
*** zerick has quit IRC | 00:56 | |
*** zerick_ has joined #openstack-ansible | 00:56 | |
*** SerenaFeng has joined #openstack-ansible | 00:57 | |
*** SerenaFeng has quit IRC | 01:01 | |
*** osnaya has quit IRC | 01:01 | |
*** woodard has joined #openstack-ansible | 01:16 | |
*** udesale has joined #openstack-ansible | 01:56 | |
*** udesale_ has joined #openstack-ansible | 02:00 | |
*** udesale has quit IRC | 02:02 | |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 02:03 |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible master: [TEST] Update Ansible to 2.5.0rc1 https://review.openstack.org/501814 | 02:04 |
*** ANKITA has joined #openstack-ansible | 02:41 | |
*** jamesdenton has joined #openstack-ansible | 02:42 | |
openstackgerrit | ShangXiao proposed openstack/openstack-ansible-openstack_hosts master: Update the old http links in docs https://review.openstack.org/550673 | 03:06 |
*** udesale_ has quit IRC | 03:31 | |
openstackgerrit | Jimmy McCrory proposed openstack/openstack-ansible-plugins master: Fix delegation to hosts not in inventory https://review.openstack.org/550665 | 04:03 |
*** fusmu has joined #openstack-ansible | 04:08 | |
*** fusmu has quit IRC | 04:13 | |
cloudnull | evenings all | 04:15 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 04:17 |
*** dave-mccowan has quit IRC | 04:26 | |
*** radeks has joined #openstack-ansible | 04:38 | |
*** jappleii__ has joined #openstack-ansible | 04:42 | |
*** fusmu has joined #openstack-ansible | 04:43 | |
*** jappleii__ has quit IRC | 04:43 | |
*** threestrands_ has quit IRC | 04:44 | |
*** udesale_ has joined #openstack-ansible | 04:45 | |
*** fusmu has quit IRC | 04:47 | |
*** lhinds has quit IRC | 04:58 | |
*** portante has quit IRC | 04:58 | |
*** pabelanger has quit IRC | 04:58 | |
*** threestrands has joined #openstack-ansible | 05:00 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 05:07 |
*** poopcat1 has quit IRC | 05:09 | |
*** karthi has joined #openstack-ansible | 05:14 | |
*** threestrands has quit IRC | 05:25 | |
cloudnull | logan-: re the "__libc_fork THREAD_GETMEM" issue we've recently been seeing | 05:33 |
cloudnull | I recently came across https://lists.linuxcontainers.org/pipermail/lxc-users/2017-June/013493.html | 05:33 |
cloudnull | and then http://manpages.ubuntu.com/manpages/bionic/man7/namespaces.7.html | 05:33 |
cloudnull | IDK if this will come across as double, so sorry for the spam if so... bouncer just rebooted. | 05:35 |
cloudnull | logan-: re the "__libc_fork THREAD_GETMEM" issue we've recently been seeing | 05:35 |
cloudnull | I recently came across https://lists.linuxcontainers.org/pipermail/lxc-users/2017-June/013493.html | 05:36 |
cloudnull | and then http://manpages.ubuntu.com/manpages/bionic/man7/namespaces.7.html | 05:36 |
cloudnull | from bionic which shows quite a few new namespace params we could tune / manage in the kernel | 05:36 |
cloudnull | once we get to bionic, however it would seem the THREAD_MEM issue is tightly related to clone | 05:37 |
*** ansmith has quit IRC | 05:37 | |
cloudnull | so to resolve this in earlier kernels we might be able to simply bump the pid_max (/proc/sys/kernel/pid_max) to 64k on infra nodes (nodes running containers) to resolve this issue. | 05:38 |
cloudnull | all that said, it looks like a bug in glibc https://sourceware.org/bugzilla/show_bug.cgi?id=15392 | 05:53 |
openstack | sourceware.org bug 15392 in nptl "Linux, setns, PID namespaces, fork: assert() about pid inequality hit sporadically" [Minor,Resolved: fixed] - Assigned to unassigned | 05:53 |
cloudnull | so there may just be no way around it, which may have also been the source of the lxc-attach hang we've seen before and now using nsenter we're just seeing the assertion error instead of silently failing. | 05:55 |
*** pcaruana has joined #openstack-ansible | 05:57 | |
cloudnull | fixed in 2.25 we have 2.23 in xenial http://paste.openstack.org/show/694602/ | 05:58 |
*** karthi has quit IRC | 06:03 | |
*** masber has joined #openstack-ansible | 06:03 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Resolve nsenter fork exception https://review.openstack.org/550331 | 06:06 |
cloudnull | ^ added a retry when the bug is encountered | 06:08 |
*** pcaruana has quit IRC | 06:08 | |
cloudnull | logan-: thanks again for finding and sharing the link to https://sourceware.org/bugzilla/show_bug.cgi?id=21386 I think that closes the loop on that for now :) | 06:09 |
openstack | sourceware.org bug 21386 in nptl "Assertion in fork for distinct parent PID is incorrect" [Normal,Resolved: fixed] - Assigned to fweimer | 06:09 |
*** karthi has joined #openstack-ansible | 06:20 | |
*** chyka has joined #openstack-ansible | 06:23 | |
*** chyka has quit IRC | 06:27 | |
*** karthi has quit IRC | 06:37 | |
*** karthi has joined #openstack-ansible | 06:37 | |
*** jamesdenton has quit IRC | 06:44 | |
*** jwitko_ has quit IRC | 06:44 | |
*** masber has quit IRC | 06:55 | |
*** eumel8_ has joined #openstack-ansible | 06:57 | |
*** jwitko_ has joined #openstack-ansible | 07:00 | |
*** eumel8_ has quit IRC | 07:01 | |
*** clone99 has joined #openstack-ansible | 07:03 | |
*** SimAloo has quit IRC | 07:04 | |
*** Fritzmen has quit IRC | 07:06 | |
*** gus has quit IRC | 07:14 | |
cloudnull | odyssey4me: mnaser: looks like the changes for gate clean up has worked | 07:15 |
cloudnull | however it also looks like changes upstream in the ceph ansible roles is breaking things | 07:15 |
cloudnull | http://logs.openstack.org/42/550542/2/check/openstack-ansible-deploy-aio_lxc-ubuntu-xenial/1b57d55/job-output.txt.gz#_2018-03-07_21_01_12_636644 | 07:15 |
*** gus has joined #openstack-ansible | 07:15 | |
cloudnull | -cc andymccr ^ | 07:15 |
*** sar has joined #openstack-ansible | 07:19 | |
*** Fritzmen has joined #openstack-ansible | 07:23 | |
*** masber has joined #openstack-ansible | 07:23 | |
*** karthi has quit IRC | 07:31 | |
*** admin0 has joined #openstack-ansible | 07:39 | |
*** pmannidi has quit IRC | 07:49 | |
*** holser__ has joined #openstack-ansible | 07:50 | |
*** ANKITA has quit IRC | 07:53 | |
*** armaan has quit IRC | 07:56 | |
*** armaan has joined #openstack-ansible | 07:56 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info https://review.openstack.org/550542 | 07:59 |
*** pcaruana has joined #openstack-ansible | 08:04 | |
*** gaoyan has joined #openstack-ansible | 08:12 | |
*** gaoyan has quit IRC | 08:12 | |
*** chyka has joined #openstack-ansible | 08:13 | |
*** karthi has joined #openstack-ansible | 08:17 | |
*** mbuil has joined #openstack-ansible | 08:17 | |
*** chyka has quit IRC | 08:17 | |
*** gkadam has joined #openstack-ansible | 08:27 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Add ceph-ansible library path https://review.openstack.org/550747 | 08:31 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Add ceph-ansible library path https://review.openstack.org/550749 | 08:33 |
odyssey4me | andymccr cloudnull evrardjp ^ should do the trick - will wait for gate confirmation before combining them | 08:33 |
*** lkoranda has quit IRC | 08:42 | |
*** pcaruana has quit IRC | 08:43 | |
*** fusmu has joined #openstack-ansible | 08:46 | |
*** holser__ has quit IRC | 08:49 | |
*** pcaruana has joined #openstack-ansible | 08:52 | |
*** lkoranda has joined #openstack-ansible | 08:52 | |
*** radeks has quit IRC | 08:58 | |
*** fusmu has quit IRC | 08:59 | |
*** holser__ has joined #openstack-ansible | 08:59 | |
*** fusmu has joined #openstack-ansible | 09:00 | |
*** pcaruana has quit IRC | 09:02 | |
*** epalper has joined #openstack-ansible | 09:02 | |
*** lkoranda has quit IRC | 09:02 | |
*** shardy has joined #openstack-ansible | 09:03 | |
*** holser__ has quit IRC | 09:03 | |
*** holser__ has joined #openstack-ansible | 09:03 | |
*** holser__ has quit IRC | 09:07 | |
*** holser__ has joined #openstack-ansible | 09:07 | |
*** lkoranda has joined #openstack-ansible | 09:12 | |
*** pcaruana has joined #openstack-ansible | 09:15 | |
*** SerenaFeng has joined #openstack-ansible | 09:21 | |
*** SerenaFeng has quit IRC | 09:26 | |
*** lkoranda has quit IRC | 09:30 | |
*** jwitko_ has quit IRC | 09:31 | |
*** pcaruana has quit IRC | 09:32 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Add ceph-ansible library path https://review.openstack.org/550747 | 09:36 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Add ceph-ansible library path https://review.openstack.org/550749 | 09:36 |
Taseer | odyssey4me: Hi ! is zuul back to normal ? | 09:36 |
*** lkoranda has joined #openstack-ansible | 09:39 | |
*** pabelanger has joined #openstack-ansible | 09:41 | |
*** lhinds has joined #openstack-ansible | 09:41 | |
*** portante has joined #openstack-ansible | 09:41 | |
odyssey4me | Taseer no, the tests are still broken for the integrated gate... some upstream changes in ceph-ansible have broken us, so we've got two issues at once. Working on a fix. | 09:43 |
Taseer | odyssey4me: ok, thanks.. | 09:44 |
*** ANKITA has joined #openstack-ansible | 09:45 | |
*** pcaruana has joined #openstack-ansible | 09:45 | |
*** Sha0000 has joined #openstack-ansible | 09:59 | |
*** shardy is now known as shardy_afk | 09:59 | |
*** jwitko_ has joined #openstack-ansible | 09:59 | |
*** epalper has quit IRC | 10:03 | |
*** epalper has joined #openstack-ansible | 10:03 | |
*** Sha0000 has quit IRC | 10:08 | |
*** karthi has quit IRC | 10:10 | |
*** radeks has joined #openstack-ansible | 10:14 | |
andymccr | odyssey4me: good catch, thats pretty sucky | 10:21 |
*** electrofelix has joined #openstack-ansible | 10:28 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and include ceph-ansible library path https://review.openstack.org/550542 | 10:33 |
*** karthi has joined #openstack-ansible | 10:40 | |
*** karthi has quit IRC | 10:44 | |
*** karthi has joined #openstack-ansible | 10:44 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 10:49 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Unpin ceph-ansible and add ceph-ansible library path https://review.openstack.org/550749 | 10:51 |
gokhan_ | hi folks, is it possible to create multiple venvs in a role ? or I am trying wrong things:( I tried it and then run repo-build.yml but it does not create any venvs. | 10:52 |
odyssey4me | gokhan_ no, not with the current tooling | 10:53 |
odyssey4me | I mean, the role could create more than one - but the repo build can't | 10:53 |
evrardjp | gokhan_: I think the right answer depends on your use case | 11:03 |
evrardjp | what are you trying to achieve? | 11:03 |
*** epalper has quit IRC | 11:04 | |
*** epalper has joined #openstack-ansible | 11:05 | |
gokhan_ | odyssey4me, ok thanks. evrardjp, I want to install my notification service on horizon containers. I tried it with changing horizon role and on there also tried to create a new venv for my notification service | 11:06 |
odyssey4me | gokhan_ better to create a role specifically for that, then just have it execute against the horizon containers | 11:06 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 11:08 |
evrardjp | gokhan_: there is an alternative to what odyssey4me said | 11:08 |
evrardjp | Have a way to override the packages that need installing into the horizon venv | 11:09 |
evrardjp | this way you'll build them into the repo build, and use them into the venv | 11:09 |
evrardjp | but that needs to be pip installable | 11:09 |
gokhan_ | odyssey4me, ok you mean create a role for myservice and then in env.d directory define it belongs to dashboard containers | 11:11 |
*** kysse_ is now known as kysse | 11:12 | |
evrardjp | gokhan_: yes | 11:12 |
gokhan_ | evrardjp odyssey4me, ok thanks I will try first way :) | 11:14 |
*** chhagarw has joined #openstack-ansible | 11:15 | |
*** chhavi__ has joined #openstack-ansible | 11:15 | |
odyssey4me | gokhan_ you won't need an env.d entry at all, unless you need to create more groups for the service | 11:15 |
evrardjp | fair point | 11:16 |
odyssey4me | if you just need to install something into the horizon containers, then your playbook just needs to use the horizon group | 11:16 |
odyssey4me | for the repo build to prepare a venv, you'll need this in your role: https://github.com/openstack/openstack-ansible-os_horizon/blob/master/defaults/main.yml#L331-L335 | 11:17 |
odyssey4me | and you'll need to ensure that the role name is prefixed by os_ | 11:17 |
gokhan_ | odyssey4me, ok now I exactly got it :) thanks a lot :) | 11:21 |
openstackgerrit | wangqi proposed openstack/openstack-ansible-os_sahara master: Update links in README https://review.openstack.org/550784 | 11:24 |
*** udesale__ has joined #openstack-ansible | 11:25 | |
*** udesale_ has quit IRC | 11:27 | |
*** karthi has quit IRC | 11:31 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 11:36 |
*** udesale__ has quit IRC | 11:36 | |
mnaser | morning | 11:38 |
*** karthi has joined #openstack-ansible | 11:39 | |
evrardjp | morning mnaser | 11:39 |
* mnaser is still sick from Dublin :( | 11:40 | |
evrardjp | mnaser: same. Fever is gone though, but I still feel a little dizzy | 11:40 |
evrardjp | you? | 11:40 |
evrardjp | too much guiness? :p | 11:41 |
mnaser | I didn’t drink at all actually! It was just a flu or cold or whatever it is | 11:43 |
mnaser | Throat, congested, always tired | 11:43 |
mnaser | And I can’t escape the snow. https://usercontent.irccloud-cdn.com/file/LfZ1JNn5/1520509421.JPG | 11:43 |
evrardjp | haha it seems so | 11:44 |
evrardjp | nothing is blocked in your place though :p | 11:44 |
*** karthi has quit IRC | 11:44 | |
evrardjp | cloudnull: could you ping me when you're here? | 11:45 |
hwoarang | seems like the latest openstack sdk has issues with self-signed certs | 11:45 |
hwoarang | https://bugs.launchpad.net/python-openstacksdk/+bug/1754302 | 11:45 |
openstack | Launchpad bug 1754302 in OpenStack SDK "openstacksdk-0.12.0 breaks with self-signed certificates" [Undecided,New] | 11:45 |
evrardjp | oh :( | 11:45 |
evrardjp | great | 11:45 |
hwoarang | fyi... we may have to adjust requiremetns or something | 11:45 |
evrardjp | yeah | 11:45 |
evrardjp | add a pin | 11:45 |
evrardjp | is that bumped into requirements ? | 11:45 |
mnaser | I don’t think that will take too long to fix | 11:47 |
evrardjp | for us it's a one liner. | 11:49 |
evrardjp | :) | 11:49 |
evrardjp | but not worth having a one liner if that gets fixed quick upstream | 11:49 |
evrardjp | hwoarang: where did you see that? | 11:50 |
hwoarang | in the opnfv xci with queens | 11:50 |
hwoarang | but it should be visible in AIO/queens too i think | 11:50 |
hwoarang | since we have self-signed certificates there | 11:50 |
hwoarang | you can try 'openstack network list' for example | 11:51 |
mnaser | The reason I think it’ll be fixed quick is that I only can assume every project is broken right now. | 11:51 |
evrardjp | hwoarang: we have other issues in queens right now | 11:51 |
evrardjp | that's why we didn't see it | 11:52 |
evrardjp | hwoarang: will check because queens should be following the proper u-c, and therefore shouldn't bump like that | 11:52 |
evrardjp | mnaser: yes that's what I understood with your comment. But in stable branches, u-c are computed, and we don't bump things litely | 11:53 |
evrardjp | lightly* | 11:53 |
*** ANKITA has quit IRC | 11:53 | |
evrardjp | hwoarang: https://github.com/openstack/requirements/blob/stable/queens/upper-constraints.txt#L411 | 11:53 |
evrardjp | that's not normal we are pulling 0.12 | 11:54 |
evrardjp | in q | 11:54 |
evrardjp | where did you see that? | 11:54 |
evrardjp | :D | 11:54 |
evrardjp | maybe you found THE thing I was looking for a while. | 11:54 |
hwoarang | hmm | 11:54 |
hwoarang | i wonder why we pullsed 0.12.0 | 11:55 |
hwoarang | *pulled | 11:55 |
*** shardy_afk is now known as shardy | 11:59 | |
evrardjp | exactly | 12:00 |
evrardjp | if you have a log, that would be great | 12:00 |
*** jamesdenton has joined #openstack-ansible | 12:01 | |
*** jwitko_ has quit IRC | 12:04 | |
evrardjp | thanks mbuil for being core on os_neutron, os_tacker, and os_congress | 12:06 |
evrardjp | I should say congratulations! | 12:08 |
*** radeks has quit IRC | 12:12 | |
hwoarang | that's great news! | 12:13 |
odyssey4me | hmm, we won't see it in our AIO/tests because we use the internal endpoint - not public (where the cert is) | 12:14 |
evrardjp | odyssey4me: maybe but it's still bad if you exceed upper constraints of the branch :p | 12:14 |
mbuil | evrardjp: thanks. I will try to help as much as possible | 12:17 |
hwoarang | yep no clue why the upper constraints is not being respected | 12:17 |
hwoarang | will look into it | 12:17 |
*** Sha0000 has joined #openstack-ansible | 12:24 | |
* fdegir congratulates mbuil as well | 12:24 | |
*** SmearedBeard has joined #openstack-ansible | 12:25 | |
evrardjp | thanks ofc to previous ones I didn't advertise on the channel: mugsie now core on openstack-ansible-os_designate, and mnaser now core on the roles of the telemetry stack | 12:26 |
*** portante_ has joined #openstack-ansible | 12:27 | |
mnaser | :) | 12:27 |
*** masuberu has joined #openstack-ansible | 12:27 | |
*** pabelanger_ has joined #openstack-ansible | 12:27 | |
*** lhinds|out has joined #openstack-ansible | 12:27 | |
*** pabelanger has quit IRC | 12:29 | |
*** Smeared_Beard has joined #openstack-ansible | 12:29 | |
fdegir | mnaser: it was nice meeting you last week | 12:30 |
*** portante has quit IRC | 12:30 | |
*** portante_ is now known as portante | 12:30 | |
fdegir | mnaser: and I must say I'm impressed with the level of support you are providing to ODL folks | 12:30 |
*** masber has quit IRC | 12:31 | |
*** lhinds has quit IRC | 12:31 | |
*** SmearedBeard has quit IRC | 12:32 | |
mnaser | fdegir: oh, I was hoping to ask about you, we didn’t get a chance to formally meet! | 12:32 |
fdegir | mnaser: I was the guy who stood during foundation infra ci/cd and complained all the time | 12:33 |
mnaser | fdegir: thank you :) if you ever need anything at all, please feel free to reach out! | 12:33 |
mnaser | fdegir: I figured just as much! :p | 12:33 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible stable/newton: Update all SHAs for 14.2.17 https://review.openstack.org/550813 | 12:34 |
fdegir | mnaser: will keep your offer in mind, thanks | 12:34 |
mnaser | fdegir: we’re very “if our customers stuff isn’t working, then our stuff isn’t working either” .. no problem, anytime :) | 12:34 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:08 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:09 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:10 |
*** admin0 has quit IRC | 13:10 | |
*** pabelanger_ is now known as pabelanger | 13:10 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:13 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Clean-up gate code to use mirror_info and pin ceph-ansible SHA https://review.openstack.org/550542 | 13:14 |
*** udesale has joined #openstack-ansible | 13:24 | |
*** woodard has quit IRC | 13:25 | |
*** woodard has joined #openstack-ansible | 13:25 | |
*** holser__ has quit IRC | 13:27 | |
*** holser__ has joined #openstack-ansible | 13:28 | |
*** karthi has joined #openstack-ansible | 13:29 | |
*** udesale has quit IRC | 13:31 | |
*** udesale has joined #openstack-ansible | 13:31 | |
*** gameon has joined #openstack-ansible | 13:36 | |
*** SerenaFeng has joined #openstack-ansible | 13:36 | |
*** karthi has quit IRC | 13:36 | |
hwoarang | mnaser: do you plan to submit a spec for binary installations? | 13:41 |
mnaser | hwoarang: need to find a bit of time to do that, if you'd like to draft up the first steps of it, please feel free! | 13:41 |
hwoarang | the topic highly interests me but i am super busy so i wanted to check. i will prob ping you end of next week again and start drafting something up if you haven't done it already | 13:42 |
mhayden | buenos dias | 13:47 |
*** dave-mccowan has joined #openstack-ansible | 13:48 | |
openstackgerrit | Ramon Orru proposed openstack/openstack-ansible-ops master: Fixing typo https://review.openstack.org/550838 | 13:49 |
openstackgerrit | Ramon Orru proposed openstack/openstack-ansible-ops master: Using cluster_metrics host as default output https://review.openstack.org/550839 | 13:49 |
openstackgerrit | Ramon Orru proposed openstack/openstack-ansible-ops master: Moving telegraf-plugins to drop them properly https://review.openstack.org/550840 | 13:49 |
*** gameon has quit IRC | 13:50 | |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Remove kernel modules: scsi_dh + x_tables https://review.openstack.org/549754 | 13:53 |
*** lbragstad has joined #openstack-ansible | 13:54 | |
*** kstev has joined #openstack-ansible | 13:57 | |
*** karthi has joined #openstack-ansible | 13:57 | |
*** kstev1 has joined #openstack-ansible | 14:01 | |
*** kstev has quit IRC | 14:01 | |
*** karthi has quit IRC | 14:02 | |
*** Sha0000 has quit IRC | 14:03 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-openstack_hosts stable/queens: Remove kernel modules: scsi_dh + x_tables https://review.openstack.org/550845 | 14:06 |
mhayden | hwoarang: still trying to figure out why https://review.openstack.org/#/c/550102/ fails on SUSE | 14:07 |
mhayden | something about the /etc/cron.d/sysstat is not working right -- i thought maybe the permissions were wrong | 14:08 |
mhayden | it keeps trying to set something for that cron file other than the content of the file itself, because the checksums match | 14:08 |
mhayden | for centos, it was that it expects different file perms | 14:08 |
mhayden | but i'm using 0644 for suse | 14:08 |
hwoarang | hmm | 14:10 |
mhayden | hwoarang: i'm spinning up an opensuse instance on my cloud to gander | 14:11 |
mhayden | making openstack_hosts idempotent has been -- less than fun | 14:12 |
odyssey4me | mhayden hwoarang it seems prudent to port https://review.openstack.org/#/q/topic:bug/1750665+(status:open+OR+status:merged) back to queens/pike - your thoughts? | 14:13 |
hwoarang | mhayden: ExecStart=/bin/ln -fs /etc/sysstat/sysstat.cron /etc/cron.d/sysstat | 14:13 |
hwoarang | sneaky | 14:13 |
hwoarang | that's in the systemd service file | 14:13 |
mhayden | odyssey4me: agreed | 14:13 |
mhayden | hwoarang: oh wait what now? | 14:13 |
mhayden | do we even need the cron file for opensuse? | 14:13 |
hwoarang | odyssey4me: yep | 14:14 |
mhayden | odyssey4me: you want to mash buttons or should i? | 14:14 |
odyssey4me | if mhayden can review that galera_server one, then we can port them back in a batch | 14:14 |
odyssey4me | I'm happy to port them combined once the galera_server one is merged | 14:15 |
mhayden | done | 14:15 |
*** SerenaFeng has quit IRC | 14:15 | |
*** throwsb1 has joined #openstack-ansible | 14:15 | |
hwoarang | mhayden: probably not because we symlink it from elsewhere and we delete the symlink when the service is stopped | 14:15 |
hwoarang | don't know why it's like that | 14:15 |
hwoarang | :/ | 14:15 |
hwoarang | mhayden: maybe you can change the task a bit to 'state: link' for suse? | 14:16 |
*** SerenaFeng has joined #openstack-ansible | 14:16 | |
hwoarang | possibly a new task... | 14:16 |
hwoarang | mhayden: wait, you can put the template file in /etc/sysstat/sysstat.cron | 14:17 |
hwoarang | instead of /etc/cron.d/. then it should work fine | 14:17 |
*** Sha000000 has joined #openstack-ansible | 14:17 | |
mhayden | hwoarang: so something in systemd does the linking for you? | 14:19 |
mhayden | wow, that would have taken me a lot of digging to find | 14:19 |
hwoarang | yep the systemd service symlinks the cron file from /etc/sysstat/ to /etc/cron.d/ | 14:19 |
mhayden | okay, i can do that | 14:20 |
hwoarang | that doesn't seem right but it is what it is ;p | 14:20 |
*** ansmith has joined #openstack-ansible | 14:21 | |
* mhayden scurries off to test | 14:22 | |
mhayden | hwoarang: what's the default permissions on /etc/sysstat/sysstat.cron on your box? | 14:27 |
hwoarang | 644 | 14:27 |
*** armaan has quit IRC | 14:33 | |
*** armaan has joined #openstack-ansible | 14:33 | |
mhayden | hwoarang: Idempotence test: pass | 14:38 |
mhayden | AND THERE WAS MUCH REJOICING | 14:38 |
hwoarang | sweet :) | 14:38 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-openstack_hosts master: Make role idempotent https://review.openstack.org/550102 | 14:38 |
mhayden | hwoarang: ^^ | 14:38 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Fix openstack_host_module_file typo https://review.openstack.org/550549 | 14:39 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-openstack_hosts stable/queens: Fix openstack_host_module_file typo https://review.openstack.org/550852 | 14:39 |
*** jwitko has joined #openstack-ansible | 14:39 | |
evrardjp | mhayden: :) | 14:42 |
openstackgerrit | Merged openstack/openstack-ansible-galera_server master: vars: Switch to galera HTTP server on all distros https://review.openstack.org/549171 | 14:44 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550853 | 14:46 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550854 | 14:46 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Allow Galera package downloads over HTTP https://review.openstack.org/550856 | 14:50 |
mhayden | evrardjp: just replied in https://review.openstack.org/550102 | 14:50 |
*** sar has quit IRC | 14:50 | |
mhayden | cloudnull: if you get time to look at https://review.openstack.org/550135 -- that'd be great :) | 14:51 |
mhayden | evrardjp: i am happy to break up the openstack_hosts idempotency review into multiple patches if it makes things easier | 14:52 |
*** ThomasS has quit IRC | 14:52 | |
evrardjp | mhayden: I am just surprised | 14:52 |
mhayden | surprised at the poor patch quality? | 14:53 |
mhayden | :) | 14:53 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client stable/pike: Allow Galera package downloads over HTTP https://review.openstack.org/550857 | 14:53 |
evrardjp | mhayden: I am surprised we can't do this in an idempotent manner | 14:53 |
evrardjp | we should have a thing that's omitting giving filename | 14:54 |
*** masber has joined #openstack-ansible | 14:56 | |
evrardjp | mhayden: my understanding was: If you remove repo X you have multiple choices: | 14:57 |
evrardjp | without filename it would remove it from anywhere | 14:57 |
evrardjp | with filename it would remove it from filename | 14:57 |
evrardjp | the second item of the _package_repos list is maybe wrong | 14:58 |
*** masuberu has quit IRC | 14:59 | |
evrardjp | so you're telling me with filename it removes it from anywhere? | 14:59 |
evrardjp | that would explain the break of idempotency | 14:59 |
evrardjp | let me read | 14:59 |
*** lhinds|out is now known as lhinds | 15:02 | |
evrardjp | that's not what I wanted to say | 15:02 |
odyssey4me | it may be better to stats the file, then use the conditional to say delete any source by that name unless it's the right file name | 15:02 |
evrardjp | I wanted to say | 15:02 |
evrardjp | "please allow me to read the apt_repository code real quick" | 15:02 |
*** hamzy has quit IRC | 15:05 | |
*** esberglu has joined #openstack-ansible | 15:10 | |
mhayden | haha | 15:11 |
mhayden | evrardjp: the problem i had is that the task was removing the queens UCA repo no matter what filename it was in | 15:11 |
mhayden | so if you say "remove queens repo from file called com_ubuntu_whatever", it will remove that repo from any file it finds | 15:12 |
mhayden | so the task was removing the queens repo from the new uca file | 15:12 |
mhayden | then adding it right back | 15:12 |
mhayden | so it always showed as changed | 15:12 |
mhayden | perhaps that's a bug in apt_repository | 15:12 |
odyssey4me | mhayden can we make it smarter using a stat to check whether the right filename exists, then to disable the removal task if thee right file exists? or something to that effect | 15:13 |
mhayden | odyssey4me: i just added a task that removes those files :) | 15:13 |
mhayden | so if they're not there, it gets skipped | 15:13 |
odyssey4me | otherwise perhaps we should do the complicated thing we do in the galera_client repo | 15:13 |
mhayden | and the right repo gets added right after | 15:13 |
*** kstev1 has quit IRC | 15:14 | |
evrardjp[m] | exactly what i meant :) | 15:15 |
cloudnull | evrardjp: ping | 15:16 |
cloudnull | mhayden: looking | 15:16 |
cloudnull | odyssey4me: those prs look good to me, are you going to combine them ? | 15:17 |
hwoarang | mhayden: should ests/roles/bootstrap-host/vars/redhat.yml in the integration repo switch to Queens? | 15:18 |
hwoarang | *tests/roles/bootstrap-host/vars/redhat.yml | 15:18 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Simplify SELinux check https://review.openstack.org/550215 | 15:19 |
odyssey4me | cloudnull the pike patches are combined - the queens patches already have the first set merged, so no combining required | 15:21 |
*** masber has quit IRC | 15:22 | |
evrardjp | mhayden: I think your patch is nice, and I won't block it based on the fact we can make it better. | 15:25 |
odyssey4me | how gracious ;) | 15:26 |
evrardjp | lol | 15:27 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible master: tests: bootstrap-host: Switch to Queens repo for SUSE and Red Hat https://review.openstack.org/550870 | 15:27 |
evrardjp | do I speak like an *** all the time, and you are just very patient/friendly with me? | 15:28 |
evrardjp | I am trying you know | 15:28 |
*** woodard has quit IRC | 15:28 | |
mhayden | evrardjp: i just read your comments with a french accent and then i'm all good | 15:29 |
odyssey4me | roflmao | 15:29 |
*** woodard has joined #openstack-ansible | 15:29 | |
evrardjp | mhayden: :) | 15:30 |
*** hamzy has joined #openstack-ansible | 15:30 | |
d34dh0r53 | lmao | 15:30 |
* mhayden hugs evrardjp | 15:31 | |
mhayden | i'm going to miss you guys :| | 15:31 |
mhayden | even d34dh0r53 | 15:31 |
mhayden | yes, even d34dh0r53 | 15:31 |
d34dh0r53 | awww :(... | 15:32 |
* mhayden still needs to write that openstack-dev email but he keeps putting it off | 15:32 | |
mhayden | my eyes get wet when i try to write it | 15:33 |
*** kstev has joined #openstack-ansible | 15:33 | |
mhayden | evrardjp: but no, you don't talk like an *** | 15:33 |
mhayden | you're just very direct, and that frightens some americans :) | 15:33 |
*** Sha000000 has quit IRC | 15:34 | |
mhayden | but i like direct people | 15:34 |
mhayden | like when hughsaunders reviews my patch and says "this part here is rubbish" | 15:34 |
mhayden | it drives the point home -- i can feel what he's feeling ;) | 15:35 |
*** hamzy has quit IRC | 15:35 | |
mhayden | hwoarang: opensuse's red bash prompt for root is intimidating ;) | 15:36 |
shananigans | Anyway I can get someone else to check this one out? https://review.openstack.org/#/c/550539/ I just had someone else hit me up with networking issues on the gateway network for osa-ops mnaio deploys. | 15:38 |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: test-prepare-host: Switch package state to 'present' on openSUSE https://review.openstack.org/550878 | 15:39 |
openstackgerrit | Merged openstack/openstack-ansible-galera_client stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550854 | 15:40 |
*** hamzy has joined #openstack-ansible | 15:41 | |
hwoarang | mhayden: lol ;p | 15:41 |
* hwoarang senses that mhayden is going somewhere... | 15:42 | |
spotz | shananigans: looking | 15:42 |
shananigans | Thanks | 15:42 |
spotz | shananigans: done | 15:43 |
*** Smeared_Beard has quit IRC | 15:43 | |
*** chhagarw has quit IRC | 15:44 | |
*** chhavi__ has quit IRC | 15:44 | |
*** chhagarw has joined #openstack-ansible | 15:44 | |
openstackgerrit | Merged openstack/openstack-ansible-plugins stable/queens: Reduce interactions by nearly 50% https://review.openstack.org/550156 | 15:44 |
*** chhavi__ has joined #openstack-ansible | 15:44 | |
*** woodard has quit IRC | 15:47 | |
*** woodard has joined #openstack-ansible | 15:47 | |
openstackgerrit | Merged openstack/openstack-ansible-ops master: Fix broken linuxbridge-agent config for the flat network in osa-ops mnaio https://review.openstack.org/550539 | 15:48 |
*** Leo_m_ has quit IRC | 15:49 | |
*** SmearedBeard has joined #openstack-ansible | 15:52 | |
*** electrofelix has quit IRC | 15:52 | |
*** woodard has quit IRC | 15:54 | |
*** woodard has joined #openstack-ansible | 15:54 | |
*** SmearedBeard has quit IRC | 15:58 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: [WIP] Simplify nodepool variable gathering https://review.openstack.org/550881 | 15:59 |
*** kstev has quit IRC | 15:59 | |
*** udesale has quit IRC | 15:59 | |
*** kstev has joined #openstack-ansible | 16:02 | |
*** pcaruana has quit IRC | 16:06 | |
mhayden | logan-: you need a few of these in the DC now https://www.servethehome.com/lenovo-thinksystem-sd650-water-cooled-dense-hpc-applications/ | 16:08 |
*** ThomasS has joined #openstack-ansible | 16:12 | |
*** SmearedBeard has joined #openstack-ansible | 16:14 | |
openstackgerrit | Markos Chandras (hwoarang) proposed openstack/openstack-ansible-tests master: test-prepare-host: Switch package state to 'present' on openSUSE https://review.openstack.org/550878 | 16:18 |
*** woodard has quit IRC | 16:18 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common SystemD init role https://review.openstack.org/466179 | 16:21 |
hwoarang | mhayden: can you merge https://review.openstack.org/#/c/548641/ with https://review.openstack.org/#/c/550870/ ? | 16:22 |
hwoarang | mine does redhat + suse at once ;p | 16:22 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 16:23 |
mhayden | hwoarang: looking | 16:23 |
mhayden | hwoarang: why don't i just abandon mine | 16:24 |
*** vnogin has joined #openstack-ansible | 16:24 | |
hwoarang | yeah whatever works | 16:26 |
mhayden | hwoarang: i just abandoned mine | 16:28 |
openstackgerrit | Merged openstack/openstack-ansible-galera_server stable/queens: vars: Switch to galera HTTP server on all distros https://review.openstack.org/550853 | 16:29 |
*** Leo_m has joined #openstack-ansible | 16:30 | |
*** Smeared_Beard has joined #openstack-ansible | 16:31 | |
*** RandomTech has joined #openstack-ansible | 16:32 | |
*** SmearedBeard has quit IRC | 16:32 | |
mnaser | odyssey4me: wanna recheck https://review.openstack.org/#/c/550542/ perhaps? | 16:37 |
*** Leo_m has quit IRC | 16:41 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 16:41 |
*** Leo_m has joined #openstack-ansible | 16:42 | |
*** chyka has joined #openstack-ansible | 16:43 | |
*** prometheanfire has quit IRC | 16:43 | |
mhayden | so if i download ansible.sqlite.txt.gz, sqlite3 complains about it being correupt | 16:50 |
*** RandomTech has quit IRC | 16:50 | |
mhayden | trying to generate an ARA report from a completed job | 16:51 |
openstackgerrit | zhongshengping proposed openstack/openstack-ansible-os_trove stable/pike: Remove Trove's support for Heat https://review.openstack.org/550905 | 16:52 |
*** ygl has joined #openstack-ansible | 16:55 | |
ygl | hi all | 16:55 |
ygl | i am facing a problem when doing a AIO install on a vm | 16:55 |
ygl | can someone help me please | 16:55 |
*** armaan has quit IRC | 16:55 | |
*** RandomTech has joined #openstack-ansible | 16:56 | |
cloudnull | ygl: what are you seeing ? | 16:56 |
ygl | cloudnull: when I do a bootstrap like this "scripts/bootstrap-aio.sh" it is throwing this error | 16:57 |
ygl | cloudnull: TASK [bootstrap-host : Fail if there is not enough space available in /] | 16:57 |
ygl | cloudnull: fatal: [localhost]: FAILED! => { assertion": "(host_root_space_available_bytes | int) >= (host_data_disk_min_size_bytes | int)\n", | 16:57 |
ygl | cloudnull: however the scripts/bootstrap-ansible.sh is scucessful | 16:58 |
ygl | cloudnull: but there is 13 GB of space left in '/' partition | 16:58 |
ygl | cloudnull: is this a bug ? | 16:59 |
*** woodard has joined #openstack-ansible | 16:59 | |
*** woodard has quit IRC | 16:59 | |
cloudnull | I believe the base requirement is 64G of space for an AIO | 16:59 |
* cloudnull looking | 16:59 | |
ygl | cloudnull: is it ? | 17:00 |
*** woodard has joined #openstack-ansible | 17:00 | |
ygl | cloudnull: but they haven't mentioned here https://docs.openstack.org/openstack-ansible/queens/contributor/quickstart-aio.html | 17:00 |
cloudnull | https://github.com/openstack/openstack-ansible/blob/3ce37a347adb343fe6f493724b22c4846a1163a1/tests/roles/bootstrap-host/tasks/check-requirements.yml#L69-L82 | 17:02 |
cloudnull | and | 17:03 |
cloudnull | https://github.com/openstack/openstack-ansible/blob/25b671e344f0f71a99406eedccf749f42e8fd9ec/tests/roles/bootstrap-host/defaults/main.yml#L213 | 17:03 |
cloudnull | looks like 50G | 17:03 |
ygl | cloudnull: ok let me increase the disk size and try again | 17:03 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts stable/queens: Remove kernel modules: scsi_dh + x_tables https://review.openstack.org/550845 | 17:03 |
*** chyka_ has joined #openstack-ansible | 17:04 | |
*** vnogin has quit IRC | 17:07 | |
*** chyka has quit IRC | 17:07 | |
*** gkadam has quit IRC | 17:12 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Archive ARA report on successful jobs https://review.openstack.org/550956 | 17:16 |
*** fusmu has quit IRC | 17:17 | |
*** eumel8 has joined #openstack-ansible | 17:22 | |
*** epalper has quit IRC | 17:23 | |
*** holser__ has quit IRC | 17:24 | |
*** mbuil has quit IRC | 17:26 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Archive ARA report on successful jobs https://review.openstack.org/550962 | 17:29 |
*** ivve has joined #openstack-ansible | 17:31 | |
*** SerenaFeng has quit IRC | 17:45 | |
RandomTech | hey is anyone here able to help me troubleshoot an issue with running the playbooks | 17:46 |
RandomTech | "galera_server : Restart mysql fall back" is failing and im not sure why | 17:46 |
*** ivve has quit IRC | 17:55 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Update the test path for plugins https://review.openstack.org/549204 | 17:56 |
*** armaan has joined #openstack-ansible | 17:56 | |
*** radeks has joined #openstack-ansible | 17:59 | |
*** holser__ has joined #openstack-ansible | 18:03 | |
*** jwitko_ has joined #openstack-ansible | 18:06 | |
*** jwitko_ has quit IRC | 18:08 | |
*** jwitko_ has joined #openstack-ansible | 18:08 | |
odyssey4me | cloudnull mind giving https://review.openstack.org/#/q/topic:bug/1750665-stable/pike+(status:open+OR+status:merged) a nudge? | 18:08 |
RandomTech | anyone here familar with the galera install? | 18:09 |
odyssey4me | ygl https://docs.openstack.org/openstack-ansible/queens/contributor/quickstart-aio.html says pretty clearly in the requirements that 50G is required | 18:09 |
odyssey4me | 50G free | 18:09 |
*** jwitko has quit IRC | 18:10 | |
*** radeks has quit IRC | 18:13 | |
*** jwitko_ has quit IRC | 18:13 | |
*** chhagarw has quit IRC | 18:15 | |
*** chhavi__ has quit IRC | 18:15 | |
*** radeks has joined #openstack-ansible | 18:18 | |
*** hamza21 has joined #openstack-ansible | 18:18 | |
*** Smeared_Beard has quit IRC | 18:18 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Improve idempotency https://review.openstack.org/550135 | 18:22 |
*** ygl has quit IRC | 18:26 | |
*** Leo_m_ has joined #openstack-ansible | 18:29 | |
*** Leo_m has quit IRC | 18:32 | |
*** Leo_m_ has quit IRC | 18:33 | |
*** Fritzmen has quit IRC | 18:47 | |
*** jwitko has joined #openstack-ansible | 18:49 | |
RandomTech | hey odyssey4me do you have a moment? | 18:55 |
odyssey4me | RandomTech some, what's up? | 18:55 |
RandomTech | im having an issue with the galera container during setup-infrastructure.yml that im having trouble figuring out | 18:56 |
*** poopcat has joined #openstack-ansible | 18:56 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 18:59 |
RandomTech | heres a link with the failed task and the error i found in galera_server_error.log odyssey4me : http://paste.openstack.org/show/695625/ | 19:00 |
RandomTech | i seperated them with a dashed line | 19:00 |
*** woodard has quit IRC | 19:00 | |
RandomTech | if you could take a look it would be really appriciated | 19:00 |
*** Fritzmen has joined #openstack-ansible | 19:00 | |
RandomTech | weve been having trouble with this error for a few days now | 19:01 |
odyssey4me | RandomTech what tag/release/branch are you using? | 19:02 |
RandomTech | we are attempting to use pike | 19:02 |
RandomTech | following the instructions here: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/ | 19:02 |
RandomTech | weve been at this for a few months now honestly | 19:03 |
odyssey4me | RandomTech there was a version of mariadb which was borked, but we patched that up real quick - you might have been caight in the middle somewhere | 19:04 |
RandomTech | will we need to reinstall the os? or will just pulling down osa again work? | 19:04 |
odyssey4me | if you do 'git log' in /opt/openstack-ansible then what's the top-most SHA? | 19:04 |
*** woodard has joined #openstack-ansible | 19:05 | |
odyssey4me | also, do "grep -r '^openstack_release' * and let me know the version it gives | 19:06 |
RandomTech | what does SHA stand for again? | 19:07 |
odyssey4me | the SHA is the long hex, something like: commit f94c4b90629bb34638035e575596feea0b14fe63 | 19:08 |
RandomTech | here you go: http://paste.openstack.org/show/695640/ | 19:09 |
RandomTech | i sperated tem by a dashed line again | 19:09 |
odyssey4me | RandomTech yep, you're hitting this issue: https://github.com/openstack/openstack-ansible/commit/0e0819bb1c3782045c8a539bf04f4e92d019224d | 19:11 |
odyssey4me | RandomTech better to checkout 16.0.9, then rebootstrap-ansible | 19:12 |
RandomTech | so pull down 16.0.9 and then rerun bootstrap? | 19:12 |
odyssey4me | you'll have to destroy the galera_server containers if there's no data in there you care about... otherwise you'll have to uninstall the existing packages and remove the repositories | 19:13 |
odyssey4me | basically the mariadb version used is very broken when used in a cluster | 19:13 |
RandomTech | im fine with running lxc-containers destroy | 19:13 |
RandomTech | this things never been setup fully | 19:13 |
odyssey4me | it does take some time to get the initial config right for your use-case | 19:14 |
RandomTech | i definately figured that out | 19:14 |
odyssey4me | that's why we recommend having a good test environment where you can wipe and rebuild quickly | 19:14 |
RandomTech | sadly we do not | 19:14 |
RandomTech | it can take us a few hours to reinstall but its fairly doable | 19:15 |
odyssey4me | if you have a single host, with 64GB RAM and some disk - then you can use https://github.com/openstack/openstack-ansible-ops/tree/master/multi-node-aio | 19:15 |
*** SmearedBeard has joined #openstack-ansible | 19:15 | |
odyssey4me | more memory is better, of course | 19:15 |
RandomTech | sadly im having to reuse old blades that fell out of a previose cluster | 19:17 |
RandomTech | your saying we should reinstall though? | 19:17 |
RandomTech | if so we can do that itll just take time | 19:17 |
odyssey4me | RandomTech no, just ditching the galera_server containers and rebuilding them will be fine | 19:18 |
RandomTech | oh okay | 19:18 |
odyssey4me | assuming the install stopped there, even the client won't be installed anywhere else | 19:18 |
RandomTech | oh yay odyssey4me i noticed the documentation is having me pull 16.0.8 should i pull 16.0.9 instead? | 19:18 |
odyssey4me | RandomTech odd, I guess the docs didn't publish quite right - where're you seeing that? | 19:19 |
RandomTech | here: https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/deploymenthost.html | 19:19 |
RandomTech | the page is listed as 16.0.9 but says to pull 16.0.8 | 19:20 |
RandomTech | ive noticed this with previose versions as well | 19:20 |
RandomTech | heres a better link odyssey4me : https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/deploymenthost.html#install-the-source-and-dependencies | 19:21 |
odyssey4me | RandomTech hmm, that's a bug if it's been consistent like that | 19:21 |
RandomTech | i think ive brought it up before but was told to just use the one listed | 19:21 |
odyssey4me | RandomTech ah ok - I understand how this happened | 19:23 |
odyssey4me | this was released in the last 24 hours, and not a single patch has merged since | 19:23 |
odyssey4me | the docs are published after any merge | 19:23 |
odyssey4me | so this is usually a brief state | 19:23 |
RandomTech | i should be fine pulling 16.0.9 then? | 19:24 |
odyssey4me | yes, absolutely | 19:24 |
RandomTech | just destroyed containers, deleted /opt/openstack-ansible/ and pulled the new one | 19:26 |
RandomTech | running the new bootstrap now | 19:27 |
RandomTech | thanks again odyssey4me. hopefully it works correctly now | 19:28 |
* odyssey4me hopes so too :) | 19:28 | |
RandomTech | now that ive run bootstrap i should be able to start running setup-hosts.yml again correct? | 19:29 |
odyssey4me | RandomTech yep | 19:30 |
RandomTech | sounds good :) | 19:30 |
odyssey4me | cloudnull I'm still seeing disk space problems on some tests, quite randomly it seems - the host has 80GB, and it seems the fail is when doing things in containers | 19:31 |
odyssey4me | do we have any machinectl info for the integrated build job logs | 19:31 |
*** woodard has quit IRC | 19:35 | |
*** woodard has joined #openstack-ansible | 19:36 | |
*** prometheanfire has joined #openstack-ansible | 19:41 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Archive ARA report on successful jobs https://review.openstack.org/550962 | 19:43 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Archive ARA report on successful jobs https://review.openstack.org/550956 | 19:44 |
jrosser | any ideas on this? local test failure in os_keystone 'vagrant up ubuntu1604' http://paste.openstack.org/show/695690/ | 19:46 |
evrardjp | jrosser: your role is named openstack-ansible-plugins instead of plugins? It depends on your git clone I guess? | 19:48 |
jrosser | well - i just cloned the repo off github, did a little tweak and tried to test it in vagrant | 19:49 |
jrosser | just to be super clear its the openstack-ansible-os_keystone test i'm trying | 19:50 |
*** holser__ has quit IRC | 19:51 | |
cloudnull | jrosser: if testing master this was a recent issue we just resolved. https://review.openstack.org/#/c/549204/ | 19:52 |
evrardjp | jrosser: yup see ^ | 19:52 |
odyssey4me | jrosser https://review.openstack.org/549204 just merged - remove tests/common and re-run run_tests | 19:52 |
evrardjp | vagrant destroy; vagrant up | 19:52 |
jrosser | ooh right yes that looks like it | 19:53 |
jrosser | thanks! | 19:53 |
*** radeks_ has joined #openstack-ansible | 19:57 | |
*** radeks has quit IRC | 19:59 | |
RandomTech | well i need to get going odyssey4me, if i remember ill tell you how it went | 20:01 |
odyssey4me | RandomTech hope it turns out bettwr this time - have a great evening! | 20:02 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 20:04 |
*** RandomTech has quit IRC | 20:05 | |
*** radeks__ has joined #openstack-ansible | 20:07 | |
*** radeks_ has quit IRC | 20:09 | |
*** flemingo has joined #openstack-ansible | 20:15 | |
*** admin0 has joined #openstack-ansible | 20:18 | |
*** radeks__ has quit IRC | 20:22 | |
*** flemingo_ has joined #openstack-ansible | 20:25 | |
*** flemingo has quit IRC | 20:25 | |
*** flemingo_ has quit IRC | 20:25 | |
*** flemingo has joined #openstack-ansible | 20:26 | |
*** hw_wutianwei has quit IRC | 20:31 | |
*** hw_wutianwei has joined #openstack-ansible | 20:32 | |
mhayden | cloudnull / odyssey4me thanks for those quick looksees on those ARA patches ;) | 20:32 |
*** Leo_m has joined #openstack-ansible | 20:35 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 20:40 |
*** Leo_m has quit IRC | 20:40 | |
*** Leo_m has joined #openstack-ansible | 20:40 | |
*** woodard has quit IRC | 20:46 | |
*** lucasxu has joined #openstack-ansible | 20:46 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 20:46 |
*** throwsb1 has quit IRC | 20:47 | |
*** sar has joined #openstack-ansible | 20:47 | |
*** sawblade6 has joined #openstack-ansible | 20:50 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_client master: [WIP] Make galera_client role idempotent https://review.openstack.org/551001 | 20:51 |
*** ansmith has quit IRC | 20:53 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_client master: [WIP] Make galera_client role idempotent https://review.openstack.org/551001 | 21:04 |
*** masber has joined #openstack-ansible | 21:05 | |
*** lucasxu has quit IRC | 21:09 | |
*** prometheanfire has quit IRC | 21:12 | |
*** prometheanfire has joined #openstack-ansible | 21:17 | |
openstackgerrit | Jonathan Rosser proposed openstack/openstack-ansible-os_keystone master: Only try to stop services that exist https://review.openstack.org/551010 | 21:18 |
openstackgerrit | Merged openstack/openstack-ansible-openstack_hosts master: Make role idempotent https://review.openstack.org/550102 | 21:21 |
*** eumel8 has quit IRC | 21:24 | |
*** Leo_m_ has joined #openstack-ansible | 21:24 | |
*** eumel8 has joined #openstack-ansible | 21:25 | |
*** Leo_m has quit IRC | 21:26 | |
*** holser__ has joined #openstack-ansible | 21:27 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-galera_client master: Make galera_client role idempotent https://review.openstack.org/551001 | 21:28 |
*** holser__ has joined #openstack-ansible | 21:29 | |
*** eumel8 has quit IRC | 21:33 | |
logan- | dang mhayden. wonder how much those weigh re: https://www.servethehome.com/lenovo-thinksystem-sd650-water-cooled-dense-hpc-applications/ | 21:35 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Simplify nodepool variable gathering https://review.openstack.org/550881 | 21:36 |
mhayden | logan-: 5 pounds? | 21:40 |
*** sar has quit IRC | 21:45 | |
*** threestrands has joined #openstack-ansible | 21:47 | |
*** hamzy has quit IRC | 21:57 | |
*** hamza21 has quit IRC | 22:00 | |
*** kstev has quit IRC | 22:03 | |
*** vnogin has joined #openstack-ansible | 22:08 | |
*** holser___ has joined #openstack-ansible | 22:08 | |
*** jra has joined #openstack-ansible | 22:10 | |
jra | So OSA creates rsyslog containers for the service containers to syslog to; if I already have a nice highly-available infrastructure-grade syslog concentrator service set up, could I not define log_hosts and cause the service containers to log directly to that instead? | 22:11 |
*** vnogin has quit IRC | 22:12 | |
*** holser__ has quit IRC | 22:12 | |
*** holser___ has quit IRC | 22:15 | |
jrosser | jra: https://docs.openstack.org/openstack-ansible-rsyslog_client/latest/ | 22:22 |
jra | jrosser: Thanks! | 22:22 |
*** masber has quit IRC | 22:25 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 22:28 |
openstackgerrit | Merged openstack/openstack-ansible-tests master: test-prepare-host: Switch package state to 'present' on openSUSE https://review.openstack.org/550878 | 22:31 |
openstackgerrit | Merged openstack/openstack-ansible-tests master: test-log-collect.sh: Collect networkd information https://review.openstack.org/549764 | 22:31 |
*** admin0 has quit IRC | 22:33 | |
*** armaan has quit IRC | 22:39 | |
*** armaan has joined #openstack-ansible | 22:39 | |
*** esberglu_ has joined #openstack-ansible | 22:40 | |
*** ansmith has joined #openstack-ansible | 22:41 | |
*** Leo_m_ has quit IRC | 22:41 | |
*** esberglu has quit IRC | 22:43 | |
*** armaan has quit IRC | 22:49 | |
*** armaan has joined #openstack-ansible | 22:50 | |
jra | jrosser: so I know these are very elementary questions, but I'm just getting my bearings with OSA: once I've added an rsyslog_client_user_defined_targets stanza to user_variables, should I re-run setup-everything.yml with --tags=rsyslog to have that take effect? | 22:54 |
*** masber has joined #openstack-ansible | 22:54 | |
*** Leo_m has joined #openstack-ansible | 22:56 | |
*** esberglu_ has quit IRC | 22:59 | |
*** esberglu has joined #openstack-ansible | 23:00 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Convert role to use a common systemd init role https://review.openstack.org/551028 | 23:00 |
jrosser | jra: rather than give you possibly bogus advice, i'd start here http://codesearch.openstack.org/?q=rsyslog_client&i=nope&files=&repos= | 23:02 |
*** esberglu has quit IRC | 23:04 | |
jrosser | you can see there all the places rsyslog_client gets used, and also that the tag 'rsyslog' might help you target an ansible run more accurately that just rerunning everything | 23:05 |
jrosser | so it looks like you are on the right track | 23:06 |
jra | Yeah, I found that tag; I guess I'm just wondering whether there's a general pattern in OSA for applying these kinds of targeted updates as opposed to just re-running everything. Running with tags=rsyslog still runs a pile of stuff, and doing the setup-hosts.yml run with tags=rsyslog seems to want to also restarge the lxc containers, which I don't really want to do. | 23:07 |
jrosser | there are also rsyslog_client-install and rsyslog_client-config tags | 23:09 |
jrosser | however others are better placed than me to comment on a general pattern in OSA | 23:09 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_nova master: Convert role to use a common systemd init role https://review.openstack.org/466179 | 23:13 |
cloudnull | jra: that tag should work to update only rsyslog globally. | 23:14 |
cloudnull | in general I will use a tag like that on a specific service when updating the user_variables | 23:15 |
cloudnull | something like `openstack-ansible repo-server.yml --tags=rsyslog` | 23:15 |
cloudnull | etc | 23:15 |
cloudnull | if the change your making will impact everything you can run setup-everything with the tag and it'll do the tagged actions in all of the required places. | 23:16 |
jra | cloudnull: that's how I expected things to work based on my non-OSA ansible experience, but it seems like there are an awful lot of "always"-tagged tasks that also run | 23:17 |
cloudnull | yes | 23:17 |
jra | so if I do "openstack-ansible --tags=rsyslog setup-hosts.yml", the playbook actually fails outright | 23:17 |
cloudnull | there are quite a few always tasks | 23:17 |
cloudnull | what is it failing on ? | 23:18 |
jra | LXC image staging, it looks like | 23:18 |
cloudnull | ah yea. i see. | 23:18 |
*** esberglu has joined #openstack-ansible | 23:18 | |
* cloudnull just confirmed that | 23:18 | |
jra | fatal: [host04]: FAILED! => {"failed": true, "msg": "the field 'args' has an invalid value, which appears to include a variable that is undefined. The error was: 'lxc_images' is undefined\n\nThe error appears to have been in '/etc/ansible/roles/lxc_hosts/tasks/lxc_cache_prestage.yml': line 66, column 3, but may\nbe elsewhere in the file depending on the exact syntax problem.\n\nThe offending line appears to be:\n\n# download | 23:19 |
cloudnull | it does fail in lxc-hosts.yml. that's a bummer. | 23:19 |
jra | I feel like that shouldn't be an always task | 23:20 |
cloudnull | if i comment that playbook out it seems to go | 23:20 |
jra | dang | 23:20 |
* cloudnull looking | 23:20 | |
cloudnull | i think there's a missing fact that needs to be passed on | 23:20 |
* cloudnull trying setup-infrastructure.yml with that tag now | 23:21 | |
jra | yeah, this is always the hazard with tag-isolated runs, it's non-trivial to design stand-alone play paths | 23:21 |
cloudnull | ++ | 23:21 |
jra | but a full OSA run in my dev environment takes literally 3.5hrs, so I'm kinda trying to avoid that... :) | 23:22 |
cloudnull | the tag works in infra | 23:23 |
jra | nice | 23:23 |
*** esberglu has quit IRC | 23:23 | |
cloudnull | granted my test cluster is only 5 nodes | 23:23 |
cloudnull | but it should convey the same | 23:24 |
* cloudnull trying setup-openstack.yml | 23:24 | |
cloudnull | setup-openstack.yml worked too | 23:26 |
cloudnull | so we have a bug in setup-hosts. | 23:26 |
cloudnull | jra: idk if you have a moment, but mind raising an issue for that ? | 23:30 |
jra | cloudnull: definitely, I'll do that | 23:31 |
jra | thanks for your help! | 23:31 |
*** threestrands_ has joined #openstack-ansible | 23:33 | |
*** jra has quit IRC | 23:36 | |
*** threestrands has quit IRC | 23:36 | |
*** jra has joined #openstack-ansible | 23:36 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Fix role when running with isolated tags https://review.openstack.org/551032 | 23:37 |
cloudnull | jra: ^ | 23:37 |
cloudnull | with that conditional tags in isolation works with setup-hosts | 23:37 |
*** chyka has joined #openstack-ansible | 23:47 | |
*** chyka_ has quit IRC | 23:48 | |
jra | aha, so it's already in the works | 23:54 |
jra | cloudnull: oh I see, and you've just authored the change. Thanks! | 23:54 |
cloudnull | yea it should make it go , if you want to pull that in to try it out and review the pr it'd be appreciated | 23:55 |
cloudnull | but local tests seem to be all ok now | 23:55 |
jra | I'll give it a go | 23:55 |
cloudnull | that was the only change i need to apply to get `openstack-ansible setup-everything.yml --tags rsyslog` working | 23:56 |
cloudnull | but YMMV given that my test cloud is not all that big or complex | 23:56 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-os_keystone master: Convert role to use a common systemd init role https://review.openstack.org/551028 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!