Wednesday, 2019-03-20

*** BjoernT has quit IRC00:01
openstackgerritMohammed Naser proposed openstack/openstack-ansible master: zuul: add integrated infra jobs  https://review.openstack.org/64470300:13
openstackgerritMohammed Naser proposed openstack/openstack-ansible-galera_server master: zuul: start running integrated infra-jobs  https://review.openstack.org/64470400:16
*** BjoernT has joined #openstack-ansible00:16
*** markvoelker has joined #openstack-ansible00:17
openstackgerritMohammed Naser proposed openstack/openstack-ansible-rabbitmq_server master: zuul: start running integrated infra-jobs  https://review.openstack.org/64470500:17
guilhermespmnaser: sounds nice ^^00:19
openstackgerritMohammed Naser proposed openstack/openstack-ansible-openstack_hosts master: zuul: start running integrated infra-jobs  https://review.openstack.org/64470600:19
*** hamzy has joined #openstack-ansible00:19
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_hosts master: zuul: start running integrated infra-jobs  https://review.openstack.org/64470700:20
openstackgerritMohammed Naser proposed openstack/openstack-ansible-lxc_container_create master: zuul: start running integrated infra-jobs  https://review.openstack.org/64470800:21
*** markvoelker has quit IRC00:21
*** BjoernT_ has joined #openstack-ansible00:21
*** BjoernT has quit IRC00:21
*** cmart has quit IRC00:25
*** BjoernT_ has quit IRC00:38
*** markvoelker has joined #openstack-ansible00:48
*** BjoernT has joined #openstack-ansible00:48
jamesdentonevenin' folks00:49
*** marst has joined #openstack-ansible00:49
guilhermespo/ jamesdenton00:56
jamesdentonhey00:57
*** gyee has quit IRC00:57
*** DanyC has joined #openstack-ansible01:28
*** marst has quit IRC01:28
*** DanyC has quit IRC01:32
*** markvoelker has quit IRC01:49
*** cshen has joined #openstack-ansible01:50
*** cshen has quit IRC01:54
*** cmart has joined #openstack-ansible02:01
*** cmart has quit IRC02:34
*** cmart has joined #openstack-ansible02:58
*** hwoarang has quit IRC03:03
*** hwoarang has joined #openstack-ansible03:04
*** cmart has quit IRC03:10
*** dave-mccowan has quit IRC03:39
*** hwoarang has quit IRC03:44
*** hwoarang has joined #openstack-ansible03:45
*** nicolasbock has quit IRC03:45
*** udesale has joined #openstack-ansible04:00
*** chhagarw has joined #openstack-ansible04:34
*** BjoernT has quit IRC05:00
*** BjoernT_ has joined #openstack-ansible05:00
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Make the _pip_packages understood by py_pkgs  https://review.openstack.org/64461705:14
*** cshen has joined #openstack-ansible05:14
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Remove the private option from include_role  https://review.openstack.org/63854005:16
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Update role for new source build process  https://review.openstack.org/62034005:17
*** cshen has quit IRC05:18
*** BjoernT_ has quit IRC05:21
*** markvoelker has joined #openstack-ansible05:22
*** markvoelker has quit IRC05:26
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Updated from OpenStack Ansible Tests  https://review.openstack.org/63954805:27
*** ivve has quit IRC05:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server master: Update mariabackup-related release notes  https://review.openstack.org/64476805:41
odyssey4memnaser cloudnull ^ as noted by cloudnull in an older patch set review, the release notes are aggregated - that patch fixes them up and fleshes them out a little05:42
*** raukadah is now known as chandankumar05:45
*** BjoernT has joined #openstack-ansible05:49
*** jbadiapa has joined #openstack-ansible05:51
*** markvoelker has joined #openstack-ansible05:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Use union for list combinations to ensure uniqueness  https://review.openstack.org/64476905:56
*** maxbab has joined #openstack-ansible06:14
*** jbadiapa has quit IRC06:17
odyssey4mehmm, it looks like rocky is also affected by the mariadb thing mnaser guilhermesp - we'll have to figure out what to do about that, because it's blocking all stable/rocky tests and builds for centos06:17
*** BjoernT has quit IRC06:17
chandankumarodyssey4me: Good morning!06:29
chandankumarodyssey4me: is this issue known http://logs.openstack.org/00/644600/1/check/openstack-ansible-functional-distro_install-centos-7/eb5dda5/job-output.txt.gz#_2019-03-20_03_59_01_365114 ?06:29
*** ivve has joined #openstack-ansible06:30
openstackgerritMerged openstack/openstack-ansible-os_sahara master: missing document start "---"  https://review.openstack.org/61411606:33
openstackgerritMerged openstack/openstack-ansible-os_sahara master: fix Unexpected indentation  https://review.openstack.org/61623506:33
openstackgerritMerged openstack/openstack-ansible-os_sahara master: Trivial: Fix the pep8 warning  https://review.openstack.org/61652106:33
odyssey4mechandankumar morning - nope, not as far as I know, and I haven't seen that in anything else06:34
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/64477906:43
chandankumarodyssey4me: Ok, I will do a recheck06:49
*** phasespace has quit IRC06:55
odyssey4mechandankumar I dunno if you've seen the fail here and whether it's a known issue? https://review.openstack.org/64476906:56
chandankumarodyssey4me: yes it is a known issue06:56
chandankumarodyssey4me: just fixed right now in rdo06:56
chandankumarodyssey4me: dpdk dependency broke it last night https://review.rdoproject.org/r/#/c/19508/06:57
odyssey4mechandankumar ok, so I can just recheck now?06:57
chandankumarodyssey4me: yup!06:57
odyssey4methanks chandankumar06:59
chandankumarodyssey4me: :-)06:59
*** miloa has joined #openstack-ansible07:04
miloaMorning07:04
*** ivve has quit IRC07:07
jrosserodyssey4me: totally agree about those infra tests, I don’t see how the unit tests from those low level roles would easily translate to a modified integrated build07:10
odyssey4mejrosser yeah, I think we may have to do another strategy there - my approach was to handle the openstack roles first, then work my way down the stack07:11
jrosserA crude split of the roles into os-* and the rest is probably the best first move07:11
jrosserYes, snap07:11
odyssey4meI think galera/rabbitmq are simple enough, but then for the rest we might just need to do some sort of simple testing that's embedded in the role - or we just use one of the infra components for the tests.07:12
jrosserWe also need to make sure it is basically trivial to add a new unit test to the low level roles07:12
jrosserBecause it is currently easy with the static inventory and so on07:12
odyssey4meWe could potentially have some sort of 'none' scenario which does something trivial which can be used.07:13
*** pcaruana has joined #openstack-ansible07:20
*** ivve has joined #openstack-ansible07:22
*** rgogunskiy has joined #openstack-ansible07:24
odyssey4mejrosser if you have a bit of time, could you take a look through https://review.openstack.org/#/q/topic:bp/python-build-simplification+status:open ?07:27
jrosserYes certainly I’ll do that this morning07:28
*** tosky has joined #openstack-ansible07:29
*** cshen has joined #openstack-ansible07:33
odyssey4mejrosser thanks a million07:35
odyssey4mechandankumar looks like the recheck hit the same issue again: http://logs.openstack.org/00/644600/1/check/tripleo-ci-centos-7-standalone-os-tempest/c1e79cd/job-output.txt.gz#_2019-03-20_07_08_48_01967307:36
chandankumarodyssey4me: oh no, we need to wait for one more recheck I think07:37
*** DanyC has joined #openstack-ansible07:41
*** simon-AS559 has joined #openstack-ansible07:41
*** phasespace has joined #openstack-ansible07:45
openstackgerritMerged openstack/openstack-ansible stable/rocky: nova: restart instead of reloading services  https://review.openstack.org/64284208:03
fnpanicgood morning08:04
openstackgerritMerged openstack/openstack-ansible stable/rocky: Bump SHAs for stable/rocky  https://review.openstack.org/64221008:05
*** DanyC has quit IRC08:12
*** luksky has joined #openstack-ansible08:13
*** simon-AS5591 has joined #openstack-ansible08:14
*** simon-AS559 has quit IRC08:17
*** hamzaachi has joined #openstack-ansible08:29
evrardjpcloudnull: https://bugs.launchpad.net/openstack-ansible/+bug/181997408:40
openstackLaunchpad bug 1819974 in openstack-ansible "config_template does not respect yaml multiline as overrides" [Undecided,New]08:40
evrardjpwe definitively have gaps in our testing08:40
odyssey4meevrardjp perhaps jrosser can arrange to get that fixed by gshippey :)08:43
evrardjpI think this action plugin deserves some love... Rewriting it wouldn't be superfluous, but we need proper testing cases first.08:44
jrosserodyssey4me: what did you see broken with rocky / mariadb?08:58
odyssey4mejrosser I saw the same failure in https://review.openstack.org/644265, but it seems to have been temporary because https://review.openstack.org/642210 merged this morning09:04
chandankumarjrosser: odyssey4me can we get this backport https://review.openstack.org/#/c/644505/ merged?09:05
chandankumarthanks!09:05
*** tstrul has joined #openstack-ansible09:11
*** DanyC has joined #openstack-ansible09:12
*** jbadiapa has joined #openstack-ansible09:17
openstackgerritMerged openstack/openstack-ansible master: Imported Translations from Zanata  https://review.openstack.org/64477909:20
*** CeeMac_ has joined #openstack-ansible09:27
*** dav_id has joined #openstack-ansible09:30
*** CeeMac has quit IRC09:30
*** simon-AS5591 has quit IRC09:34
noonedeadpunkMorning everyone09:41
*** cshen has quit IRC09:47
openstackgerritFrank Kloeker proposed openstack/openstack-ansible master: Change docs build to openstackdocstheme logic  https://review.openstack.org/62342909:48
noonedeadpunkWould be great to get reviews on https://review.openstack.org/#/q/topic:translations_branch+(status:open) if someone has time for this09:49
*** chhagarw has quit IRC09:49
*** chhagarw has joined #openstack-ansible09:50
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-openstack_hosts master: Install user supplied CA certificates into system trust store  https://review.openstack.org/64144509:53
*** jbadiapa has quit IRC09:56
*** eumel8 has joined #openstack-ansible09:57
*** mino_ has joined #openstack-ansible10:04
*** mino_ has quit IRC10:06
*** aedc has quit IRC10:08
*** cshen has joined #openstack-ansible10:09
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest stable/rocky: Bring back the --serial flag alive  https://review.openstack.org/64450510:10
*** aedc has joined #openstack-ansible10:15
*** jbadiapa has joined #openstack-ansible10:16
*** luksky has quit IRC10:17
openstackgerritGeorgina Shippey proposed openstack/openstack-ansible-repo_build master: Replace usage of netloc filters to urlsplit  https://review.openstack.org/64481110:20
*** electrofelix has joined #openstack-ansible10:21
*** aedc has quit IRC10:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Update python_venv_build role docs  https://review.openstack.org/64481310:22
odyssey4mejrosser ^ hopefully that helps10:22
* jrosser looks10:23
jrosserreviewing the blueprint was really useful too10:23
*** simon-AS559 has joined #openstack-ansible10:23
odyssey4meah yes, let me link the blueprint too10:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Update python_venv_build role docs  https://review.openstack.org/64481310:28
odyssey4mejrosser I added a reference to the blueprint, because that does give valuable background.10:28
CeeMac_morning all10:32
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Moved compilemessages to handlers  https://review.openstack.org/63996010:32
*** chhagarw has quit IRC10:32
*** CeeMac_ is now known as CeeMac10:33
*** chhagarw has joined #openstack-ansible10:33
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_keystone_interface_secure var for ssl verification  https://review.openstack.org/64481610:33
*** tstrul has quit IRC10:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Update python_venv_build role docs  https://review.openstack.org/64481310:35
odyssey4mejrosser I probably need some grammatical fixes in https://review.openstack.org/644813, or perhaps some sentence restructuring. I think it covers the gist of it though. Once you're happy with it, we can ask spotz to give it a once-over.10:37
*** cshen has quit IRC10:45
*** nicolasbock has joined #openstack-ansible10:47
*** cshen has joined #openstack-ansible10:48
*** dave-mccowan has joined #openstack-ansible10:54
*** yolanda has quit IRC10:59
*** yolanda has joined #openstack-ansible10:59
*** luksky has joined #openstack-ansible11:06
openstackgerritMerged openstack/openstack-ansible-galera_server master: Update mariabackup-related release notes  https://review.openstack.org/64476811:06
*** SmearedBeard has joined #openstack-ansible11:13
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Use requirements.yml for managing os_tempest deps  https://review.openstack.org/64460011:17
chandankumar\o/11:17
*** SmearedBeard has quit IRC11:23
*** SmearedBeard has joined #openstack-ansible11:24
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Include config_template action plugin as a deps for os_tempest  https://review.openstack.org/64483011:24
*** vollman has joined #openstack-ansible11:26
*** simon-AS559 has quit IRC11:27
*** Smeared_Beard has joined #openstack-ansible11:28
*** udesale has quit IRC11:28
*** udesale has joined #openstack-ansible11:29
*** SmearedBeard has quit IRC11:30
*** cshen has quit IRC11:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Update python_venv_build role docs  https://review.openstack.org/64481311:34
odyssey4mejroll thanks for the feedback - done, and fixed the docs build issue too11:34
odyssey4meoops, I meant jrosser11:36
*** pcaruana has quit IRC11:38
*** cshen has joined #openstack-ansible11:43
jrosserchandankumar: do you guys have a plan here? this looks like a bit of an anti-pattern https://review.openstack.org/#/c/640348/3/install.sh11:48
jrosseri guess i mean an ansible role is generally installed by something else (galaxy / git clone / ...) so having a further installer inside the role is a little wierd11:49
odyssey4me++11:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Update python_venv_build role docs  https://review.openstack.org/64481311:50
*** dave-mccowan has quit IRC11:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/ansible-role-python_venv_build master: Update python_venv_build role docs  https://review.openstack.org/64481311:52
*** ansmith_ has quit IRC11:53
chandankumarjrosser: yes I will take a look11:57
chandankumarjrosser: odyssey4me I will be not around tomorrow due to Holi festival in india.11:57
openstackgerritMerged openstack/openstack-ansible stable/rocky: Add support to deploy mistral  https://review.openstack.org/64261411:59
*** jbadiapa has quit IRC12:11
*** markvoelker has quit IRC12:13
*** pcaruana has joined #openstack-ansible12:16
jrosserodyssey4me: "If the wheel build was not completed" -> "If the wheel build was not enabled" ? there are a couple of those which make it sound a bit like succeed/fail rather than opt in/out of wheel building12:23
*** simon-AS559 has joined #openstack-ansible12:39
*** CeeMac_ has joined #openstack-ansible12:42
*** ansmith has joined #openstack-ansible12:42
*** CeeMac has quit IRC12:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Cleanup SUSE testing  https://review.openstack.org/64462612:48
*** hamzaachi has quit IRC12:53
chandankumarjrosser: do we still need this patch https://review.openstack.org/#/c/643880/ as serial is back now?12:57
*** hamzaachi has joined #openstack-ansible12:57
jrosserchandankumar: no i don't think we do12:58
chandankumarjrosser: ok, abandoned12:59
odyssey4mejrosser when I write in a rush, it's often a bit of a mess - I usually prefer to come back to it with enough time passing in between... but having other people review is just as good :)12:59
*** hwoarang has quit IRC13:00
jrosserodyssey4me: it's all good :)13:01
*** hwoarang has joined #openstack-ansible13:01
*** tureba has joined #openstack-ansible13:09
*** marst has joined #openstack-ansible13:10
*** aedc has joined #openstack-ansible13:11
eumel8o/13:17
eumel8is the metal centos7 job almost broken?13:18
eumel8tried for the second time: http://logs.openstack.org/29/623429/4/check/openstack-ansible-deploy-aio_metal-centos-7/13:18
odyssey4meeumel8 it would appear there is something wrong there13:19
eumel8haven't make a deeper look13:20
odyssey4mehmm, I think I know what it might be too - the base image probably has something installed which it shouldn't have13:20
*** jbadiapa has joined #openstack-ansible13:21
odyssey4meyep, it appears that 'mysqladmin' is present on the host, but not at the right version, so the role execution bails out because it doesn't want to upgrade unless the operator wants to do that on purpose13:22
eumel8mhmm13:23
eumel8I only want to bring the docs change in ;)13:23
odyssey4meeumel8 yep, we'll see if I can find the root cause and get it sorted ASAP13:24
eumel8thx!13:32
*** simon-AS559 has quit IRC13:40
openstackgerritMerged openstack/openstack-ansible stable/rocky: Pass ceph_mons as a list of inventory hosts  https://review.openstack.org/64426513:40
*** marst has quit IRC13:43
*** BjoernT has joined #openstack-ansible13:47
*** BjoernT has quit IRC13:48
*** jonher has quit IRC13:54
*** BjoernT has joined #openstack-ansible13:55
*** marst has joined #openstack-ansible13:58
*** jonher has joined #openstack-ansible14:02
odyssey4mewell, that's nice - the MariaDB-client package provides the mysqladmin command :/14:04
chandankumarjrosser: needs https://review.openstack.org/#/c/644505/ +w on this14:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client master: Update MariaDB client version to match server  https://review.openstack.org/64487014:14
odyssey4mejrosser mnaser guilhermesp ^ that will resolve the current master build failures for metal tests14:14
jrosserchandankumar: done14:15
chandankumarjrosser: thanks14:15
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client master: Update MariaDB client version to match server  https://review.openstack.org/64487014:15
odyssey4meeumel8 ^ FYI14:15
*** chandankumar is now known as raukadah14:29
spotzodyssey4me: jrosser just ping when you want me to look14:31
*** aedc has quit IRC14:33
*** maxbab has quit IRC14:35
*** electrofelix has quit IRC14:41
*** jbadiapa has quit IRC14:51
odyssey4mespotz I think you can safely review https://review.openstack.org/644813 now - it's technically correct, although it could do with some grammatical improvements :)14:52
spotzodyssey4me: Ok I'll just fix as I go through:)14:52
odyssey4mespotz that'll do just fine - note that the docs job does publish it if you wish to see it in published form14:52
odyssey4methank you very much!14:53
spotzOkie and you're welcome, I've got it pulled up just need to finish waking up!14:53
* odyssey4me passes some coffee to spotz 14:56
spotz:)14:56
*** shananigans has joined #openstack-ansible14:56
*** phasespace has quit IRC15:01
spotzodyssey4me: I think I'm going to put up alternative text to get consensus, want to make sure I'm not totally rewording in a different direction then intended15:07
openstackgerritMerged openstack/openstack-ansible-galera_client master: Update MariaDB client version to match server  https://review.openstack.org/64487015:07
*** hwoarang has quit IRC15:09
*** hwoarang has joined #openstack-ansible15:10
*** phasespace has joined #openstack-ansible15:13
openstackgerritShannon Mitchell proposed openstack/openstack-ansible master: Automatically prune the inventory backup  https://review.openstack.org/56595015:15
spotzodyssey4me jrosser - Ok check out the alternative wording in the comments15:18
*** rgogunskiy has quit IRC15:27
*** altlogbot_0 has joined #openstack-ansible15:28
*** altlogbot_0 has quit IRC15:30
*** dav_id has quit IRC15:36
*** aludwar has quit IRC15:44
*** luksky has quit IRC15:45
*** aludwar has joined #openstack-ansible15:46
openstackgerritFrank Kloeker proposed openstack/openstack-ansible master: Change docs build to openstackdocstheme logic  https://review.openstack.org/62342915:48
*** BjoernT has quit IRC15:50
*** gyee has joined #openstack-ansible15:51
*** cmart has joined #openstack-ansible15:52
*** cmart has quit IRC15:56
*** cshen has quit IRC15:58
*** cmart has joined #openstack-ansible15:59
*** xgerman has joined #openstack-ansible16:04
*** BjoernT has joined #openstack-ansible16:06
*** jbadiapa has joined #openstack-ansible16:22
*** priteau has joined #openstack-ansible16:33
*** altlogbot_0 has joined #openstack-ansible16:39
cloudnullafternoons all16:41
*** altlogbot_0 has quit IRC16:41
*** CeeMac_ has quit IRC16:46
*** BjoernT has quit IRC16:47
guilhermesphey cloudnull o/16:48
cloudnullhows it ?16:48
guilhermespall good.. just upgrading some really old openstack deployments by hand.. quite cumbersome :P16:49
mnaserhttps://zuul-ci.org/docs/zuul/user/config.html#attr-job.ansible-version16:49
mnaserwe can use zuul to natively run our ci D:16:49
*** yolanda has quit IRC16:49
*** keson has joined #openstack-ansible16:51
guilhermesp@all, about the cycle-highlights, if there still time to submit, I ended up with two cycle bullets, if anyone have something to add in that list, please do : ) http://paste.openstack.org/show/748131/16:52
*** Smeared_Beard has quit IRC16:59
*** SmearedBeard has joined #openstack-ansible17:01
jrosserguilhermesp: the sharing of os_tempest with tripleo?17:03
guilhermespjrosser:  yeah I was seeing that here https://etherpad.openstack.org/p/osa-stein-ptg. But is it something accomplished already or is it a wip?17:04
jrosseri think there is a voting test now on the tripleo side17:05
*** ivve has quit IRC17:06
*** jbadiapa has quit IRC17:07
*** udesale has quit IRC17:17
*** DanyC has quit IRC17:20
*** DanyC has joined #openstack-ansible17:21
goldenfriHi, I am running a new deplay and when running openstack-ansible setup-openstack It is failing when it tries to "Add service to keystone service catalog" with "Cloud default was not found" did I miss something in the config possibly?17:23
*** altlogbot_3 has joined #openstack-ansible17:23
*** altlogbot_3 has quit IRC17:24
*** altlogbot_1 has joined #openstack-ansible17:25
*** DanyC has quit IRC17:26
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-galera_server master: DNM test this  https://review.openstack.org/64494817:27
*** altlogbot_1 has quit IRC17:28
*** altlogbot_1 has joined #openstack-ansible17:29
*** hamzaachi has quit IRC17:35
*** hamzaachi has joined #openstack-ansible17:37
*** miloa has quit IRC17:45
goldenfrihrm, perhaps it was just a bug. I went and deleted the keystone service and re-ran and now it seems to be running running through setup-openstack just fine.17:51
*** cshen has joined #openstack-ansible17:53
eumel8great job, odyssey4me, centos jobs works again and all gate checks passed: https://review.openstack.org/#/c/623429/17:53
*** bgmccollum has quit IRC17:54
*** cshen has quit IRC17:57
*** cmart has quit IRC17:58
evrardjpeumel8: what was the problem for centos?18:01
*** priteau has quit IRC18:04
*** luksky has joined #openstack-ansible18:05
eumel8evrardjp: wrong version of MySQL in Galera installation caused by a new CentOs Image18:07
*** aedc has joined #openstack-ansible18:08
jrosserAnyone done cold-migrate on pci-passthrough stuff?18:10
eumel8evrardjp: btw, is the SuSE support are now definitly out? I think documentation is to adjust in differerent places in that case18:10
evrardjpeumel8: I am working on it occasionally :)18:13
evrardjpIn fact I am trying to setup a process to help here18:13
eumel8evrardjp: mhm, could be very simple process: asking for help here?  :)18:15
*** bgmccollum has joined #openstack-ansible18:17
*** kopecmartin is now known as kopecmartin|off18:19
*** irclogbot_0 has quit IRC18:21
evrardjpeumel8: :)18:23
*** irclogbot_2 has joined #openstack-ansible18:23
nicolasbockQuick question: Does the 'metal' part of the scenario mean that everything is deployed on one host, i.e. not inside containers?18:24
mnaseryes nicolasbock18:25
nicolasbockWhy do we care? I mean that seems to me a very unusual deployment scenario18:25
mnaserits actually quite usual :)18:26
*** DanyC has joined #openstack-ansible18:26
mnaserit's much faster, less complicated, and it's the path that a few deployers are moving towards18:26
mnaserit removes the complexitiy of operating N amount of 'machines'18:26
nicolasbockOh I see18:26
nicolasbockYes, but it removes the isolation you get from containers18:27
mnaserwith metal, 3 controllers means 3 managed systems18:27
mnaserwith containers, 3 controllers means potentially 45 managed systems depending on how many services you run18:27
*** irclogbot_2 has quit IRC18:27
nicolasbockYes, that's true18:27
nicolasbockOk, interesting point of view18:27
nicolasbockThanks!18:27
mnaserwe already have cgroup isolation, so the only thing would be if one service is 'exploited' it might affect other ones18:27
*** irclogbot_3 has joined #openstack-ansible18:28
mnaserwhich is a valid security concern, but we can use cgroups with systemd to address that eventualy18:28
mnaseralso, in a private cloud environment, it may be possible that there is just no bad actors and the cloud is interacted with by a trusted set of individuals behind a firewall18:28
nicolasbockWell I was thinking more in terms of scaling out and advantages of upgrades you get with stateless containers.18:28
nicolasbockI agree with you that security is sometimes not much of a concern18:29
nicolasbockBut generally simpler is better ;)18:29
*** neith has quit IRC18:30
*** PrinzElvis has quit IRC18:30
*** DanyC has quit IRC18:30
*** FrankZhang has quit IRC18:31
*** shertel has quit IRC18:31
*** neith has joined #openstack-ansible18:31
*** NobodyCam has quit IRC18:31
*** geekinutah has quit IRC18:32
*** PrinzElvis_ has joined #openstack-ansible18:32
*** hamzaachi has quit IRC18:33
mnasernicolasbock: yeah, i'd love it if we used stateless containers but our stateful containers right now introduce quite a lot of complexity18:33
*** FrankZhang has joined #openstack-ansible18:33
mnaserin my ideal world i'd do podman containers :)18:33
mnaseri think suse's and redhat's ideal world includes that too :P18:33
nicolasbockI hadn't heard of podman, but I think you are right about SUSE and RedHat's ideal worlds ;)18:34
*** NobodyCam has joined #openstack-ansible18:34
*** geekinutah has joined #openstack-ansible18:34
*** DanyC has joined #openstack-ansible18:35
*** SmearedBeard has quit IRC18:38
*** BjoernT has joined #openstack-ansible18:48
*** chhagarw has quit IRC18:50
*** DanyC has quit IRC18:56
*** ivve has joined #openstack-ansible18:58
*** cmart has joined #openstack-ansible18:58
*** altlogbot_1 has quit IRC19:00
*** altlogbot_1 has joined #openstack-ansible19:01
*** PrinzElvis_ is now known as PrinzElvis19:05
*** altlogbot_1 has quit IRC19:06
*** altlogbot_2 has joined #openstack-ansible19:06
evrardjpmnaser: for that there is kolla-ansible19:15
mnaseri think kolla is designed for docker first, and the images it depends on are a bit silly imho19:15
mnaserloci is the way to do images right19:16
*** irclogbot_3 has quit IRC19:16
evrardjpI won't go that path :)19:16
*** irclogbot_0 has joined #openstack-ansible19:16
evrardjphahaha19:16
mnaseri feel like kolla images are a bit confused19:17
mnaserthey're like system containers (full os) but running in an application container platform (docker)19:17
evrardjpit's a lot of things... I like LOCI19:17
evrardjpI prefer LOCI*19:18
evrardjpdifferent ways to build things19:18
mnasermy ideal world is standalone kubelets orchestrated by ansible using loci images19:18
mnaserso kubelets handle container state and ansible just has to orchestrate the manifests19:18
mnaseri wouldn't trust the k8s layer *yet* to use it as a cluster19:18
mnaserand ansible is great at orchestrating things across hosts19:19
mnaserk8s isn't the best in doing that (yet, imho)19:19
mnaserso really using containers as a packaging mechanism is the best openstack approach.. imho19:20
evrardjpbut it means you would love some of k8s concepts19:26
evrardjpliveliness/readiness probes are quite super cool19:26
evrardjpif you don't expose that through k8s you're kinda losing somehting19:26
*** irclogbot_0 has quit IRC19:30
*** irclogbot_2 has joined #openstack-ansible19:30
mnaserevrardjp: right, i think k8s provides a good construct for application scheduling, something like some sort of 'systemd' replacement19:31
mnaserbut i also like podman for the same construct, use *actual* application containers with an application container platform19:32
*** altlogbot_2 has quit IRC19:34
*** altlogbot_2 has joined #openstack-ansible19:35
*** hamzaachi has joined #openstack-ansible19:38
admin0hi all .. what could cause this:   Failed to start libvirt guest: libvirtError: internal error: cannot load AppArmor profile19:38
admin0or which playbook could solve this ?19:38
evrardjpnot sure we touch apparmor19:39
mnaserya feels like a libvirt thing19:39
fnpanichi19:40
fnpanicdoes anyone know if you can list users in horizon when the groups are managed in AD?19:40
fnpaniccan this be done with a special user filter?19:41
admin0fnpanic, you mean a ldapdump ?19:41
admin0i don't think so .. what we do is ldapdump the AD, use filters and then add the appropriate projects in openstack19:42
fnpanicok, i am looking for some kind of "self-service"19:42
admin0explain that :D19:43
admin0once you add the users, its pretty self-service19:43
admin0i meant the projects19:43
fnpanicso we want to use a email enabled Security group in AD19:43
fnpanicso you can add users with outlook (very convient for the users) and so add them to the corresponding openstack project19:43
fnpanicthis works so far but you only see the users in the ad groups in ad and not horizon19:44
fnpanic:-)19:44
admin0yes, because horizon does not do a dump19:44
admin0keystone just does a bind check19:44
fnpanicoh and it cannot be forced to do so?19:45
fnpanicat least it can follow refereals19:45
admin0well, its python  .. you can easily add a button and a page to do a dump19:45
admin0and list it there19:45
fnpanicquery_scope = sub19:45
fnpanicok got it. so nothing build in and so is "by design"19:46
admin0using scope when binding is there ..  i meant not the dump/list :)19:46
admin0plus since the project name is also their username ( usually) , isn't a project list also the user list ?19:46
fnpanicno the project name = ad group name19:47
admin0ok19:48
fnpanicit would have been nice to have so you can check the users in a particular project in horizon19:48
fnpanicif it is not possible due to only ldap bind is used it is fine19:48
admin0and why do you need this in horizon itself, don't you have a business type of dashboard that shows different stats19:48
admin0like the one you want ,plus also global image utilization, most active projects etc ?19:49
admin0most active projects, biggest projects ( in terms of volumes, vcpu, images etc )19:49
fnpanicno yet :-) If you have recommondations it would be great. Grafana and what datasource?19:50
fnpanicfor the openstack stats :-)19:51
admin0oh .. i build my own .. from sql19:51
admin0i can try to open source it ( its php/symfony based )19:51
fnpanicok19:51
fnpanicwhy not grafana ? and maybe an exportert?19:51
fnpanici though there was some type of this in the ops repo?19:52
admin0i am trying to convert it to python + plotly :)19:52
fnpanicif have also seen some stuff in the grafana page for openstack19:52
fnpanicwhy ?19:52
admin0to learn python + plotly19:52
admin0real world requirements19:52
fnpanicok19:53
fnpanic:-)19:53
*** cshen has joined #openstack-ansible19:53
admin0is the ops repo grafana already connecting to sql ?19:55
admin0then it would make it easy and quick19:55
admin0i am waiting for a suitable server to try it19:55
*** cshen has quit IRC19:58
fnpanicyes i though so20:05
fnpanicgrafana is using the sql as a backend20:05
*** shananigans has quit IRC20:45
*** irclogbot_2 has quit IRC20:45
*** irclogbot_3 has joined #openstack-ansible20:46
*** ansmith has quit IRC20:48
*** altlogbot_2 has quit IRC20:53
*** altlogbot_2 has joined #openstack-ansible20:54
*** DanyC has joined #openstack-ansible20:55
*** DanyC has quit IRC21:00
*** DanyC has joined #openstack-ansible21:08
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/rocky: Update fedora-atomic image to version 27 following upstream docs  https://review.openstack.org/64299221:11
*** keson has quit IRC21:11
*** DanyC has quit IRC21:46
*** hamzaachi has quit IRC21:48
*** ansmith has joined #openstack-ansible21:50
*** cshen has joined #openstack-ansible21:53
*** cshen has quit IRC21:58
*** pcaruana has quit IRC22:11
*** marst has quit IRC22:12
*** SmearedBeard has joined #openstack-ansible22:17
*** BjoernT has quit IRC22:22
*** BjoernT has joined #openstack-ansible22:27
*** arxcruz is now known as arxcruz|pto22:39
*** BjoernT has quit IRC22:50
NobodyCamgood afternoon folks23:02
NobodyCamanyone ever encountered a issue where after a upgrade(added a service) OpenStack is unable to launch instances, they get stuck in build / scheduling .. I set all nova logs to debug but don't see any errors jumping out23:04
NobodyCamI do see this in the compute log:23:05
NobodyCamInstance 7d8f61e6-155c-47a9-9d35-95939b29d487 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start23:05
noonedeadpunkIt's just a guess, but try to check your rabbitmq installation23:16
NobodyCamlogs look ok, I think23:16
noonedeadpunkOr even run rabbitmq-install.yml -e rabbitmq_upgrade=true23:17
noonedeadpunkI faced with an issue with rabbitmq, when I was shuting down and then starting one of the rabbit nodes, cluster just got stuck23:20
*** luksky has quit IRC23:20
noonedeadpunkno errors in the log, rabbitmq looks like up and running, but no mesage exchange actually occured23:20
noonedeadpunkSO I had the simillar symptoms, and rabbitmq-install.yml -e rabbitmq_upgrade=true was a cure for this situation23:21
NobodyCamI'll give that a shot23:21
mnasernoonedeadpunk: i ran into that damn issue so many times.23:21
mnaseri think it is something we do in our deployment.23:22
mnasercc guilhermesp ^23:22
mnaserthe only way around it i found was deleting all queues and recreating them23:22
mnaseri wonder if it's related to us using tls?23:22
noonedeadpunkTHe most strange thing is that everything becomes bad right after starting this node (not during shut down)23:23
noonedeadpunkAs for me it looks like smth wrong with rabbit itself to be honest, as it's cluster status shows no problem and no alerts...23:24
noonedeadpunkwhile even remaining 2 nodes were online all the time, and they stops working as well...23:25
noonedeadpunkbut I'm not really big rabbit expert, so...23:26
guilhermespoh that god damn rabbit issue...yes, as mnaser suggested a good shot would be deleting the queues and put and eye on the service23:27
mnaseri wonder why23:28
mnasermaybe we deploy a buggy rabbitmq23:28
noonedeadpunkActually rabbitmq_upgrade=true deletes ques as well, I gues:)23:28
mnasernoonedeadpunk: you run centos or ubuntu?23:29
mnasersame question for NobodyCam23:29
noonedeadpunkUbuntu23:29
mnaserok well we used to ship 3.7.823:30
mnaserwhich is 20 September 201823:30
noonedeadpunkbtw, how do you resolve ha question regarding memcached? As once the first memcached container goes down it causes almost whole cluster to get timouts during auth23:30
mnasernoonedeadpunk: i have noticed that too :\23:31
mnaseri think its probably a service config fault imho23:31
*** tosky has quit IRC23:31
mnaserhttps://github.com/rabbitmq/rabbitmq-server/pull/1878 seems interesting23:33
noonedeadpunkAs far as i remember by design memchached uses only one backend (the first/last specified - don't remember which one), and once it timouts - tries to use the next one. From the other hand it's possible to decrease timout, but still sessions and data shouldn't be distributed among backends, so small timout on high load may just result in backends switching...23:37
NobodyCammnaser: centos23:37
*** SmearedBeard has quit IRC23:37
noonedeadpunkmight be related...23:37
NobodyCamjust ran the rabbit playbook finished with out error, still unable to launch23:38
*** DanyC has joined #openstack-ansible23:47
*** DanyC has quit IRC23:51
*** cshen has joined #openstack-ansible23:54
*** cshen has quit IRC23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!