Tuesday, 2019-04-16

*** markvoelker has quit IRC00:00
*** tosky has quit IRC00:01
*** nurdie_ has quit IRC00:01
*** nurdie has joined #openstack-ansible00:02
*** nurdie_ has joined #openstack-ansible00:07
mnaserkplant: cool00:10
*** nurdie has quit IRC00:10
*** cmart has quit IRC00:14
mnaserkplant: you should leave a +1 to help other reviewers in Gerrit if you don't mind :)00:16
kplantdone00:22
*** nurdie_ has quit IRC00:44
*** nurdie has joined #openstack-ansible00:45
*** nurdie has quit IRC00:50
snadgei know you're not supposed to reboot devstack etc.. but it seems the storage is at least persistent when I do00:57
snadgefor some reason its not creating a route to the public network which is defined though00:58
snadgebut the actual instances are allocated addresses etc.. they just cant be pinged from the host00:58
snadgemaybe i just need to restart neutron?00:58
kplantwhat do you mean by route to the public network?01:21
snadgeby default devstack seems to create a FLOATING_IP range of 172.24.4.0/24 .. and after you've brought it up for the first time, theres a route to that network01:22
snadgeand from the controller (its an all in one setup) you can ping instances on those addresses01:23
kplantoh, i think i understand now01:23
snadgepresumably it does that as part of the stack.sh script.. which im looking at now.. i dont want to run unstack then stack because it blows everything away01:23
kplanti don't know enough about the architecture of devstack to intelligently guess, i've never used it01:25
kplantbut i will anyway :-). is there a bridge interface that floating ip network is attached to?01:25
kplantyou might be able to find it in the neutron config if you search BRIDGE_IFACES01:26
*** hwoarang has quit IRC01:28
*** hwoarang has joined #openstack-ansible01:28
mnasersnadge: this channel is for openstack ansible and not devstack :)01:28
mnaseryou probably won't get all the beset help here :P01:28
snadgei realised that after i asked.. i am in here because I do indeed have an openstack ansible deployment, its just not the one i'm playing with right now01:29
kplantmnaser: stable/stein deploy just completed on centos7 with ceph+magnum+metering01:32
mnaserkplant: w00t01:33
mnasernaisu01:33
kplantyou guys have a pretty good sla, heh01:33
mnaser:D01:35
kplanti'll give a multinode debian run a shot here in a moment01:35
mnaserim just about to deploy a debian compute (Ctl plane still centos)01:36
mnaserthere's an issue right now cloning things01:36
mnaserpython_venv_build repo is broken01:36
mnaserworking with infra to fix it right now01:36
mnasercc jrosser ^01:36
snadgekplant: you pointed me in the right direction.. devstack uses a br-ex interface by default.. and apparently it just doesn't bother to configure it on reboot01:42
snadgethis is separate to the virbr0 .. completely irrelevant information.. nobody uses devstack for anything other than.. apparently testing that devstack works ;)01:43
kplantglad to hear you tracked it down01:46
kplantmnaser: i think i'll give it a shot anyway, if anything maybe i can provide more information that may or may not be helpful01:47
*** nicolasbock has quit IRC02:29
*** DanyC has joined #openstack-ansible02:32
*** DanyC has quit IRC02:36
*** hwoarang has quit IRC02:37
*** hwoarang has joined #openstack-ansible02:39
*** weshay_pto is now known as weshay02:49
*** ChosSimbaOne has quit IRC02:51
*** ChosSimbaOne has joined #openstack-ansible02:51
*** kplant has quit IRC03:07
*** cshen has joined #openstack-ansible03:16
*** cshen has quit IRC03:20
*** dxiri has quit IRC04:00
*** hwoarang has quit IRC04:21
*** hwoarang has joined #openstack-ansible04:26
*** shyamb has joined #openstack-ansible05:03
*** gyee has quit IRC05:08
*** shyamb has quit IRC05:09
*** shyamb has joined #openstack-ansible05:13
*** cshen has joined #openstack-ansible05:16
*** cshen has quit IRC05:20
openstackgerritMerged openstack/openstack-ansible stable/stein: debian: add job template for telemetry  https://review.openstack.org/65235705:24
*** jbadiapa has quit IRC05:25
prometheanfireheh, glance is still on rocky_contract02 for it's db version in stein05:27
*** ivve has joined #openstack-ansible05:40
*** nurdie has joined #openstack-ansible05:45
*** nurdie_ has joined #openstack-ansible05:47
*** nurdie has quit IRC05:50
*** DanyC has joined #openstack-ansible05:57
*** nurdie_ has quit IRC06:01
*** kopecmartin|off is now known as kopecmartin06:07
*** shyamb has quit IRC06:13
*** pcaruana has joined #openstack-ansible06:26
*** serverascode has quit IRC06:29
*** shyamb has joined #openstack-ansible06:32
*** serverascode has joined #openstack-ansible06:32
*** johnsom has quit IRC06:32
*** serverascode has quit IRC06:38
*** markvoelker has joined #openstack-ansible06:43
*** NobodyCam has quit IRC06:46
*** mubix has quit IRC06:46
*** mubix has joined #openstack-ansible06:52
*** NobodyCam has joined #openstack-ansible06:53
*** luksky has joined #openstack-ansible06:54
*** johnsom has joined #openstack-ansible06:55
*** starborn has joined #openstack-ansible06:57
*** Talion has joined #openstack-ansible07:01
*** serverascode has joined #openstack-ansible07:02
*** cshen has joined #openstack-ansible07:21
*** tosky has joined #openstack-ansible07:23
*** shyamb has quit IRC07:30
*** jbadiapa has joined #openstack-ansible07:31
*** shyamb has joined #openstack-ansible07:37
*** hamzaachi has joined #openstack-ansible07:55
*** DanyC has quit IRC08:00
*** DanyC has joined #openstack-ansible08:00
*** johnsom has quit IRC08:04
*** DanyC has quit IRC08:05
*** johnsom has joined #openstack-ansible08:05
*** shyamb has quit IRC08:07
*** phasespace has joined #openstack-ansible08:08
*** priteau has joined #openstack-ansible08:09
*** gkadam has joined #openstack-ansible08:09
*** gkadam has quit IRC08:10
*** nurdie has joined #openstack-ansible08:21
*** nurdie has quit IRC08:26
starbornTime appropiate greetings to everybody.08:29
starbornMaybe someone has a clue: I am running into problems with the second playbok (setup-infrastructure.yml) at "TASK [python_venv_build : Upgrade pip/setuptools/wheel to the versions we want]" -> "raise HTTPError(http_error_msg, response=self)\nHTTPError: 404 Client Error: Not Found for url: http://10.10.0.41:8181/os-releases/19.1.0.dev12/ubuntu-18.04-x86_64\n"08:32
starbornAll containers can reach all containers on all hosts. infra{1,2}_repo don't have the files but infra3_repo has them.08:34
jrosserstarborn: that is a known issue08:34
starbornI see. And what could be the solution? syncing everything manually?08:35
jrosserstarborn: here is a patch that should help https://review.openstack.org/#/c/652110/08:36
*** luksky has quit IRC08:36
jrosserthe sync runs on the first repo server, but due to a bug the files are generated on the last one, so never get synced08:37
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/stein: debian: add support  https://review.openstack.org/65231408:37
fnpanicgood morning08:38
*** luksky has joined #openstack-ansible08:39
starbornjrosser: Thanks. You saved my day :)08:39
jrosserstarborn: it looks like that patch is already backported to stable/stein, so you should be able to check out a later point in your repo_build role08:40
jrosserrepo_server sorry08:40
jrosseroh dear not enough coffee :) its python_venv_build :)08:41
CeeMacmorning08:51
spotzmorning08:53
*** shyamb has joined #openstack-ansible08:54
*** luksky has quit IRC09:07
*** Talion has quit IRC09:10
*** luksky has joined #openstack-ansible09:19
*** DanyC has joined #openstack-ansible09:21
*** shyamb has quit IRC09:34
*** shyamb has joined #openstack-ansible09:52
*** luksky has quit IRC10:03
*** shyamb has quit IRC10:19
*** shyamb has joined #openstack-ansible10:19
chandankumarjrosser: odyssey4me mnaser guilhermesp can we get this doc os_tempest userguide changes https://review.openstack.org/#/c/644570/ merged10:28
chandankumarthanks, when free!10:28
*** luksky has joined #openstack-ansible10:33
noonedeadpunkchandankumar I'd love to see links to opendev.org instead of git.openstack.org here https://review.openstack.org/#/c/644570/13/doc/source/user/installation.rst10:41
chandankumarkopecmartin: ^^10:42
noonedeadpunkAs you may know, everything will be redirected to opendev.org really soo, so I see no reasons to add links to git.openstack.org in order to replace them in several weeks10:42
noonedeadpunkbut probably we should listen someone else regarding this...10:43
kopecmartinare we really discussing two links? really? ..10:44
noonedeadpunkok, you're right, will place a follow-up patch10:47
kopecmartinnoonedeadpunk, thank you :)10:47
*** shyamb has quit IRC10:48
*** nicolasbock has joined #openstack-ansible10:55
*** shyamb has joined #openstack-ansible10:59
openstackgerritMerged openstack/openstack-ansible stable/stein: debian: add support  https://review.openstack.org/65233911:00
*** nurdie has joined #openstack-ansible11:01
*** nurdie_ has joined #openstack-ansible11:03
*** nurdie has quit IRC11:06
*** chhagarw has joined #openstack-ansible11:08
*** pcaruana has quit IRC11:17
*** nurdie_ has quit IRC11:23
*** nurdie has joined #openstack-ansible11:24
*** nurdie has quit IRC11:28
evrardjpI won't be able to attend the meeting today, I am off11:29
evrardjpFYI11:29
jamesdentonYou will be missed.11:30
evrardjphahaha11:30
evrardjphow are you jamesdenton?11:30
jamesdentonFeelin good.11:30
evrardjp:)11:31
jamesdentonI'm about to roll out Ironic. Wish me luck.11:31
evrardjpI hope you won't need it , but I still do it11:31
*** ansmith has quit IRC11:35
*** phasespace has quit IRC11:35
jamesdentonum.. what is HPE OneView... O_o11:38
CeeMacits a monitoring/management platform for HPE servers11:54
jamesdentonSeems our Ironic documentation only calls out that deployment scenario. CeeMac, fix that!11:55
jamesdenton:)11:56
CeeMacsure11:58
* CeeMac runs away11:58
*** vnogin has joined #openstack-ansible11:59
mnasermbuil, dirk, nicolasbock: so suse is now non voting a failing in stable/rocky btw — still pending/waiting for fixes12:02
noonedeadpunkmnaser https://review.openstack.org/#/c/648854/ partialy fixes it12:03
CeeMacjamesdenton, was ironic something that came out of HPs Helion project perchance?12:03
nicolasbockI am looking into it as well mnaser and noonedeadpunk12:03
CeeMacor is it just the OSA specific docs that call out OneView12:03
noonedeadpunkAnd it would be great to get https://review.openstack.org/#/c/652273/ merged:)12:04
jamesdentonCeeMac The docs call out that scenario, specifically. Which is fine. I just couldn't easily find alternatives. Will have to dig into it later12:04
CeeMacsounds fun. good job you have plenty free time atm :D12:04
*** pcaruana has joined #openstack-ansible12:04
jamesdentonlol true12:05
starbornThe infrastructure playbook fails at creating the MariaDB/Galera users: "The PyMySQL (Python 2.7 and Python 3.X) or MySQL-python (Python 2.X) module is required." – any ideas?12:05
mbuilmnaser, nicolasbock: yep, I was hoping to find time to debug this afternoon. THanks for the heads up anyway! :)12:06
starborn(All the containers are up and running and MariadB works fine in the container. The root credentials are also fine)12:07
jamesdentonjrosser I am not sure what is going on with the unsigned ubuntu-cloud-archive mirrors. The archive at canonical.com looks good, the mirrors appear to be missing a lot of stuff. http://ubuntu-cloud.archive.canonical.com/ubuntu/dists/bionic-updates/rocky/ vs http://mirror.gra1.ovh.openstack.org/ubuntu-cloud-archive/dists/bionic-updates/rocky/12:08
*** cshen has quit IRC12:13
jamesdentonjrosser The mirror comes from the nodepool environment vars[1]. Perhaps we can override that with 'uca_apt_repo_url' temporarily? [1] https://github.com/openstack/openstack-ansible-tests/blob/401fc3d5cdef09f99470f20256c2ecd7e36925fa/common-tasks/test-set-nodepool-vars.yml#L28. Here's the log: http://logs.openstack.org/41/652641/2/check/openstack-ansible-opendaylight-ubuntu-bionic/12ee052/job-output.txt.gz#_2019-04-15_12:15
jamesdenton17_02_09_07723412:15
jamesdentonerr, http://logs.openstack.org/41/652641/2/check/openstack-ansible-opendaylight-ubuntu-bionic/12ee052/job-output.txt.gz#_2019-04-15_17_02_09_07723412:15
*** shyamb has quit IRC12:16
*** priteau has quit IRC12:17
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: Enable support for novajoin tempest plugin  https://review.openstack.org/65298612:17
*** priteau has joined #openstack-ansible12:18
*** kplant has joined #openstack-ansible12:23
*** jbadiapa has quit IRC12:32
*** shyamb has joined #openstack-ansible12:37
*** ansmith has joined #openstack-ansible12:39
*** cshen has joined #openstack-ansible12:39
starbornFun Fact: "apt install python3-pymysql" executed within the galera containers solved the problem.12:41
odyssey4mestarborn which service/role was this for?12:43
odyssey4mestarborn also, which series/release was this for?12:44
chandankumarmnaser: odyssey4me Hello12:44
chandankumarmnaser: odyssey4me I want to discuss about smoke test patch https://review.openstack.org/#/c/652060/12:45
chandankumardo we want to make smoke test as a default or keep the existing test as it is.12:45
chandankumar?12:45
odyssey4mechandankumar both review feedback comments suggest making smoke the default whitelist instead12:46
*** vnogin has quit IRC12:46
*** aedc has quit IRC12:47
chandankumarodyssey4me: ok, got it, I mis understood the mnaser comment so poked here12:48
jrosserjamesdenton: i don't think its a UCA issue - see here http://logs.openstack.org/41/652641/2/check/openstack-ansible-opendaylight-ubuntu-bionic/12ee052/job-output.txt.gz#_2019-04-15_17_18_50_91450912:48
jrosserjamesdenton: the things there beginning W: are just warnings, the failure is this E:Failed to fetch http://ppa.launchpad.net/odl-team/fluorine/ubuntu/dists/bionic/main/binary-amd64/Packages  404  Not Found12:48
jamesdentonI think there's two issue there, if I'm reading it right. 1) the UCA isn't signed and 2) the ODL repo doesn't exist12:49
jrosserand thats becasue the repo isnt here https://launchpad.net/~odl-team/+archive/ubuntu/fluorine12:49
jrossersnap12:49
jrosseri don't think the signing matters12:49
jamesdentonOk, so it would accept an unsigned repo but is bailing on the 404?12:50
jrosseri believe so, yes12:50
mnaserUCA not being signed is ok12:50
jamesdentongot it.12:50
mnaserInfra purposesly does this12:50
mnaserSo people don’t use infra mirrors as actual mirrors12:50
jamesdentonOh, right on, mnaser. Well, I was hoping the fluorine bionic repo would be added yesterday, but it was only added for oxygen. I can ping again, or we can try to force fluorine/xenial via override12:51
mnaserjamesdenton: you can try pinging the LF release engineering team at #lf-releng12:52
mnaserYou likely would get a response there12:52
jamesdentonk12:52
jrosserjamesdenton: i don't think we got the override correct http://logs.openstack.org/41/652641/2/check/openstack-ansible-odl-sfc-ubuntu-bionic/3bb53a4/job-output.txt.gz#_2019-04-15_17_01_54_99323212:54
starbornodyssey4me: "TASK [galera_server : Create galera users]", regarding the version: I cloned the repo two weeks ago and did a "git pull" today. "git describe --tags" says "19.0.0.0rc1-33-g3e990058c"12:54
jamesdentonActually, just got a response from inquiry yesterday - fluorine/bionic should be ready in 30 min or so12:55
odyssey4mestarborn so you're running from stable/stein then?12:56
starbornodyssey4me: I hope so :)12:56
spotzdang I missed evrardjp12:57
jamesdentonjrosser Are you suggesting we put the override in the wrong location? :D12:57
odyssey4meinteresting - well https://github.com/openstack/openstack-ansible-galera_server/blob/master/vars/debian.yml#L36 should have provided the an appropriate package for it, but we should perhaps switch to the pymysql package now that ansible supports using it12:57
jrosserjamesdenton: i didnt understand how they worked :) it needs to be in each override file for each specific test i think12:58
jamesdentonjrosser It may be moot here shortly12:58
jrosseryes if the repo is being updated then no point fiddling with it any more12:58
jamesdentonjrosser http://ppa.launchpad.net/odl-team/fluorine/ubuntu/dists/bionic/12:59
jamesdentonrecheck!13:00
openstackgerritMerged openstack/openstack-ansible-os_tempest master: User guide  https://review.openstack.org/64457013:00
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_neutron master: Swap special CI jobs from xenial to bionic  https://review.openstack.org/65264113:01
jrosserjamesdenton: ^ thats without the override from yesterday....13:02
*** shyamb has quit IRC13:02
jamesdentoncool13:02
*** shyamb has joined #openstack-ansible13:03
*** pcaruana has quit IRC13:07
*** mkuf has joined #openstack-ansible13:10
*** pjm6_ has joined #openstack-ansible13:11
starbornI may have another rookie question: The execution of "ansible  galera_container -m shell -a (…)" fails with the error "No hosts matched, nothing to do" although there _is_ a "galera_container" group in /etc/openstack_deploy/openstack_inventory.json (The playbooks for creating the hosts and the infrastuctrure went through without any problems)13:19
starborn"/opt/openstack-ansible/scripts/inventory-manage.py -l" also shows all the hosts.13:20
noonedeadpunkstarborn: you probably should provide ansible path to dynamic inventory script13:20
odyssey4menoonedeadpunk or just cd into /opt/openstack-ansible and it will add the -i for you13:21
odyssey4mealso galera_all is more universal than galera_container, because it includes galera installed on either hosts or in containers13:21
noonedeadpunkyeah, this will also work:)13:22
*** EmilienM has joined #openstack-ansible13:27
EmilienMmnaser: hey13:27
EmilienMmnaser: are you aware of https://github.com/ansible/ansible/issues/50141 ?13:27
EmilienMI checked and you use the fact in OS ansible13:27
mnaserhiya13:28
* mnaser looks13:28
mnaserEmilienM: nope, but ouch, that's a pretty big thing to change13:28
openstackgerritMerged openstack/openstack-ansible-nspawn_container_create stable/stein: debian: add support  https://review.openstack.org/65236913:29
mnaserI think we still use ansible 2.7.9 in our gate right now13:29
mnaserso I don't know how much that breaks things, yet.13:29
EmilienMmnaser: expect 2.8 in RHEL8 / centos813:30
openstackgerritChandan Kumar (raukadah) proposed openstack/openstack-ansible-os_tempest master: Make smoke tests as a default whitelist tests  https://review.openstack.org/65206013:30
mnaserhoooboy13:30
mnaserokay, thanks for the heads up.13:30
mnaserEmilienM: is there any reasoning of the leading '2.' ?13:30
*** pcaruana has joined #openstack-ansible13:33
*** gillesMo has joined #openstack-ansible13:33
EmilienMmnaser: I don't know13:36
*** marst has joined #openstack-ansible13:36
EmilienMmnaser: will you be at the ansible meetup wednesday night in Montreal?13:36
EmilienM(I'll be)13:36
mnaserEmilienM: im speaking there!13:36
mnaser:P13:36
EmilienMWOW13:36
EmilienMawesome13:36
starbornodyssey4me: Changing into "/opt/openstack-ansible " didn't change anything. OTOH: " /opt/openstack-ansible/scripts/inventory-manage.py -g | grep galera" shows all the groups the galera installations belong t: "galera, galera_container, infra2-host_containers, shared-infra_all"13:36
mnaserlook forward to catching up :)13:37
EmilienMmnaser: yes definitely13:37
odyssey4mestarborn odd, because the wrapper script should pick up that you're in that subdirectory and source the env vars and include the -e: https://github.com/openstack/openstack-ansible/blob/master/scripts/openstack-ansible.sh#L3513:39
odyssey4mestarborn you should find that 'which ansible' returns '/usr/loca/bin/ansible'13:40
odyssey4me*local13:40
odyssey4mestarborn and that, in turn, is a symlink to the wrapper script put down by our ansible bootstrap13:40
mnaserhmm13:41
mnaserI just hit a snag on a debian deploy13:41
mnaserceph_client tries to install libvirt-bin .. why is it managing it?13:41
mnaserI was able to trace it back.. but only to the first commit ever13:42
mnaserMay 7, 2015 .. anyone remember why? :-P13:42
*** EmilienM has left #openstack-ansible13:42
spotzmnaser: For old history I usually ask cloudnull:)13:42
mnaserhttps://github.com/openstack/openstack-ansible-ceph_client/blob/4be411364820169d1de13898978ed7019cc28c86/vars/main.yml#L35-L3913:42
mnaserI just don't think it's necessary for us to manage that in ceph_client, os_nova installs the libvirt that it needs13:43
odyssey4memnaser I *think* it might be because there's one ceph-client lib that requires it, but I can't be sure.13:43
odyssey4memnaser regardsless, that would be handled in the package deps anyway, so it shouldn't be required13:43
odyssey4mealthough, that said - we did find that deps aren't upgraded if you upgrade the primary for ubuntu IIRC13:43
odyssey4meie if you upgrade libvirt-bin, it doesn't necessarily upgrade all its deps - so all the qemu packages stay at an older level... or something like that13:44
starbornodyssey4me: "which ansible" -> "/opt/ansible/bin/ansible" – and that's not a symlink but the wrappet itself it seems.13:44
starbornRunning with "-vvvv" also says "ansible python module location = /opt/ansible/lib/ansible"13:45
odyssey4mestarborn hmm, that's odd - because firstly we put it into /opt/ansible-runtime13:45
mnaserodyssey4me: right but I figure os_nova would handle that beforehand and do the stuff it needed to do *shrug*13:45
odyssey4meand secondly https://github.com/openstack/openstack-ansible/blob/master/scripts/bootstrap-ansible.sh#L157-L17113:46
odyssey4memnaser one would hope so13:46
starbornodyssey4me: Wait a moment …13:47
starbornodyssey4me: "/usr/local/bin/ansible" also exists and _is_ indeed a symlink to "/usr/local/bin/openstack-ansible"13:48
starbornodyssey4me: The $PATH is: "/opt/ansible/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/usr/games:/usr/local/games:/snap/bin"13:49
starbornSo that "/opt/ansible/bin/ansible" has precedence.13:49
odyssey4mestarborn ok, so how did /opt/ansible/bin get there?13:49
odyssey4mestarborn unless you mean /opt/ansible-runtime/bin ?13:50
starbornodyssey4me: No, it actually is "/opt/ansible/bin" (copy & pasted)13:50
odyssey4mestarborn and is /opt/ansible-runtime there?13:50
starbornodyssey4me: Yes.13:51
odyssey4mestarborn ok, so something else put /opt/ansible there and put it into the path too...13:51
odyssey4mestarborn that's kinda ok, but it does mean that you will have to do what our wrapper does manually if you leave it that way whenever you use 'ansible' or 'ansible-playbook'13:52
openstackgerritMohammed Naser proposed openstack/openstack-ansible-ceph_client master: debian: fix libvirt package name  https://review.openstack.org/65299813:54
openstackgerritMohammed Naser proposed openstack/openstack-ansible-ceph_client master: debian: fix libvirt package name  https://review.openstack.org/65299813:54
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty stable/stein: debian: add support  https://review.openstack.org/65234013:56
starbornodyssey4me: Sorry for wasting your time. I just found out that a colleague installed his own Ansible version and manipulated the $PATH accordingly.13:58
starborn:(13:58
odyssey4mestarborn no worries, now you know a little more about how we do things :)14:01
*** kopecmartin is now known as kopecmartin|off14:02
*** vnogin has joined #openstack-ansible14:05
*** marst has quit IRC14:07
*** markvoelker has quit IRC14:07
starbornodyssey4me: That's right. I really learned a lot about OpenStack Ansible in the last two weeks.14:07
chandankumarodyssey4me: do we have to switch this job openstack-ansible-functional-tempestconf-centos-7 to https://github.com/openstack/openstack-ansible-os_tempest/blob/master/zuul.d/jobs.yaml#L16 to integrated build?14:12
arbrandesWould love to get some eyes on https://review.openstack.org/652648, now that Zuul's ok with it. ;P14:13
odyssey4mechandankumar yeah, I think so14:13
chandankumarodyssey4me: Ok, I will do that.14:14
*** jbadiapa has joined #openstack-ansible14:15
ionidid you guys use kubernets deployed using magnum?14:16
arbrandesioni: sure.  any problems?14:18
*** priteau has quit IRC14:19
openstackgerritMerged openstack/openstack-ansible-os_congress stable/stein: debian: add support  https://review.openstack.org/65235914:19
ioniarbrandes, well i'm using cinder as storage and while deploying mysql , it does create the volume correctly but never attaches to volume to instances(minions) and it remains on pending. in the events i have 0/4 nodes are available: 1 node(s) had taints that the pod didn't tolerate, 3 node(s) had no available volume zone.14:19
ioniso it's something related to availability zone14:20
ionii have all services in the default zone, nova14:20
*** marst has joined #openstack-ansible14:21
ioniarbrandes, https://paste.xinu.at/lKx8/ storage class14:22
ioniarbrandes, if i manually create volume from opentack client and pass the id to a yaml to create an nginx pod, it works flawless14:25
ioniusing latest rocky, kubernets 1.11.514:25
openstackgerritMerged openstack/openstack-ansible-os_blazar stable/stein: debian: add support  https://review.openstack.org/65234214:26
ioniarbrandes, i'm following: https://kubernetes.io/docs/tutorials/stateful-application/mysql-wordpress-persistent-volume/14:29
openstackgerritMerged openstack/openstack-ansible-os_ironic stable/stein: debian: add support  https://review.openstack.org/65235014:32
openstackgerritMerged openstack/openstack-ansible-os_barbican stable/stein: debian: add support  https://review.openstack.org/65234314:35
*** nurdie has joined #openstack-ansible14:36
openstackgerritMerged openstack/openstack-ansible-os_tacker stable/stein: debian: add support  https://review.openstack.org/65235614:37
*** priteau has joined #openstack-ansible14:37
ionii was wondering osa stein supports ubuntu 16.04?14:46
openstackgerritMerged openstack/openstack-ansible-os_rally stable/stein: debian: add support  https://review.openstack.org/65234114:46
jrosserioni: rocky is the transition relase from 16.04->18.0414:48
jrosseryou need an OS upgrade to proceed beyond rocky14:48
ionijrosser, ok. thanks14:48
openstackgerritMerged openstack/openstack-ansible-os_heat stable/stein: debian: add suport  https://review.openstack.org/65235114:49
*** luksky has quit IRC14:50
openstackgerritMerged openstack/openstack-ansible-os_gnocchi stable/stein: debian: add support  https://review.openstack.org/65236414:51
openstackgerritMerged openstack/openstack-ansible-os_masakari stable/stein: debian: add support  https://review.openstack.org/65235414:51
openstackgerritMerged openstack/openstack-ansible-os_sahara stable/stein: debian: add support  https://review.openstack.org/65235314:51
openstackgerritMerged openstack/openstack-ansible-os_magnum stable/stein: debian: add support  https://review.openstack.org/65235514:51
openstackgerritMerged openstack/openstack-ansible-os_octavia stable/stein: debian: add support  https://review.openstack.org/65234514:51
openstackgerritMerged openstack/openstack-ansible-os_designate stable/stein: debian: add support  https://review.openstack.org/65236614:52
openstackgerritMerged openstack/openstack-ansible-os_panko stable/stein: debian: add support  https://review.openstack.org/65236514:54
openstackgerritMerged openstack/openstack-ansible-os_ceilometer stable/stein: debian: add support  https://review.openstack.org/65236314:54
jamesdentonjrosser Looks good now: https://review.openstack.org/#/c/65264114:55
jrosserjamesdenton: cool!14:56
*** strobelight has joined #openstack-ansible15:00
*** kaiokmo has quit IRC15:06
*** sreejithp has joined #openstack-ansible15:09
*** strobelight has quit IRC15:11
*** strobelight has joined #openstack-ansible15:12
starbornodyssey4me: Thanks for the help so far – "It's an invigorating ride" :)15:13
*** starborn has quit IRC15:13
*** eglute has joined #openstack-ansible15:15
mgariepyfun ;( https://github.com/openstack/openstack-ansible-lxc_container_create/blob/stable/rocky/tasks/lxc_container_network_new.yml << how to I prevent the network to restart ?15:15
*** Talion has joined #openstack-ansible15:15
*** nurdie has quit IRC15:17
*** fnpanic has quit IRC15:19
jamesdentonAs in, when networkd restarts you lose your connection?15:20
*** mubix has quit IRC15:20
*** mubix has joined #openstack-ansible15:20
*** hamzy has quit IRC15:22
jamesdentonmgariepy Might be relevant (but not real resolution): https://github.com/systemd/systemd/issues/607815:24
*** pcaruana has quit IRC15:27
*** nurdie has joined #openstack-ansible15:30
*** pcaruana has joined #openstack-ansible15:30
openstackgerritMerged openstack/openstack-ansible-os_swift stable/stein: debian: add support  https://review.openstack.org/65235815:31
*** ivve has quit IRC15:33
chandankumarok on smoke test, just two tests failed, let's fix it http://logs.openstack.org/60/652060/3/check/openstack-ansible-deploy-aio_metal-debian-stable/4f89348/logs/openstack/aio1-utility/stestr_results.html15:38
chandankumar'Invalid image identifier or unable to access requested image15:38
*** pcaruana has quit IRC15:40
*** vnogin has quit IRC15:40
*** fnpanic has joined #openstack-ansible15:45
*** pcaruana has joined #openstack-ansible15:46
*** gyee has joined #openstack-ansible15:50
*** dxiri has joined #openstack-ansible15:51
*** nurdie has quit IRC15:52
*** hamzaachi has quit IRC15:54
*** pcaruana has quit IRC15:55
*** pjm6_ has quit IRC15:59
*** nurdie has joined #openstack-ansible16:00
*** pcaruana has joined #openstack-ansible16:02
guilhermespmeeting time?16:02
mnaserah indeed.16:02
mnaser#startmeeting openstack_ansible_meeting16:03
openstackMeeting started Tue Apr 16 16:03:09 2019 UTC and is due to finish in 60 minutes.  The chair is mnaser. Information about MeetBot at http://wiki.debian.org/MeetBot.16:03
openstackUseful Commands: #action #agreed #help #info #idea #link #topic #startvote.16:03
mnaser#topic office hours16:03
*** openstack changes topic to " (Meeting topic: openstack_ansible_meeting)"16:03
openstackThe meeting name has been set to 'openstack_ansible_meeting'16:03
*** openstack changes topic to "office hours (Meeting topic: openstack_ansible_meeting)"16:03
mnasermy laptop is absolutely tanking right now, I'm trying to figure out what's going on, so ill be in and out16:03
mnaserweekly tc topics reminder16:03
mnaserand also, once we land all the patches, probably a good time to release rc216:03
jamesdentono/16:04
noonedeadpunko/16:04
nicolasbocko/16:04
noonedeadpunkmnaser: what do you think about landing https://review.openstack.org/#/q/topic:rabbitmq_vhost_policies+(status:open+OR+status:merged) (and backporting to stein?)16:05
jrossero/ hello16:05
noonedeadpunkI mean it would be great to get HA queues at once for stein16:08
*** pcaruana has quit IRC16:08
*** shyamb has quit IRC16:09
*** cshen has quit IRC16:12
guilhermespI particularly like the idea to make ha queues by default. It should not have any impact, we aim to reduce the variables and stuff but I think stuff like improving our HA are good to go16:17
guilhermespbackporting the topic to stein should be ok too imho16:19
noonedeadpunkI'll cover these additional variables by removing ceilometer ones from group_vars :p16:20
guilhermespthat's fair noonedeadpunk :)16:20
*** flaviosr_ has quit IRC16:21
redkriegI'm trying to install with stein but I'm getting a 404 on the repo server when running task "python_venv_build : Upgrade pip/setuptools/wheel to the versions we want", does anyone have any ideas?  I tried removing and rebuilding the pkgrepo container to no avail.  full error and context: http://paste.openstack.org/show/749379/16:23
mgariepyjamesdenton, network changes then restart for new config (from interfaces.d to networkd) while it's restarting the network is not up.16:35
jamesdentonmgariepy One of the shortcomings of networkd, IMO. I have not found a workaround16:36
*** pcaruana has joined #openstack-ansible16:36
mgariepya work around would be to wait to be on 18.04 to apply this change16:36
mgariepyor to serialize the restart so not all the servers goes down at once16:37
chandankumarguilhermesp: mnaser odyssey4me https://review.openstack.org/#/c/652986/ please jave a look16:39
chandankumarthanks!16:39
chandankumar*have16:39
*** dxiri has quit IRC16:43
*** cmart has joined #openstack-ansible16:44
*** cmart has quit IRC16:51
*** markvoelker has joined #openstack-ansible16:52
*** hamzaachi has joined #openstack-ansible16:52
*** markvoelker has quit IRC16:56
*** yolanda_ has quit IRC16:57
mnaserredkrieg: that’s a common bug. It’s solved in tip of stein. We should have a new rc soon17:00
mnaser#endmeeting17:00
*** openstack changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: http://bit.ly/2xA1eZC"17:00
openstackMeeting ended Tue Apr 16 17:00:55 2019 UTC.  Information about MeetBot at http://wiki.debian.org/MeetBot . (v 0.1.4)17:00
openstackMinutes:        http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-04-16-16.03.html17:00
* mnaser throws laptop out of window17:00
openstackMinutes (text): http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-04-16-16.03.txt17:01
openstackLog:            http://eavesdrop.openstack.org/meetings/openstack_ansible_meeting/2019/openstack_ansible_meeting.2019-04-16-16.03.log.html17:01
redkriegsorry for interrupting the meeting, didn't see that up there17:01
redkriegis there a commit I can check out to get this install working for now?17:01
*** devx has quit IRC17:03
*** cshen has joined #openstack-ansible17:03
*** cmart has joined #openstack-ansible17:11
*** priteau has quit IRC17:11
*** cshen has quit IRC17:11
nicolasbockHi noonedeadpunk, did you ever figure out how to get past https://bugs.launchpad.net/cinder/+bug/1806156 ?17:12
openstackLaunchpad bug 1806156 in Cinder "shared_targets_online_data_migration fails when cinder-volume service not running" [Undecided,Confirmed]17:12
nicolasbockWhy isn't that happening in CI?17:12
noonedeadpunkI guess because we init DB during CI17:13
noonedeadpunkBut never pass second time trough it17:13
nicolasbockYou mean when we install Queens we should or are initializing the DB?17:14
noonedeadpunkI suppose that you shouldn't face it on queens...17:14
nicolasbockI am upgrading from Queens to Rocky and am seeing this17:15
*** dxiri has joined #openstack-ansible17:15
nicolasbockThe cinder-volume service is running though17:15
nicolasbockSo I don't quite understand why the error message about waiting for a message17:16
nicolasbockAs far as I can tell all service are running just fine.17:16
noonedeadpunkDo not know as well... And hasn't found the way to pass trough it. However I wasn't really looking into it, as once you're on rocky, you may skip db migrations17:17
nicolasbockVery convenient ;)17:17
noonedeadpunkso the problem might be during migrations between releases17:17
openstackgerritMerged openstack/openstack-ansible-os_mistral stable/stein: debian: add support  https://review.openstack.org/65269517:17
noonedeadpunkas db structure may change17:17
nicolasbockOk17:17
nicolasbockI'll play around with this a bit more17:17
noonedeadpunkso it's might be a problem for you actually....17:18
noonedeadpunkyeah, let me know if you'll find smth:)17:18
nicolasbockDefinitely will17:18
*** cshen has joined #openstack-ansible17:23
openstackgerritMerged openstack/openstack-ansible-tests stable/stein: debian: add jobs  https://review.openstack.org/65232117:24
*** hamzy has joined #openstack-ansible17:27
*** cshen has quit IRC17:27
*** cmart has quit IRC17:35
*** cshen has joined #openstack-ansible17:36
*** cmart has joined #openstack-ansible17:36
*** kaiokmo has joined #openstack-ansible17:38
openstackgerritMohammed Naser proposed openstack/openstack-ansible stable/stein: debian: add job template for aio-lxc  https://review.openstack.org/65305817:40
openstackgerritMohammed Naser proposed openstack/openstack-ansible-nspawn_hosts stable/stein: debian: switch nspawn debian job to voting  https://review.openstack.org/65305917:41
openstackgerritMerged openstack/ansible-role-systemd_service stable/stein: debian: add ci and update meta  https://review.openstack.org/65232717:43
*** Kurlee has joined #openstack-ansible17:44
openstackgerritMerged openstack/openstack-ansible-apt_package_pinning stable/stein: debian: add ci and update meta  https://review.openstack.org/65232217:47
openstackgerritMerged openstack/openstack-ansible-memcached_server stable/stein: debian: add ci and update meta  https://review.openstack.org/65232317:48
*** cshen has quit IRC17:48
*** priteau has joined #openstack-ansible17:48
noonedeadpunkFolks, take a look at https://review.openstack.org/#/c/652268/ please - this seems to fixe suse on master17:49
openstackgerritMerged openstack/openstack-ansible-haproxy_server stable/stein: debian: add ci and update meta  https://review.openstack.org/65233317:49
*** Kurlee has quit IRC17:50
nicolasbockI don't understand. What's wrong with the image we load right now?17:51
nicolasbockIs it different?17:51
openstackgerritMerged openstack/openstack-ansible-openstack_hosts stable/stein: debian: add ci and update meta  https://review.openstack.org/65232617:54
openstackgerritMerged openstack/openstack-ansible-galera_client stable/stein: debian: add ci and update meta  https://review.openstack.org/65232517:54
openstackgerritMerged openstack/openstack-ansible-openstack_openrc stable/stein: debian: add ci and update meta  https://review.openstack.org/65232417:56
*** hamzaachi has quit IRC18:01
*** hamzaachi has joined #openstack-ansible18:02
openstackgerritMerged openstack/openstack-ansible-galera_server stable/stein: debian: add ci and update meta  https://review.openstack.org/65232918:05
*** DanyC has quit IRC18:07
openstackgerritMerged openstack/openstack-ansible-lxc_container_create stable/stein: debian: add ci and update meta  https://review.openstack.org/65232818:08
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server stable/stein: debian: add ci and update meta  https://review.openstack.org/65233018:12
*** electrofelix has quit IRC18:13
nicolasbockOh wait, is it because ara2c doesn't follow links?18:13
nicolasbocknoonedeadpunk: If that's the case, why not use curl or wget?18:14
nicolasbockThat would be easier than introducing another fact, don't you think?18:14
mnaserI think we have moved spawn role to use get_uri instead of aria2c18:16
*** vakuznet has joined #openstack-ansible18:16
mnaserevrardjp: I don't understand why we're dropping https://review.openstack.org/#/c/649892/18:19
mnaserwe need openstack_testing.yml to be included so its failing because of that18:20
*** vnogin has joined #openstack-ansible18:20
*** luksky has joined #openstack-ansible18:21
*** vnogin has quit IRC18:24
openstackgerritNicolas Bock proposed openstack/openstack-ansible-lxc_hosts master: Use get_url instead of aria2c  https://review.openstack.org/65307318:26
nicolasbockYou are right mnaser . Something like ^^ ?18:26
*** DanyC has joined #openstack-ansible18:26
mnasernicolasbock: small suggestion and we're good18:28
openstackgerritNicolas Bock proposed openstack/openstack-ansible-lxc_hosts master: Use get_url instead of aria2c  https://review.openstack.org/65307318:30
nicolasbockDone18:30
nicolasbockThanks!18:30
*** DanyC has quit IRC18:31
*** priteau has quit IRC18:33
*** Nick_A has joined #openstack-ansible18:37
*** irclogbot_2 has quit IRC18:39
*** irclogbot_0 has joined #openstack-ansible18:40
*** pjm6 has joined #openstack-ansible18:42
openstackgerritMerged openstack/openstack-ansible-lxc_hosts stable/rocky: opensuse: move suse jobs to non-voting  https://review.openstack.org/65227318:43
openstackgerritMerged openstack/openstack-ansible master: Add global HA policy for rabbitmq  https://review.openstack.org/65218618:45
*** cshen has joined #openstack-ansible18:46
openstackgerritNicolas Bock proposed openstack/openstack-ansible-lxc_hosts master: Use get_url instead of aria2c  https://review.openstack.org/65307318:46
*** chhagarw has quit IRC18:46
openstackgerritMerged openstack/openstack-ansible-os_glance stable/stein: debian: add ci and update meta  https://review.openstack.org/65234718:50
openstackgerritMerged openstack/openstack-ansible-os_keystone stable/stein: debian: add ci and update meta  https://review.openstack.org/65234818:53
openstackgerritMerged openstack/openstack-ansible-os_neutron stable/stein: debian: add ci and update meta  https://review.openstack.org/65234918:55
openstackgerritMerged openstack/openstack-ansible-os_nova stable/stein: debian: add ci and update meta  https://review.openstack.org/65235218:56
*** cshen has quit IRC18:57
openstackgerritMerged openstack/openstack-ansible-os_cinder stable/stein: debian: add ci and update meta  https://review.openstack.org/65234419:00
*** cshen has joined #openstack-ansible19:13
*** pjm6 has quit IRC19:20
*** rholloway has joined #openstack-ansible19:22
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/stein: debian: add ci and update meta  https://review.openstack.org/65234619:38
*** jsquare has quit IRC19:42
*** jsquare has joined #openstack-ansible19:42
*** chhagarw has joined #openstack-ansible19:49
openstackgerritMerged openstack/openstack-ansible-nspawn_hosts stable/stein: debian: switch nspawn debian job to voting  https://review.openstack.org/65305919:50
openstackgerritMerged openstack/ansible-role-python_venv_build stable/stein: debian: add ci and update meta  https://review.openstack.org/65233719:52
*** cshen has quit IRC19:58
*** cmart has quit IRC20:08
*** weshay has quit IRC20:14
*** weshay has joined #openstack-ansible20:15
*** pcaruana has quit IRC20:19
*** priteau has joined #openstack-ansible20:23
*** hamzaachi has quit IRC20:24
*** priteau has quit IRC20:27
*** ansmith has quit IRC20:30
*** DanyC has joined #openstack-ansible20:31
*** hamzy has quit IRC20:54
*** vakuznet has quit IRC20:54
*** kplant has quit IRC20:57
mnasercan I get reviews on https://review.openstack.org/#/c/652377/ ?21:04
mnaserthat is the *last* components21:04
*** kaiokmo has quit IRC21:10
redkriegmnaser: I hate to bug you but I've not been able to find anything related to that 404 on the pip repo issue in the bug tracker or recent commits.  do you know where I can look for more info on it?21:13
mnaserredkrieg: it is fixed by https://review.openstack.org/#/c/652252/21:13
mnasergit checkout stable/stein in your openstack-ansible folder21:14
mnaserand ./scripts/bootstrap-ansible.sh should get you going21:14
redkriegahh fantastic, thank you21:14
*** kplant has joined #openstack-ansible21:20
*** chhagarw has quit IRC21:27
arbrandesioni: sorry, I mean to try reproducing your issue, but haven't been able to, yet.  What I can tell you is that I haven't observed it myself, in a Rocky Magnum.21:29
mnasernoonedeadpunk: mind checking https://review.openstack.org/#/c/652377/ if you're around?21:33
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Optimizing the safety of the http link site in project.yaml.  https://review.openstack.org/61773721:37
*** nurdie has quit IRC21:41
*** nurdie has joined #openstack-ansible21:42
*** nurdie has quit IRC21:47
*** hamzaachi has joined #openstack-ansible21:47
*** strobelight has quit IRC21:54
*** cshen has joined #openstack-ansible21:55
*** cshen has quit IRC21:59
*** DanyC has quit IRC22:03
redkriegmnaser: I confirmed that the reverse filter is added after pulling the latest stable/stein and running bootstrap-ansible.sh. it felt like it ran longer, but I'm still getting the same 404 after running all three setup-* playbooks: http://paste.openstack.org/show/749400/22:06
mnaserredkrieg: hmm is this an upgrade?22:06
redkriegI had initially tried to upgrade from a fresh install of rocky, yes.  followed upgrade instructions to this error, figured I must've messed something up and deleted all the lxc containers and started over from bootstrap.22:07
mnaseryeah rocky->stein upgrades are not yet a thing22:08
redkriegI deleted them with the lxc-containers-destroy.yml playbook22:08
mnaserwe still have to document that process and get the upgrade tooling put in place properly22:08
openstackgerritMerged openstack/openstack-ansible stable/stein: Ensure debian is part of the bootstrap os list  https://review.openstack.org/65236822:08
mnaserim gonna guess the issue here is your pip conf still exists22:08
mnaserrm /root/.pip/pip.conf22:08
mnaserand you'll probably be good22:08
redkriegawesome, I'll give that a go.  thanks again22:09
*** sreejithp has quit IRC22:10
*** hamzaachi_ has joined #openstack-ansible22:15
*** hamzaachi has quit IRC22:17
*** ansmith has joined #openstack-ansible22:19
*** marst has quit IRC22:27
openstackgerritMerged openstack/openstack-ansible stable/stein: debian: add job template for aio-lxc  https://review.openstack.org/65305822:33
*** luksky has quit IRC22:35
*** ansmith has quit IRC22:38
*** ansmith has joined #openstack-ansible22:45
*** cshen has joined #openstack-ansible23:19
*** tosky has quit IRC23:19
*** cshen has quit IRC23:24
*** hwoarang has quit IRC23:57
*** hwoarang has joined #openstack-ansible23:58

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!