Friday, 2018-11-23

openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882000:12
*** cshen has joined #openstack-ansible00:21
*** cshen has quit IRC00:25
*** chhagarw has joined #openstack-ansible00:37
*** chhagarw has quit IRC00:39
*** eumel8 has quit IRC00:52
*** jawad_axd has joined #openstack-ansible01:05
*** jawad_axd has quit IRC01:09
*** jawad_axd has joined #openstack-ansible01:26
*** jawad_axd has quit IRC01:30
*** jawad_axd has joined #openstack-ansible02:07
*** jawad_axd has quit IRC02:11
*** cshen has joined #openstack-ansible02:22
*** cshen has quit IRC02:26
*** jawad_axd has joined #openstack-ansible02:49
*** jawad_axd has quit IRC02:53
*** ianychoi has quit IRC02:57
*** ianychoi has joined #openstack-ansible02:57
*** udesale has joined #openstack-ansible03:13
*** vnogin has joined #openstack-ansible04:17
*** vnogin has quit IRC04:21
*** cshen has joined #openstack-ansible04:22
*** cshen has quit IRC04:26
*** ivve has joined #openstack-ansible04:35
*** radeks__ has joined #openstack-ansible04:47
*** radeks_ has quit IRC04:50
*** radeks__ has quit IRC05:00
*** d3n14l has joined #openstack-ansible05:42
*** pcaruana has quit IRC05:44
*** cshen has joined #openstack-ansible06:01
*** cshen has quit IRC06:06
*** chhagarw has joined #openstack-ansible06:23
*** chandankumar has joined #openstack-ansible06:23
*** chandankumar is now known as chkumar|rover06:25
*** chkumar|rover is now known as chkumar|ruck06:25
*** pcaruana has joined #openstack-ansible07:08
*** rmart04 has joined #openstack-ansible07:11
*** rmart04 has quit IRC07:19
*** cshen has joined #openstack-ansible07:24
*** mma has joined #openstack-ansible07:44
*** mma has quit IRC07:46
*** mma has joined #openstack-ansible07:46
*** rmart04 has joined #openstack-ansible07:59
*** jawad_axd has joined #openstack-ansible08:02
*** rpittau has joined #openstack-ansible08:02
*** rmart04 has quit IRC08:11
*** frippe75 has quit IRC08:30
*** DanyC has joined #openstack-ansible08:34
MiougeGood morning everyone08:35
*** dcdamien has joined #openstack-ansible08:47
*** DanyC has quit IRC09:08
*** DanyC has joined #openstack-ansible09:09
*** DanyC has quit IRC09:09
odyssey4medmsimard thank you :) we try09:12
odyssey4meo/ Miouge09:12
odyssey4meDoes anyone have any idea why there's suddenly a bunch of timeouts going on in gates?09:13
odyssey4meit seems it's all related to the galera packages - 2 hrs to install the client: http://logs.openstack.org/35/619535/1/gate/openstack-ansible-deploy-aio_metal-opensuse-423/087f55d/job-output.txt.gz#_2018-11-22_14_38_29_50436909:14
*** tosky has joined #openstack-ansible09:15
*** emine__ has joined #openstack-ansible09:26
*** cshen has quit IRC09:35
*** d3n14l has quit IRC09:44
openstackgerritMaoyangLiu proposed openstack/openstack-ansible-os_neutron master: 1.modify the http link to https link 2. fix the Chinese punctuation  https://review.openstack.org/61968809:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/queens: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969009:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/pike: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969109:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client stable/queens: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969409:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client stable/pike: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969509:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/queens: Add MariaDB infrastructure mirrors  https://review.openstack.org/61969610:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/pike: Add MariaDB infrastructure mirrors  https://review.openstack.org/61969710:01
openstackgerritMerged openstack/openstack-ansible master: Add MariaDB infrastructure mirrors  https://review.openstack.org/61953510:14
jrosseri don't seem to be able to use the tempest role tags usefully with playbooks/os-temptest-install.yml10:20
jrosseri just want to rerun the tests but it's a bit all/nothing when using --tags10:20
*** cshen has joined #openstack-ansible10:22
*** chkumar|ruck has quit IRC10:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Move git SHA pins to group_vars  https://review.openstack.org/61962910:28
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Add MariaDB infrastructure mirrors  https://review.openstack.org/61971410:29
*** chandan_kumar has joined #openstack-ansible10:35
*** chandan_kumar is now known as chkumar|ruck10:35
*** electrofelix has joined #openstack-ansible10:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Add MariaDB infrastructure mirrors and disable nested virt  https://review.openstack.org/61971810:42
*** mcela1 has joined #openstack-ansible10:44
mcela1:jamesdenton We succesfully re-installed everything and used a new "clean" vlan (nodes did not have an interface on this vlan, so br-vlan.1324 was created by neutron). And everything appears to work correclty. On another note, we are having problems with neutron and floating IP's, since they lose connection intermitently. We suspect that this might be a problem with keepalive/HA configuration, because the output of "neutron l310:47
mcela1-agent-list-hosting-router myrouter" shows 3 routers in "active" mode10:47
*** udesale has quit IRC11:07
openstackgerritJonathan Herlin proposed openstack/openstack-ansible master: Add a check that keepalived interfaces have IPs  https://review.openstack.org/61909211:11
*** ahosam has joined #openstack-ansible11:20
*** flaviosr has joined #openstack-ansible11:25
*** rpittau_ has joined #openstack-ansible11:31
*** rpittau has quit IRC11:35
*** mma has quit IRC11:36
*** mma has joined #openstack-ansible11:36
*** rpittau_ is now known as rpittau11:43
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882011:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [docs] Clean up the AIO user story  https://review.openstack.org/61952211:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Implement AIO changes to allow test usage by roles  https://review.openstack.org/55179111:53
nowsterbootstrap-aio.sh still dying at:11:59
nowsterTASK [systemd_service : Create TEMP run dir] ***********************************11:59
nowsterfatal: [localhost]: FAILED! => {"msg": "'dict object' has no attribute 'interface'"}11:59
nowsterAny ideas for tracking this down.11:59
nowsterServer is a bare metal Intel core i7.11:59
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882012:02
*** ahosam has quit IRC12:03
*** cshen has quit IRC12:14
odyssey4menowster what distro is that, and is that a fresh host with no changes before the git checkout and running bootstrap-ansible/bootstrap-aio ?12:19
*** shardy has joined #openstack-ansible12:20
odyssey4menowster it seems likely that it doesn't relate to the task, but instead there's something looking at the current facts and it's not finding the right fact12:20
nowsterFresh host, ubuntu bionic12:21
odyssey4menowster does the host have eth0 ?12:21
nowsterno, it's called enp2s012:21
nowsterbut all the other networking has set itself up12:22
nowsterbr-vlan, etc.12:22
*** cshen has joined #openstack-ansible12:22
odyssey4meand that's using eth1, right?12:22
odyssey4me(which is a dummy interface)12:22
nowsterthere's no eth112:22
odyssey4mehmm, ok - let me finish up my current patch then I'll take a peek - but I suspect the issue has something to do with all that12:24
nowsterI have:12:26
nowsterlo, enp2s0, br-vlan, br-storage, br-vxlan, br-mgmt, dummy-lbaas, dummy-dbaas, du12:26
nowstermmy-vlan, dummy-storage, eth14@br-lbaas-veth, br-lbaas-veth@eth14, eth13@br-dbaa12:26
nowsters-veth, br-dbaas-veth@eth13, eth12@br-vlan-veth, br-vlan-veth@eth12, br-lbaas, b12:26
nowsterr-dbaas, dummy-vxlan, dummy-mgmt12:26
nowstersorry...   lo, enp2s0, br-vlan, br-storage, br-vxlan, br-mgmt, dummy-lbaas, dummy-dbaas, dummy-vlan, dummy-storage, eth14@br-lbaas-veth, br-lbaas-veth@eth14, eth13@br-dbaas-veth, br-dbaas-veth@eth13, eth12@br-vlan-veth, br-vlan-veth@eth12, br-lbaas, br-dbaas, dummy-vxlan, dummy-mgmt12:26
*** pcaruana has quit IRC12:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Implement AIO changes to allow test usage by roles  https://review.openstack.org/55179112:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Ensure AIO container_tech/install_method vars are namespaced  https://review.openstack.org/61923312:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [docs] Clean up the AIO user story  https://review.openstack.org/61952212:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Implement AIO changes to allow test usage by roles  https://review.openstack.org/55179112:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Implement AIO changes to allow test usage by roles  https://review.openstack.org/55179112:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Move git SHA pins to group_vars  https://review.openstack.org/61962912:44
odyssey4memnaser morning - could I get eyes on https://review.openstack.org/619691 & https://review.openstack.org/619697 too please12:49
odyssey4mealso https://review.openstack.org/61971412:49
odyssey4mejrosser evrardjp are either of you around? or any other cores?12:50
jrosserSort of :)12:50
*** noonedeadpunk has quit IRC12:50
*** noonedeadpunk[h] has joined #openstack-ansible12:50
odyssey4mejrosser it'd be helpful to get reviews for https://review.openstack.org/#/q/topic:osa-mariadb-mirrors+status:open asap to unblock queens/pike from all the timeouts due to slow mariadb mirrors12:51
*** noonedeadpunk[h] is now known as noonedeadpunk12:52
odyssey4menowster ok, I've kicked off a vagrant-based bionic image and have confirmed it has enp0s3 instead of eth0 - so hopefully I hit the same issue and can work it out12:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Add bionic to Vagrantfile  https://review.openstack.org/61972712:57
chkumar|ruckjrosser, Hello12:59
chkumar|ruckjrosser, http://logs.openstack.org/36/614336/3/check/openstack-ansible-functional-ubuntu-bionic/c29dc71/logs/ara-report/result/0c446a67-a6eb-434d-87c3-04e8bddace3d/13:00
chkumar|ruckjrosser, here barbican tempest plugin is there13:00
chkumar|ruckjrosser, but if we check distro jobs13:00
chkumar|ruckjrosser, http://logs.openstack.org/36/614336/3/check/openstack-ansible-functional-distro_install-ubuntu-bionic/312df80/logs/ara-report/result/b418aed2-7a67-4a04-b2a4-55569df06b97/13:00
chkumar|ruckjrosser, no plugin is found here13:00
chkumar|ruckjrosser, so no test discovered so regex passed to tempest13:01
chkumar|ruckso no tempest run13:01
chkumar|ruckjrosser, it is pretty much expected13:01
odyssey4mechkumar|ruck jrosser yes, for ubuntu there are no plugin packages - so we actually need to make all ubuntu distro jobs use the source based tempest install13:01
chkumar|ruckjrosser, on distro side we need to add barbican-tempest-plugin package13:01
odyssey4mehttps://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/ubuntu.yml#L29-L3313:02
chkumar|ruckjrosser, and rest is ok13:02
chkumar|ruckodyssey4me, can I change here tempest_install_method to source13:02
chkumar|ruckwill it overrides the value?13:02
odyssey4mechkumar|ruck where?13:03
chkumar|ruckodyssey4me, https://github.com/openstack/openstack-ansible-os_tempest/blob/master/vars/ubuntu.yml#L2913:04
chkumar|ruck?13:05
chkumar|ruckor we need to handle overrides some where else?13:05
odyssey4mechkumar|ruck yeah, I'm looking to see what'd be best13:05
chkumar|rucklet me push a patch and see how it goes13:06
odyssey4meI guess that might work.13:06
openstackgerritChandan Kumar proposed openstack/openstack-ansible-os_tempest master: Use tempest_install_method to source for ubuntu distro job  https://review.openstack.org/61972913:08
chkumar|ruckjrosser, ^^13:08
jrosserCool, thanks for taking a look13:09
odyssey4meah, it won't actually help for the role test though, because extra vars have a higher precedence that anything, and the distro install is being set via an extra var13:09
chkumar|ruckjrosser, odyssey4me https://review.openstack.org/#/c/619024/13:09
odyssey4meso https://github.com/openstack/openstack-ansible-tests/blob/master/test-distro_install-vars.yml#L54 would have to be set via some jinja which sets it to source for ubuntu, but distro for all others13:10
odyssey4melemme do a patch for that quick13:10
chkumar|ruckodyssey4me, sure13:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Always use source installs for tempest on ubuntu  https://review.openstack.org/61973013:14
odyssey4methat should do the trick13:14
evrardjpodyssey4me: hey I am there13:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Always use source installs for tempest on ubuntu  https://review.openstack.org/61973213:19
evrardjpodyssey4me: should I update the a-r-r for rocky with the new galera_server role?13:23
odyssey4meevrardjp no need - those all merged before rocky was cut13:23
*** sep has quit IRC13:24
evrardjpit's okay13:24
evrardjpyeah13:24
evrardjpI saw it13:24
evrardjpchanged my bad review with a better one13:24
evrardjpthanks there13:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Implement AIO changes to allow test usage by roles  https://review.openstack.org/55179113:26
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Implement AIO changes to allow test usage by roles  https://review.openstack.org/55179113:27
odyssey4meevrardjp tyvm13:27
odyssey4mejrosser also tyvm13:28
*** sep has joined #openstack-ansible13:30
odyssey4menowster odd, I don't get any failures13:31
chkumar|ruckodyssey4me, https://github.com/openstack/openstack-ansible-os_tempest/blob/master/defaults/main.yml#L1913:37
odyssey4mechkumar|ruck yes?13:37
chkumar|ruckodyssey4me, let's depend on tempest binary for everything instead of stestr?13:37
odyssey4mechkumar|ruck https://github.com/openstack/openstack-ansible-os_tempest/commit/74f49fc12f3cd5a67cb05aa6cff0fa12c3855e7413:37
chkumar|rucktempest run --subunit also generates subunit result13:37
odyssey4mechkumar|ruck oh really? if that's the case, then yeah - go ahead and patch it to remove that extra variable13:38
chkumar|ruckodyssey4me, since there will be no support for tempest from ubuntu side there we are good to go13:38
*** mcela1 has left #openstack-ansible13:39
nowsterodyssey4me: any ideas where to look for where it's trying to retrieve that info?13:39
odyssey4menowster I'm guessing it's cached facts, but I have no idea what's trying to use it - which would be handy.13:40
odyssey4menowster if you remove the /etc/openstack_deploy/ansible_facts folder, then try bootstrapping again, does it work?13:41
nowsterI'm going to start from bare metal again.13:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Implement AIO changes to allow test usage by roles  https://review.openstack.org/55179113:56
*** speedmann has joined #openstack-ansible13:58
nowsterodyssey4me: did "rm -rf ansible_facts"... still fails.13:58
odyssey4menowster ok, that's odd - is python installed on the host? I wonder if there's some sort of dependency missing13:59
openstackgerritMerged openstack/openstack-ansible-tests stable/queens: Add MariaDB infrastructure mirrors  https://review.openstack.org/61969614:00
nowster# python -V14:00
nowsterPython 2.7.15rc114:00
nowsterIn the facts dir... localhost has:14:01
nowster    "ansible_default_ipv4": {},14:01
nowster    "ansible_default_ipv6": {},14:01
odyssey4meoh, that'd be a problem14:01
mgariepyhttp://logs.openstack.org/54/619354/1/check/openstack-ansible-deploy-aio_distro_lxc-ubuntu-bionic/372515b/logs/openstack/aio1_cinder_api_container-d64d2f9a/cinder/cinder-volume.log.txt.gz#_2018-11-22_21_30_55_28014:01
mgariepycinder issue on rocky ?14:01
odyssey4menowster does the host have a default route set?14:01
nowsteryes14:01
nowsterdefault via 10.35.7.254 dev enp2s0 proto dhcp src 10.35.6.147 metric 10014:02
odyssey4menowster hmm, I wonder why ansible is not seeing that as the default address then14:02
odyssey4menowster I think you should be able to work around that by setting this variable when running the bootstrap: https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/defaults/main.yml#L20614:03
odyssey4menowster export BOOTSTRAP_OPTS="bootstrap_host_public_address=<the address usable for access from outside the box>"14:04
odyssey4meI suspect that it doesn't allow a dhcp address to be used - it likely needs to be static14:05
odyssey4memgariepy well, that looks like some clean up is required14:05
mgariepyhttps://review.openstack.org/#/c/617053/214:05
mgariepyfound it.14:05
mgariepyi guess it needs to merge also ;)14:06
nowsterodyssey4me: maybe it doesn't like rfc1918 addresses14:06
odyssey4meoh dear http://logs.openstack.org/14/619714/1/check/openstack-ansible-deploy-distro_ceph-opensuse-423/f25435d/job-output.txt.gz#_2018-11-23_11_57_27_13538714:08
*** chkumar|ruck has quit IRC14:15
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_placement master: [WIP] Create base files to install placement  https://review.openstack.org/61882014:22
odyssey4mecores could I get some eyes on https://review.openstack.org/619218 to remove some cruft ?14:22
*** jawad_axd has quit IRC14:26
openstackgerritMerged openstack/openstack-ansible-tests stable/pike: Add MariaDB infrastructure mirrors  https://review.openstack.org/61969714:29
mnaserim stuck on https://review.openstack.org/#/c/608433/ and not sure why it's not able to access the vip14:30
mnaserhelp appreciated :) i'll try to spin up a vm with it soon but if anyone sees something glaring..14:30
*** jawad_axd has joined #openstack-ansible14:32
nowsterodyssey4me: if I run "ansible -c local -m setup localhost" it gets the right info14:32
odyssey4menowster awesome :)14:32
nowsterBut why doesn't it get it ordinarily?14:33
odyssey4menowster what did you change to make it work?14:33
nowsterand then when you re-run bootstrap-aio.sh it fails again14:33
nowsterand has wiped the facts14:33
nowsternothing was changed to get ansible guessing correctly14:34
jrossermnaser: have you had to deal with this? nova.compute.manager [instance: 2159468e-f5bd-4330-abde-b6e66835f5f2] UEFINotSupported: UEFI is not supported14:34
odyssey4mehmm, ok - check the cached facts to see whether it has the same contents?14:34
mnaserjrosser: eh yes, you have to use a custom image to boot stuff on arm14:34
jrosserdoh14:35
nowsterodyssey4me: in  /etc/openstack_deploy/ansible_facts ?14:35
mnaseris there a cirros arm image?14:35
jrosserthats what happens with cirros arm6414:35
jrosserunless theres something else that needs fixing too......14:35
*** jawad_axd has quit IRC14:36
odyssey4menowster yep, there should be a file per host with the facts cached in each file14:41
nowsterodyssey4me: but if I've wiped that directory?14:42
odyssey4menowster run the bootstrap-aio again and it should recreate it14:42
nowsteryes, and it creates it with the empty default.ipv414:42
odyssey4menowster ok, now run ansible -m setup localhost - it should update the cached facts14:43
nowsterdone that... and bootstrap-aio.sh overwrites them with the wrong ones14:43
odyssey4meugh, 'ansible-playbook' gathers facts differently when set to in the play, versus the setup module14:44
odyssey4meclearly it's doing something different, and it's not meeting some condition which results in the fact not being populated14:45
odyssey4mecould you try and set that interface to be a static address? or override the bootstrap-host role default as suggested?14:45
nowsteractually, that worked.14:45
odyssey4meyeah, unfortunately playbook fact gathering is not as good as using the setup module in a task14:46
nowsterrunning bootstrap-aio.sh, having it fail, then "ansible -c local -m setup localhost", then boostrap-aio.sh again, works14:46
nowsterodyssey4me: pointer to the playbook stuff and I'll investigate?14:47
odyssey4menowster it's an ansible bug - not an OSA bug14:47
nowsteroh, right.14:47
odyssey4meThere are a few bugs around the difference between running the setup module and the gather_facts option. It relates to using smart gathering IIRC. All in all, it's one of the frustrations of inconsistencies.14:48
odyssey4meA workaround could be to have the playbook use the setup module prior to running the role.14:48
odyssey4meie add pre_tasks here https://github.com/openstack/openstack-ansible/blob/master/tests/bootstrap-aio.yml#L20 with a task that runs the setup module14:49
*** cshen has quit IRC14:49
odyssey4meusing this gather_subset argument: https://github.com/openstack/openstack-ansible/blob/master/scripts/gate-check-commit.sh#L14314:50
*** mma has quit IRC14:50
odyssey4methe argument just reduces the time taken by excluding unnecessary fact gathering (ohai & facter)14:50
openstackgerritMerged openstack/openstack-ansible-galera_client stable/pike: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969514:51
openstackgerritMerged openstack/openstack-ansible-galera_client stable/queens: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969414:51
*** mma has joined #openstack-ansible14:51
nowsterjrosser: Have now got (with your patches and suggestions) to the xml library missing failure point14:53
nowsterprobably missing "python-lxml" somewhere14:54
jrossernowster: ok - i've not addressed that yet so just apt installed libxslt1.1 into the utility container14:54
jrosserlxc-attach to the container, apt to install and it'll get a bit further14:55
jrosserdid you see my question to mnaser earlier about the UEFI images? that will be the next thing to fail14:55
*** mma has quit IRC14:56
*** rgogunskiy has quit IRC15:04
openstackgerritMerged openstack/openstack-ansible-galera_server stable/queens: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969015:10
nowsterjrosser: ta15:12
nowsternot spotted that one (UEFI)15:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Add MariaDB infrastructure mirrors and disable nested virt  https://review.openstack.org/61971815:12
openstackgerritMerged openstack/openstack-ansible-galera_server stable/pike: Use OpenStack infrastructure MariaDB mirrors  https://review.openstack.org/61969115:13
nowstererk... Cannot initiate the connection to ubuntu-cloud.archive.canonical.com:80 (2001:67c:1360:8c01::23). - connect (101: Network is unreachable)"15:13
nowsterthis is x86-64 with no ipv6 connectivity15:14
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Fix ansible-sshd version  https://review.openstack.org/61899515:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Fix ansible-sshd version  https://review.openstack.org/61899515:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Fix ansible-sshd version  https://review.openstack.org/61899515:24
odyssey4mecores - it'd be good to get reviews for https://review.openstack.org/618995 asap as it's a gate unblocker for pike15:25
*** cshen has joined #openstack-ansible15:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Move git SHA pins to group_vars  https://review.openstack.org/61962915:28
*** jawad_axd has joined #openstack-ansible15:30
odyssey4meevrardjp will https://review.openstack.org/#/c/619629/5 be ok for your release tooling?15:31
*** jawad_axd has quit IRC15:33
*** jawad_axd has joined #openstack-ansible15:34
evrardjpodyssey4me: this will require slight adaptations, but I have bigger concerns by adding all those to group vars15:34
odyssey4meevrardjp like?15:34
odyssey4me(bearing in mind that this is an interim measure to unblock getting rid of repo_build)15:35
evrardjpwell here those variables were loaded only when needed, so workers didn't have to carry those15:35
evrardjpyeah15:35
evrardjpwell15:35
*** shardy has quit IRC15:36
odyssey4meI can turn some attention to killing more of the other group vars to compensate if this is a concern.15:36
evrardjpI guess my question is what are the next steps -- I am curious about this temp step15:38
evrardjpodyssey4me: I thought we could directly remove -- let's say glance sha -- from the integrated, with a depends on the sha in the glance role15:39
odyssey4mewell, with this in place, the roles can simply use those vars - so repo build should be able to go away entirely... all I need is to change the integrated repository's pip arguments15:39
odyssey4megetting the in-role pinning done is going to take quite a bit of time, and I'm not sure that's going to get done by release15:40
evrardjpwhy not? What's the issue?15:40
evrardjpI mean we can move role per role15:40
evrardjpI thought that was the plan15:40
odyssey4meI don't have enough time to work through them all in time for release.15:40
evrardjpbut you don't have to be alone15:41
odyssey4meDoing this allows each role to do its builds, and us to remove repo build and the py pkgs plugin... then we can move the pinning into the roles as a next step.15:41
evrardjpas long as we have an example with one role, that gets removed from the integrated, and mvoed to role15:41
evrardjpok that's the thing, I thought this was the other way around15:41
evrardjpwe moved pins towards roles, slowly, removing the corresponding things of integrated15:42
evrardjpand then, we nothing remains, remove repo build and py_pkgs15:42
evrardjpI guess it's all about the same15:42
odyssey4meI think this will get better results more quickly.15:42
odyssey4meIt also helps us to switch to using the integrated build for role tests more quickly.15:42
evrardjpI don't see the speed gain there, but I might not have your oversight/vision15:43
evrardjpI will adapt the tooling anyway :)15:44
odyssey4mewell, I'm also kinda just feeling this out as I go - this way seemed a simple way to make progress15:44
odyssey4methe in-role pinning is going to involve more difficult work which also involves proposal bot things which I'm not entirely sure how best to tackle15:45
odyssey4meas far as I can see, this is an easier change to follow15:45
evrardjpproposal bot is the automation of the process, like we'd do proposal bot for bumping shas15:48
evrardjpI'd not take that into account for now15:48
evrardjpseparate problem domains :)15:48
odyssey4mebasically I'm saying that starting in the roles with this is harder than starting here as far as I can see. I'll run a trial now, but I think with this and some more group_var changes on top, repo_build is dead.15:51
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Move git SHA pins to group_vars  https://review.openstack.org/61962915:51
evrardjpodyssey4me: yeah but you have to unravel all the pain of the removal of repo_build, because of its intertwined nature15:56
odyssey4meyep, working on that now15:56
evrardjpif you want I can work on the bumping of the shas in the roles, as this is not dependant of your work15:56
odyssey4meI think a few bits will have to be done before that.15:58
evrardjpI guess that's the part I don't get :)15:58
odyssey4me1. we have to wean the roles away from using git on the repo server, so the 'smart-sources' patches cloudnull started need to be finalised and merged so that we're using the wheel contents rather than fetching from git15:59
*** pcaruana has joined #openstack-ansible16:00
evrardjpwhat I'd do is ... 1) move role x to be developer_mode: True by default (and therefore only build locally), 2) match shas between integrated and role, 3) remove all mention of developer_mode, 4) repeat16:01
evrardjpas 1) 2) 3) is effectively the role tests IIRC16:01
odyssey4me2. we need to decide how important offline source-based installs are for now... it's easier to leave that out initially, then focus on it later... otherwise we have to work out a process for getting all the git repositories and putting them onto the repo server in the python_venv_build role or somewhere else, and how to switch between using that or going online16:01
evrardjpI guess offline source-based installs don't matter anymore16:01
odyssey4me3. we have to make developer mode usable in the new world16:02
odyssey4meI've got a plan written out for developer mode. I just need to execute on it.16:03
evrardjpthat's the thing, I have the impression it's a lot of work for a few people again, and I just don't want burnout of people due to stresses of bringing broken things16:03
*** jawad_axd has quit IRC16:04
evrardjpwell I'm no ptl anymore though, so I shouldn't judge that :p16:04
evrardjpI just personally care :p16:04
*** dave-mccowan has joined #openstack-ansible16:05
odyssey4mewell, lemme see how this patch plays out in the gate - I'll switch back to working on developer mode for a role to see how my plan plays out16:05
odyssey4meI have the feeling that this is all going to have to come together anyway.16:05
odyssey4meI switched focus to the integrated build to try and get it to be easier to use for role tests - and I think that's largely done now. I just need to do a trial test for one of the roles to see how well it works.16:06
evrardjpmaybe the big bang is not too bad here16:06
odyssey4mespeaking of which https://review.openstack.org/#/c/551791/41 just passed :)16:09
odyssey4meit'd be good to get eyes on that, along with https://review.openstack.org/#/c/619522/516:10
*** blinkiz has quit IRC16:20
*** jawad_axd has joined #openstack-ansible16:24
*** jawad_axd has quit IRC16:27
*** jawad_axd has joined #openstack-ansible16:27
nowsterI now have master running on x86_64. Had to re-run some of the playbooks due to not failing over from IPv6 to IPv4 correctly.16:28
noonedeadpunkI try to configure a QoS for neutron and it seems, that qos extension is present for linuxbridge plugin only on compute node https://github.com/openstack/openstack-ansible-os_neutron/blob/master/templates/plugins/ml2/linuxbridge_agent.ini.j2#L30, while https://docs.openstack.org/neutron/rocky/admin/config-qos.html#configuration says it should present both on compute and networking node16:28
noonedeadpunkDoes anyone have working QoS with linuxbridge agent?16:29
*** DanyC has joined #openstack-ansible16:30
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible-os_neutron master: Add port_forwarding to neutron configuration.  https://review.openstack.org/61964016:33
mgariepymbuil, added the link.16:33
*** rpittau has quit IRC16:45
*** dave-mccowan has quit IRC16:45
*** cshen has quit IRC16:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Add integrated deploy/upgrade jobs  https://review.openstack.org/61976516:46
*** cshen has joined #openstack-ansible16:48
*** DanyC has quit IRC16:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Try using a dynamic scenario  https://review.openstack.org/61976816:53
noonedeadpunkAlso "append['qos']" looks pretty strange for me... I thought, that "()" must be used for jinja append16:53
openstackgerritMerged openstack/openstack-ansible master: Remove unnecessary octavia scenario AIO bootstrap  https://review.openstack.org/61921816:53
*** DanyC has joined #openstack-ansible16:54
openstackgerritDmitriy Rabotjagov (noonedeadpunk) proposed openstack/openstack-ansible-os_neutron master: Fix linuxbridge agent extensions  https://review.openstack.org/61977117:04
*** DanyC has quit IRC17:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: [WIP] Try using a dynamic scenario  https://review.openstack.org/61976817:06
odyssey4mecores - https://review.openstack.org/#/c/619233/ is ready for review, which helps us move towards using the integrated repo for all tests17:21
odyssey4mealso https://review.openstack.org/619522 which updates the AIO user story to make a bit more sense17:22
odyssey4methis whole chain would be good to get eyes on https://review.openstack.org/#/q/topic:use-integrated-repo-for-all-tests+(status:open+OR+status:merged)17:22
*** rmart04 has joined #openstack-ansible17:34
odyssey4memnaser just did a test patch for glance role testing using the integrated repo, and https://review.openstack.org/#/c/619765/1 has done all the right things (just installs keystone, haproxy, glance) and passed tempest :)17:34
mnaserodyssey4me: that is so beyond exciting17:35
mnaseryay for not breaking things17:35
*** emine has joined #openstack-ansible17:35
odyssey4meso yeah, I'll work some more on it next week - but it's a good start... I'm stoked that it's working for a basic test at least17:37
odyssey4memuch the same run time as the current role tests too, which is good :)17:37
*** Adri2000 has quit IRC17:38
*** emine__ has quit IRC17:38
*** jmccrory has quit IRC17:38
odyssey4meso yeah - please review what's up - anything from here on will rely on what's up being ok for everyone17:39
odyssey4metime to w/end! :)17:39
*** Adri2000 has joined #openstack-ansible17:39
*** jmccrory has joined #openstack-ansible17:39
mnaserodyssey4me: have a good evening17:43
*** chhagarw has quit IRC17:48
*** dcdamien has quit IRC17:55
mnaserdo we have a pattern for checking if a service is deployed18:01
mnaseri.e. i want to have magnum set `magnum_cert_manager_type` to `barbican` if barbican is deployed18:02
logan-there should be an example in most of the core services using local facts18:03
*** jawad_axd has quit IRC18:06
*** rmart04 has quit IRC18:09
*** rmart04 has joined #openstack-ansible18:10
*** rmart04 has quit IRC18:27
*** jawad_axd has joined #openstack-ansible18:31
noonedeadpunkprobably oftopic question, but I've just noticed, that neutron dnsmasq replies on DNS recursive requests from worldwide on Rocky/ Does this problem occur only for me (due to some bug in neutron itself), or it's a common issue?18:31
*** hamzaachi has joined #openstack-ansible18:49
*** jawad_axd has quit IRC18:59
*** dcdamien has joined #openstack-ansible19:00
*** DanyC has joined #openstack-ansible19:06
*** electrofelix has quit IRC19:06
*** DanyC has quit IRC19:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Remove unnecessary octavia scenario AIO bootstrap  https://review.openstack.org/61979219:18
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/rocky: Remove unnecessary octavia scenario AIO bootstrap  https://review.openstack.org/61979219:18
jamesdentonnoonedeadpunk - https://bugs.launchpad.net/neutron/+bug/150120619:19
openstackLaunchpad bug 1501206 in neutron "router:dhcp ports are open resolvers" [High,In progress] - Assigned to Dr. Jens Harbott (j-harbott)19:19
noonedeadpunkThanks jamesdenton... But it seems, that patch stuck somewhere on it's way, and it's not going to change in the nearest future...19:21
jamesdentonyeah it's been around a while19:21
noonedeadpunkIs there some normal workaround this stuff? As by far the only way, which I found during quick research, is to set no-resolv in dnsmasq-neutron.conf, and dnsmasq_local_resolv=True in dhcp_agent.ini (with commenting out dnsmasq_dns_servers), but I think I've broke smth for customers without DNS in their networks...19:25
noonedeadpunkSo dnsmasq sends just empty reply to attaker, which is not really usefull for them...19:26
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible stable/rocky: move ceph-ansible to stable-3.2 instead of stable-3.1  https://review.openstack.org/61979619:36
openstackgerritMarc Gariépy (mgariepy) proposed openstack/openstack-ansible stable/rocky: Add openstackclient bash completion  https://review.openstack.org/61935419:39
*** dw has quit IRC19:48
*** emine has quit IRC19:58
*** cshen has quit IRC20:03
*** cshen has joined #openstack-ansible20:19
mgariepynice. now i have the same error  on ceph-ubuntu-bionic, xenial and ceph opensuse ! :D20:34
*** cshen has quit IRC20:34
*** cshen has joined #openstack-ansible20:36
*** noonedeadpunk has quit IRC20:37
mgariepyanyone seens this ? http://logs.openstack.org/54/619354/2/check/openstack-ansible-deploy-ceph-ubuntu-xenial/f0f7eff/job-output.txt.gz#_2018-11-23_20_29_25_15797920:42
mgariepyERROR! The requested handler 'restart ceph mons' was not found in either the main handlers list nor in the listening handlers list20:42
*** dave-mccowan has joined #openstack-ansible20:56
*** dave-mccowan has quit IRC21:11
guilhermespppl, in order to test so_placement role, would I need to create the task like "test-install-placement.yml" in here https://github.com/openstack/openstack-ansible-tests ?21:16
openstackgerritMerged openstack/openstack-ansible stable/pike: Fix ansible-sshd version  https://review.openstack.org/61899521:19
*** fimaz has joined #openstack-ansible21:22
openstackgerritLogan V proposed openstack/openstack-ansible stable/queens: Update etcd role to v2.0  https://review.openstack.org/61640821:24
*** fimaz has quit IRC21:29
*** fimaz has joined #openstack-ansible21:30
*** jawad_axd has joined #openstack-ansible21:34
*** hamzaachi has quit IRC21:44
*** hamzaachi has joined #openstack-ansible21:45
*** pcaruana has quit IRC21:46
*** hamzaachi has quit IRC21:46
*** hamzaachi has joined #openstack-ansible21:47
openstackgerritgit-harry proposed openstack/openstack-ansible stable/ocata: Fix ansible-sshd version  https://review.openstack.org/61980021:49
*** fimaz has quit IRC21:49
*** fimaz has joined #openstack-ansible21:49
*** hamzaachi has quit IRC21:57
*** hamzaachi has joined #openstack-ansible21:58
*** hamzaachi has quit IRC21:59
*** hamzaachi has joined #openstack-ansible21:59
*** fimaz has quit IRC22:01
*** hamzaachi has quit IRC22:04
*** hamzaachi has joined #openstack-ansible22:05
*** hamzaachi has quit IRC22:06
*** hamzaachi has joined #openstack-ansible22:06
*** fimaz has joined #openstack-ansible22:11
*** fimaz has quit IRC22:12
*** lbragstad has joined #openstack-ansible22:53
*** dcdamien has quit IRC22:53
*** hamzaachi has quit IRC23:11
*** hamzaachi has joined #openstack-ansible23:12
*** hamzaachi has quit IRC23:13
*** hamzaachi has joined #openstack-ansible23:14
*** jawad_axd has quit IRC23:30
*** hamzaachi has quit IRC23:42
*** cshen has quit IRC23:43

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!