*** thorst has joined #openstack-ansible | 00:04 | |
*** thorst has quit IRC | 00:31 | |
*** markvoelker has joined #openstack-ansible | 00:45 | |
*** kristian__ has joined #openstack-ansible | 00:49 | |
*** kristian__ has quit IRC | 00:54 | |
*** hw_wutianwei has joined #openstack-ansible | 01:07 | |
*** thorst has joined #openstack-ansible | 01:08 | |
*** thorst has quit IRC | 01:08 | |
*** thorst has joined #openstack-ansible | 01:09 | |
*** thorst has quit IRC | 01:13 | |
*** thorst has joined #openstack-ansible | 01:25 | |
*** thorst has quit IRC | 01:27 | |
cloudnull | evenings | 01:47 |
---|---|---|
cloudnull | tasker: still around | 01:47 |
cloudnull | the issue is that haproxy will only load the one hap config | 01:47 |
cloudnull | you have to concatenate the files into the single config | 01:48 |
cloudnull | if you run the hap role from osa on the now upgraded host it will do the needful | 01:48 |
cloudnull | the code path between trusty and xenial are similar however there are differences specific to systemd | 01:49 |
cloudnull | mw_: hum. | 01:49 |
cloudnull | are you enabling l3-ha? | 01:50 |
cloudnull | maybe something getting out of sync ? | 01:50 |
*** chyka has joined #openstack-ansible | 02:19 | |
*** chyka has quit IRC | 02:23 | |
*** thorst has joined #openstack-ansible | 02:28 | |
*** thorst has quit IRC | 02:29 | |
mhayden | spotz: here now | 02:29 |
*** chhavi has quit IRC | 02:33 | |
*** esberglu has quit IRC | 02:40 | |
mw_ | cloudnull: no l3-ha | 02:52 |
mw_ | cloudnull: DVR and I'm deploying with a Heat template | 02:52 |
cloudnull | so DVR on the test env? | 02:58 |
mw_ | Yeah | 02:59 |
cloudnull | is your heat stack deploying DVR w/ linux bridge? | 02:59 |
mw_ | Nope | 02:59 |
cloudnull | \ | 02:59 |
cloudnull | opps | 02:59 |
mw_ | Is that even possible? | 03:00 |
cloudnull | no its not, to the best of my knowledge | 03:00 |
mw_ | to deploy a LB solution when the underlying network is OVS-DVR? | 03:00 |
mw_ | haha ok | 03:00 |
*** markvoelker has quit IRC | 03:02 | |
SamYaple | linuxbridge with dvr won't happen | 03:03 |
*** markvoelker has joined #openstack-ansible | 03:03 | |
SamYaple | spent alot of time looking into that one | 03:03 |
SamYaple | basically at that point you would be reimplementing lots of OVS and you have t oask yourself... why | 03:03 |
mw_ | SamYaple: That's what I thought. | 03:03 |
mw_ | I'm trying to repro this with a small heat template | 03:03 |
mw_ | SamYaple cloudnull Are either of you familiar with heat at all? | 03:04 |
mw_ | I'm wondering if it's a dependency issue that I'm unaware of.. | 03:05 |
mw_ | The snat interfaces in the snat namespace aren't being created all the time. It's hit and miss :S | 03:07 |
cloudnull | im not aware of anything that would cause that | 03:19 |
cloudnull | however im also no dvr-ovs expert | 03:19 |
mw_ | cloudnull: I'm also occasionally getting several (up to 3) snat IPs for the same subnet. Something weird is happening here... | 03:20 |
mw_ | One of them is active and the rest aren't | 03:20 |
SamYaple | mw_: there is a bug in the retry filters where if nova schedules to a compute host, that compute host fails and it reschedules you can end up with multiple ips attached to a port | 03:24 |
SamYaple | check your logs ot see if it is retring (or just remove the retry filter and watch if it fails) | 03:24 |
mw_ | SamYaple: Nova scheduler log? | 03:26 |
SamYaple | mw_: that and the compute logs | 03:27 |
mw_ | SamYaple: "The instance sync for host 'compute1' did not match. Re-created its InstanceList." | 03:27 |
SamYaple | if its hitting the retry filter there should be evidence in the scheduler logs, | 03:27 |
mw_ | SamYaple: That's hte only thing in the scheduler log that isn't "successfully synced instances from host..." | 03:27 |
*** udesale has joined #openstack-ansible | 03:40 | |
mw_ | SamYaple: Any idea what I'm looking for in the compute logs? | 03:41 |
*** gkadam has joined #openstack-ansible | 03:41 | |
mw_ | SamYaple: Heat isn't able to delete the stack because additional snat ports have been created (that it doesn't know about it seems). | 03:45 |
SamYaple | im not sure. im just commenting on one of the reasons you can get multiple ips on a boot | 03:55 |
SamYaple | port* | 03:55 |
*** luzC has quit IRC | 03:57 | |
mw_ | SamYaple: Ok, cool. Thanks :) | 03:58 |
*** germs has left #openstack-ansible | 03:59 | |
*** poopcat has quit IRC | 04:01 | |
*** markvoelker has quit IRC | 04:01 | |
*** markvoelker has joined #openstack-ansible | 04:01 | |
*** thorst has joined #openstack-ansible | 04:04 | |
*** thorst has quit IRC | 04:09 | |
*** chhavi has joined #openstack-ansible | 04:13 | |
*** rodolof has joined #openstack-ansible | 04:18 | |
*** thorst has joined #openstack-ansible | 04:26 | |
*** thorst has quit IRC | 04:30 | |
*** gouthamr has joined #openstack-ansible | 04:31 | |
openstackgerrit | Praveen N proposed openstack/openstack-ansible-os_tempest master: typo fix https://review.openstack.org/492375 | 04:40 |
*** hybridpollo has quit IRC | 04:55 | |
*** rromans has quit IRC | 05:08 | |
*** rromans has joined #openstack-ansible | 05:08 | |
*** gouthamr has quit IRC | 05:16 | |
*** luzC has joined #openstack-ansible | 05:31 | |
*** jamesdenton has quit IRC | 05:36 | |
*** luzC has quit IRC | 05:37 | |
*** kristian__ has joined #openstack-ansible | 05:52 | |
*** luzC has joined #openstack-ansible | 05:54 | |
*** kristian__ has quit IRC | 05:56 | |
*** luzC has quit IRC | 05:57 | |
*** jamesdenton has joined #openstack-ansible | 05:57 | |
*** lvdombrkr has quit IRC | 06:06 | |
*** lvdombrkr has joined #openstack-ansible | 06:10 | |
randy^^ | morning | 06:10 |
lvdombrkr | morning | 06:11 |
*** rodolof has quit IRC | 06:11 | |
*** Oku_OS-away is now known as Oku_OS | 06:12 | |
*** jamesdenton has quit IRC | 06:16 | |
lvdombrkr | how can i rebuild only infra1-neutron-agents-container-22e6641c from begining? | 06:22 |
*** thorst has joined #openstack-ansible | 06:26 | |
*** thorst has quit IRC | 06:31 | |
randy^^ | lvdombrkr: with -l? | 06:34 |
randy^^ | lvdombrkr: https://cunninghamshane.com/tips-for-managing-openstack-with-openstack-ansible/ - "Rebuilding specific LXC container" | 06:34 |
*** jamesdenton has joined #openstack-ansible | 06:34 | |
*** kristian__ has joined #openstack-ansible | 06:34 | |
randy^^ | https://docs.openstack.org/openstack-ansible/latest/admin/maintenance-tasks/containers.html | 06:35 |
randy^^ | "Destroy and recreate containers" | 06:35 |
randy^^ | wow. os-nova-install.yml finished after 8 hours (6 VMs). | 06:36 |
*** jamesdenton has quit IRC | 06:39 | |
*** drifterza has joined #openstack-ansible | 06:39 | |
lvdombrkr | i add dhcp agent from neutron-agents-container-22e6641c but cant ping it from external network | 06:41 |
lvdombrkr | where can be problem? | 06:42 |
lvdombrkr | randy^^: thank you | 06:42 |
*** jamesdenton has joined #openstack-ansible | 06:48 | |
randy^^ | lvdombrkr: missing ip in the container, wrong bridge bound, arp issue etc.. | 06:49 |
randy^^ | lxc-attach to it and have a look with "ip a s" | 06:49 |
lvdombrkr | randy: ip is on container | 06:52 |
lvdombrkr | randy^^: you mean ip or interface? | 06:53 |
randy^^ | "ip address show". and check the interface with brctl show if it is bound to the correct bridge on the containerhost | 06:54 |
randy^^ | i had some similar issues, i had to increade ssh_dely to 60sec, since sometimes arp resolutions is not fast enought. | 06:55 |
randy^^ | if i ping the containers, some packets are missing, afterwards it is running correctly. | 06:55 |
randy^^ | but i think it is due to the VM setup and the "overcrowded" esxi servers in the company lab ;) | 06:55 |
*** jvidal has joined #openstack-ansible | 06:57 | |
*** tobberydberg has joined #openstack-ansible | 07:00 | |
lvdombrkr | randy^^: maybe you can look into my neutron_agent_container bridge log and give some feedback?? http://paste.openstack.org/raw/618016/ | 07:04 |
*** shardy has joined #openstack-ansible | 07:09 | |
*** luzC has joined #openstack-ansible | 07:10 | |
*** luzC has quit IRC | 07:14 | |
*** luzC has joined #openstack-ansible | 07:14 | |
randy^^ | i only see that there is no networkconnection from the container towards outside, but not why :) | 07:16 |
randy^^ | AMQP server on 172.16.84.133:5671 is unreachable: - for me it looks like a basic connectivity issue | 07:17 |
randy^^ | so check the containers management interface if the ip address is correct, and the bridge setup is ok. | 07:18 |
*** luzC has quit IRC | 07:18 | |
randy^^ | on the containerhost. has nothing to do with neutron itself, i think | 07:18 |
lvdombrkr | randy^^: i just try telnet 172.16.84.133:5671 from agent_container and there is no problems | 07:21 |
lvdombrkr | interesting | 07:21 |
*** prometheanfire has quit IRC | 07:23 | |
*** markus_z has joined #openstack-ansible | 07:23 | |
lvdombrkr | randy^^: what i just Notice that agent_container network status is down | 07:32 |
randy^^ | maybe the binding to "{'physnet1': 'ens2f3', 'vlan': 'ens2f1'} | 07:36 |
randy^^ | istn correct? | 07:36 |
*** luzC has joined #openstack-ansible | 07:38 | |
*** prometheanfire has joined #openstack-ansible | 07:42 | |
*** yifei has quit IRC | 07:42 | |
*** yifei has joined #openstack-ansible | 07:49 | |
lvdombrkr | randy^^: its correct | 07:49 |
lvdombrkr | randy^^: physnet1': 'ens2f3 its a new network which i added recently to openstack_user_config and rerun lxc-container-create and os-neutron-install | 07:51 |
*** jafeha has quit IRC | 07:52 | |
*** sxc731 has joined #openstack-ansible | 07:53 | |
*** pbandark has joined #openstack-ansible | 08:01 | |
*** markus_z has quit IRC | 08:03 | |
*** markus_z has joined #openstack-ansible | 08:04 | |
*** electrofelix has joined #openstack-ansible | 08:19 | |
*** jafeha has joined #openstack-ansible | 08:21 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_sahara master: Implement uWSGI for sahara-api https://review.openstack.org/491421 | 08:27 |
*** thorst has joined #openstack-ansible | 08:27 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_sahara master: Implement uWSGI for sahara-api https://review.openstack.org/491421 | 08:29 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_sahara master: Implement uWSGI for sahara-api https://review.openstack.org/491421 | 08:29 |
*** thorst has quit IRC | 08:32 | |
*** armaan has quit IRC | 08:33 | |
*** armaan has joined #openstack-ansible | 08:33 | |
*** woodard has quit IRC | 08:53 | |
*** woodard has joined #openstack-ansible | 08:53 | |
*** mbuil has joined #openstack-ansible | 09:13 | |
odyssey4me | morning all - time to get a patch in to use the reverse proxy for images.linuxcontainers.org | 09:16 |
flaviosr | If I want to add a centos job to the sahara role, is it enough to just add it to the list in https://github.com/openstack-infra/project-config/blob/master/zuul/layout.yaml#L13672 ? | 09:17 |
odyssey4me | unfortunately infra is heavily backed up, so it may take all day to merge | 09:17 |
odyssey4me | flaviosr yes, it should be enough | 09:17 |
flaviosr | morning odyssey4me ! | 09:17 |
flaviosr | thanks :) | 09:17 |
odyssey4me | ansible-role-functional-jobs-centos7-nv to start with if you want non voting for now | 09:18 |
flaviosr | yes, that is exactly what I was thinking | 09:19 |
*** luzC has quit IRC | 09:22 | |
*** luzC has joined #openstack-ansible | 09:23 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value https://review.openstack.org/492452 | 09:31 |
*** luzC has quit IRC | 09:39 | |
*** yifei has quit IRC | 09:42 | |
*** markvoelker has quit IRC | 09:42 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value https://review.openstack.org/492452 | 09:46 |
*** luzC has joined #openstack-ansible | 09:47 | |
odyssey4me | evrardjp andymccr ^ a quick review for that would be good | 09:47 |
odyssey4me | if that passes gate then we're good and I'll add the override hack to the tests repo for all other role tests | 09:47 |
andymccr | odyssey4me: sweet taking a look - you coding from inside your occulus rift? :D | 09:54 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value https://review.openstack.org/492452 | 09:54 |
odyssey4me | thanksfully there are opensuse images ready to go very quickly, so we get a quick result to validate whether it's working | 09:55 |
odyssey4me | and no - not inside the oculus yet | 09:55 |
odyssey4me | I got to play a little last night, but had to download a raft-load of stuff which took some time, cutting my play time short | 09:56 |
odyssey4me | I'll try again later today | 09:56 |
odyssey4me | that said, there is an app that allows you to use your desktop through the rift which I thought might be interesting | 09:56 |
odyssey4me | I did play a couple of shooters which was very, very intense | 09:56 |
odyssey4me | well, this patch set appears to be working, and was quick | 09:59 |
odyssey4me | interesting, centos on internap is beating suse on rax-dfw | 10:00 |
odyssey4me | this is not normal :) | 10:01 |
odyssey4me | evrardjp to explain what's going on in that patch | 10:02 |
andymccr | ahh btw the suse images are changing - infra is only going to keep 423 onboard and not 422, although i think we have some issues with our 423 stuff since that is failing when 422 passes - but i figure we can fix that up reasonably easily once hwoarang is back | 10:02 |
odyssey4me | the value was changes from a dns entry to a URL in the machinectl patch - so your assumption that we're using the URL everywhere is wrong | 10:02 |
evrardjp | I just see the code. | 10:03 |
evrardjp | it may have changed before, but I guess it was with a reno | 10:04 |
evrardjp | I'm just focusing on this patch. | 10:04 |
odyssey4me | I'll check the reno, but this patch returns it to the same value as the stable patch - as is explained in the commit message. | 10:05 |
odyssey4me | oh, and the machinectl patch appears to have had no reno | 10:06 |
odyssey4me | no reno: https://github.com/openstack/openstack-ansible-lxc_hosts/commit/42545f1c3c7b41ee4db8b55024cfa39a50eb06ab | 10:07 |
*** armaan has quit IRC | 10:07 | |
*** shardy has quit IRC | 10:08 | |
odyssey4me | the test has passed for suse and centos, so it definitely works :) | 10:08 |
*** armaan has joined #openstack-ansible | 10:08 | |
*** armaan has quit IRC | 10:10 | |
*** armaan has joined #openstack-ansible | 10:10 | |
*** shardy has joined #openstack-ansible | 10:11 | |
*** fen[sha] is now known as fengor | 10:15 | |
*** armaan has quit IRC | 10:26 | |
*** thorst has joined #openstack-ansible | 10:28 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery https://review.openstack.org/492465 | 10:29 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery https://review.openstack.org/492465 | 10:31 |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery https://review.openstack.org/492465 | 10:32 |
*** thorst has quit IRC | 10:33 | |
odyssey4me | evrardjp replied to your comments | 10:35 |
evrardjp | seeing the other patches, I don't have have to open the review to guess what you said ;) | 10:35 |
*** armaan has joined #openstack-ansible | 10:35 | |
evrardjp | let me check :) | 10:36 |
*** udesale has quit IRC | 10:36 | |
*** kristian__ has quit IRC | 10:37 | |
*** kristian__ has joined #openstack-ansible | 10:38 | |
*** armaan has quit IRC | 10:39 | |
*** sxc731 has quit IRC | 10:46 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use LXC reverse proxy in OpenStack-CI https://review.openstack.org/492475 | 11:02 |
odyssey4me | right, so I think those three patches will resolve that issue | 11:07 |
spotz | mhayden still here? | 11:09 |
spotz | mhayden: andymccr is looking but thoughts on https://bugs.launchpad.net/openstack-ansible/+bug/1703621. comments are all there. Leaving to ride the horses but let me know | 11:10 |
openstack | Launchpad bug 1703621 in openstack-ansible "Appendix A conflict with /etc/openstack_deploy/openstack_user_config.yml.example" [Medium,Confirmed] - Assigned to Amy Marrich (amy-marrich) | 11:10 |
andymccr | enjoy spotz! | 11:11 |
andymccr | i will have an update for you in there by the time youre back hopefully :) | 11:11 |
spotz | andymccr: gonna try to get them both done this morning so off a little earlier:) | 11:11 |
*** armaan has joined #openstack-ansible | 11:11 | |
openstackgerrit | Jesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use LXC reverse proxy in OpenStack-CI https://review.openstack.org/492475 | 11:12 |
odyssey4me | andymccr mhayden so with regards to the RDO/EPEL and other CentOS repositories, it appears that for some reason the base image has a bunch of upstream mirrors configured and we're not using any of the nodepool ones beyond the base centos stuff... so we can definitely improve there | 11:14 |
odyssey4me | we aren't using the mariadb repositories in infra either, except for the integrated gate | 11:14 |
andymccr | i think we disabled a bunch of the base ones - if im not mistaken mhayden put a patch in for that - but that sounds really promising. | 11:15 |
odyssey4me | yup, we now disable all then enable what we want - which is a start | 11:16 |
*** armaan has quit IRC | 11:16 | |
odyssey4me | but we need to re-examine what we're using and perhaps patch the infra image to ensure it has the right config | 11:16 |
odyssey4me | alternatively, overwrite with our own like we do for ubuntu | 11:16 |
andymccr | im hoping that mixed with the dnf stuff will improve centos significantly | 11:17 |
andymccr | (and the present vs latest) | 11:17 |
odyssey4me | yup | 11:17 |
odyssey4me | I think we can use this as a topic for a bit of a hackfest at the PTG | 11:17 |
andymccr | +2 | 11:17 |
odyssey4me | perhaps dovetail with using devstack-gate to reduce all the stuff we have to detect and override | 11:17 |
andymccr | im game for that. | 11:18 |
odyssey4me | alright, it seems that https://review.openstack.org/492475, https://review.openstack.org/492452 and https://review.openstack.org/492465 are all passing for suse/centos so once they get an ubuntu host hopefully they'll pass there too and we are good to go | 11:22 |
*** pbandark1 has joined #openstack-ansible | 11:27 | |
*** pbandark has quit IRC | 11:27 | |
*** pbandark1 is now known as pbandark | 11:27 | |
lvdombrkr | hello guys i trying add vpnaas ( use this guide https://docs.openstack.org/developer/openstack-ansible-os_neutron/ocata/configure-network-services.html) but after run os_neutron_install get error fatal: [infra1_neutron_server_container-ee121208]: FAILED! => {"failed": true, "msg": "'neutron_vpnaas_service_provider' is undefined"} | 11:34 |
lvdombrkr | any thoughts on this? | 11:34 |
lvdombrkr | ? | 11:45 |
*** smatzek has joined #openstack-ansible | 11:49 | |
*** gkadam has quit IRC | 11:52 | |
evrardjp | lvdombrkr: probably there is a variable that needs definition that's not documented. | 11:57 |
evrardjp | you have to check into the neutron role | 11:58 |
*** esberglu has joined #openstack-ansible | 11:59 | |
lvdombrkr | evrardjp: thank you i already tried to find it but without success | 12:00 |
evrardjp | lvdombrkr: what os are you running? What version of the code are you running? | 12:01 |
evrardjp | Apparently it's defined for ubuntu16, and you should probably not set it. | 12:01 |
lvdombrkr | evrardjp: centos 7 | 12:02 |
lvdombrkr | 15.1.8 | 12:02 |
evrardjp | ok | 12:02 |
evrardjp | let me fix that for you | 12:02 |
evrardjp | you caught a bug, congrats! | 12:02 |
mhayden | morning | 12:02 |
*** thorst has joined #openstack-ansible | 12:02 | |
mhayden | odyssey4me: weird, i thought they were using the mirrors -- perhaps it's time to disable fastestmirror again and check the baseurls | 12:03 |
mhayden | also, i couldn't find a nodepool mirror for RDO last time i tried | 12:03 |
*** esberglu has quit IRC | 12:04 | |
mhayden | crap, it appears my linter tests broke stuff as well :/ | 12:05 |
mhayden | the directory is different in the role tests | 12:05 |
lvdombrkr | evrardjp: i will be grateful ))) | 12:05 |
evrardjp | mhayden: ? | 12:05 |
evrardjp | that's sad. | 12:06 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily https://review.openstack.org/492494 | 12:08 |
mhayden | evrardjp: ^^ | 12:08 |
openstackgerrit | Jean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Fix VPNaaS variable definition for non-ubuntu https://review.openstack.org/492495 | 12:08 |
evrardjp | mhayden: why not reverting? | 12:09 |
evrardjp | I'm ok. | 12:09 |
mhayden | the linter itself is okay | 12:09 |
mhayden | but the unit test discovery needs work | 12:09 |
evrardjp | I was planning to add extra rules, so I am glad you caught this up | 12:09 |
odyssey4me | one should not merge linter changes when changes elsewhere aren't merging due to a gate wedge ;) | 12:10 |
evrardjp | lvdombrkr: here is your patch: https://review.openstack.org/#/c/492495/ | 12:10 |
odyssey4me | mhayden see https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh | 12:10 |
evrardjp | you can apply that to your neutron if you want a temporary fix and are in urgent need for a fix. | 12:10 |
odyssey4me | we can source /etc/ci/mirror_info.sh and it provides a bunch of env vars with the mirror URL's | 12:11 |
odyssey4me | but that also shows the repo configs that are implemented | 12:11 |
odyssey4me | we could patch it so that the RDO stuff is changed to use the reverse proxy by default? | 12:11 |
mhayden | oh nice... i might see if i can work a patch for centos | 12:11 |
odyssey4me | also, I see the output of what's configured here: http://logs.openstack.org/99/490899/5/check/gate-openstack-ansible-tests-ansible-func-centos-7/31a0876/console.html#_2017-08-07_16_21_26_446741 | 12:12 |
odyssey4me | we shouldperhaps either replace https://github.com/openstack/openstack-ansible-tests/blob/master/common-tasks/test-set-nodepool-vars.yml#L37-L47 or add things below it to configure the right repositories | 12:13 |
mhayden | odyssey4me: well, i disable all of those repos via project-config, but the project-config clone seems to be flaky | 12:15 |
odyssey4me | yeah, that needs resolving | 12:15 |
mhayden | mordred was looking into it but i couldn't get anything from him yesterday | 12:15 |
mhayden | i imagine he got caught up in something else | 12:15 |
mhayden | but that --disable * helps a bunch since there are a bunch of repos enabled that we don't always need | 12:16 |
mhayden | and some we never need | 12:16 |
mhayden | the centos image isn't terribly clean... looks purpose built for RDO | 12:16 |
odyssey4me | yep, it likely is | 12:18 |
odyssey4me | perhaps a discussion should be had to make it more generic as RDO aren't the only ones using it any more | 12:18 |
odyssey4me | good to see the reverse proxy working right http://logs.openstack.org/65/492465/3/check/gate-openstack-ansible-tests-ansible-func-opensuse-422-nv/8b75e6c/logs/ara/result/74c19534-3ed7-4f8e-a0a0-3db3918323d5/ | 12:19 |
mhayden | i'm good with 7.6M/s | 12:20 |
odyssey4me | andymccr I think while it'd be useful to have ARA logs if a job times out, I think maybe it's best we refrain from making any further major changes until we get out of the current wedge | 12:20 |
*** schwicht has joined #openstack-ansible | 12:21 | |
mhayden | odyssey4me: do you have any jobs/output that shows the output of that mirror script? | 12:21 |
odyssey4me | mhayden no, not at this time - what info are you looking for? | 12:22 |
mhayden | just looking for how i can whip those baseurl adjustments into a script | 12:22 |
mhayden | the linter test disable patch already died due to an old version of project-config on the node | 12:23 |
mhayden | sigh | 12:23 |
odyssey4me | in theory, that's already done for some: https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh#L352-L357 | 12:23 |
*** shardy has quit IRC | 12:23 | |
mhayden | perhaps i should adjust project-config to remove the actual repo files from centos that aren't included in that mirror script | 12:24 |
odyssey4me | perhaps, then also add the appropriate RDO options too - but leave them disabled by default | 12:24 |
odyssey4me | ie the ones which get added when you install the RDO package | 12:24 |
mhayden | right | 12:24 |
*** shardy has joined #openstack-ansible | 12:25 | |
mhayden | the question is where to put that RDO fix | 12:25 |
mhayden | since it normally comes through via pip_install | 12:25 |
odyssey4me | put it in there too | 12:25 |
*** sxc731 has joined #openstack-ansible | 12:25 | |
odyssey4me | eh what? | 12:25 |
odyssey4me | what fix are you referring to? | 12:25 |
lvdombrkr | evrardjp: thank you, i quite new in openstack, how can i run this pach? | 12:26 |
odyssey4me | I see that we could also be smarter about how we change the ubuntu repositories for nodepool | 12:27 |
odyssey4me | if these files exist, use them: https://github.com/openstack-infra/project-config/blob/master/nodepool/scripts/configure_mirror.sh#L302-L307 | 12:27 |
odyssey4me | we should perhaps also add mariadb mirrors for centos | 12:27 |
*** jamesdenton has quit IRC | 12:35 | |
*** jamesdenton has joined #openstack-ansible | 12:36 | |
evrardjp | lvdombrkr: you either have to wait (recommended), or you do about the same change into your /etc/ansible/roles/os_neutron (faster). | 12:39 |
lvdombrkr | evrardjp: can i make this changes myself? | 12:40 |
evrardjp | yes you'll have to :p | 12:41 |
evrardjp | I can't change your environment | 12:41 |
lvdombrkr | evrardjp: sorry but i dont understood what excatly I need to change? | 12:43 |
*** woodard has quit IRC | 12:45 | |
*** woodard has joined #openstack-ansible | 12:46 | |
*** goldenfr_ has quit IRC | 12:52 | |
*** schwicht has quit IRC | 12:53 | |
*** goldenfri has joined #openstack-ansible | 12:53 | |
evrardjp | the patch is doing a change on the neutron role. If you want to test it fast, you need to apply it your on deploy. So do the same changes into your /etc/ansible/roles/os_neutron | 12:58 |
evrardjp | lvdombrkr: ^ | 12:58 |
*** esberglu has joined #openstack-ansible | 13:00 | |
mhayden | i'm going to bump my linter fix patch because it already failed centos due to project-config issues | 13:01 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily https://review.openstack.org/492494 | 13:01 |
*** SerenaFe_ has joined #openstack-ansible | 13:07 | |
*** rodolof has joined #openstack-ansible | 13:08 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest stable/ocata: Support installing plugins from packages https://review.openstack.org/491842 | 13:08 |
*** aludwar has quit IRC | 13:09 | |
*** lucasxu has joined #openstack-ansible | 13:09 | |
*** aludwar has joined #openstack-ansible | 13:10 | |
*** schwicht has joined #openstack-ansible | 13:11 | |
lvdombrkr | evrardjp: i will test right now | 13:13 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos https://review.openstack.org/492528 | 13:14 |
mhayden | odyssey4me: ^^ i'll save the output so we don't have to ask this question again :P | 13:15 |
*** kylek3h has joined #openstack-ansible | 13:15 | |
lvdombrkr | evrardjp: now i have failed in other task: http://paste.openstack.org/raw/618046/ | 13:19 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos https://review.openstack.org/492528 | 13:19 |
evrardjp[m] | lvdombrkr: there is a bug opened for that. if you want to step up and contribute, now would be the time. | 13:21 |
*** sauloaislan has joined #openstack-ansible | 13:23 | |
sauloaislan | Morning! | 13:24 |
lvdombrkr | evrardjp: okey i understood, thank you | 13:26 |
mhayden | odyssey4me: okay, so by default, centos appears to be using the nodepool repos for everything except RDO | 13:28 |
mhayden | https://gist.github.com/major/108dfc95b35bc8c25b0070fef5c1f08a | 13:28 |
sauloaislan | Can someone help me? fatal: [aio1]: FAILED! => {"failed": true, "msg": "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"} | 13:28 |
evrardjp | lvdombrkr: it's really simple to contribute: | 13:28 |
evrardjp | https://docs.openstack.org/openstack-ansible/latest/contributor/contribute.html | 13:29 |
evrardjp | lvdombrkr: first step would be to confirm the bug here: https://bugs.launchpad.net/openstack-ansible/+bug/1705420 | 13:30 |
openstack | Launchpad bug 1705420 in openstack-ansible "os-neutron-install.yml fails during LBaaS v2 deployment" [Undecided,New] | 13:30 |
evrardjp | Just dropping a message | 13:30 |
evrardjp | sauloaislan: we'd need to know the playbook run, and the role. | 13:30 |
evrardjp | and maybe some variables :) | 13:30 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos https://review.openstack.org/492528 | 13:31 |
mhayden | desire to move to a van down by the river grows | 13:32 |
evrardjp | ooooh | 13:33 |
andymccr | mhayden: how is the wifi down by the river? | 13:33 |
evrardjp | I'm ok for fishing. | 13:33 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: [TEST] Enumerate CentOS gate repos https://review.openstack.org/492528 | 13:33 |
evrardjp | I'm pretty sure mhayden is more ready in case of phishing though. | 13:33 |
mhayden | oh yeah | 13:34 |
*** sxc731 has quit IRC | 13:34 | |
andymccr | https://pbs.twimg.com/media/BhhMT6RCUAALJYc.png:large evrardjp like that?! | 13:35 |
evrardjp | OMG OMG I didn't know this one. | 13:35 |
mhayden | :| | 13:35 |
andymccr | https://pbs.twimg.com/media/BIPjeMJCAAA1WTS.jpg:large actually - new favourite | 13:36 |
sauloaislan | evrardjp: See http://paste.openstack.org/show/RVvwZBZTJD6bWbCrLz32/ | 13:38 |
evrardjp | andymccr: the last one is saved forever. | 13:38 |
odyssey4me | dammit major, your lint test is breaking everything | 13:41 |
odyssey4me | we have a proper wedge now | 13:41 |
mhayden | trying to get the fix merged :| | 13:41 |
evrardjp | yeah he already proposed a patch. | 13:41 |
mhayden | ol' evrardjp reaaaaally wanted unit tests | 13:41 |
mhayden | :P | 13:42 |
evrardjp | yeah it's my fault. | 13:42 |
evrardjp | I take the blame! | 13:42 |
odyssey4me | so basically we have to get two successful runs of the lint patch before we can merge the lxc patch | 13:42 |
* mhayden is sending the gate good feelings | 13:42 | |
odyssey4me | and to get that, we have to not hit infracloud twice in a row | 13:42 |
andymccr | oh what we merged the lint test? | 13:42 |
evrardjp | mhayden: good vibes? | 13:42 |
odyssey4me | I knew I shoulda -2'd that one :/ | 13:43 |
mhayden | does anyone know where the centos image might be defined? as in what gets passed to dib to build it | 13:43 |
* andymccr is an oracle and suggested not merging it because we are at rc1 and that can seriously wait until things have settled down :P | 13:43 | |
andymccr | i recommend reverting the lint thing | 13:43 |
andymccr | until like a month or so | 13:44 |
evrardjp | ok | 13:44 |
mhayden | andymccr: could propose that too and see which merges first | 13:44 |
andymccr | when everything is smoothly working but right now we have image issues, centos timeout issues, lint issues, other general infra issues | 13:44 |
odyssey4me | well, I guess we recheck until it passes | 13:44 |
*** marst_ has joined #openstack-ansible | 13:54 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Revert "Add linter for passing pkgs as list" https://review.openstack.org/492539 | 13:54 |
mhayden | i went ahead and proposed a revert | 13:54 |
mhayden | hopefully one of them passes | 13:54 |
mhayden | and we can toss the other one | 13:54 |
sauloaislan | evrardjp: Did you see my playbook ? | 13:55 |
andymccr | mhayden: yeah, FTR, the linters are great, i am massively in favour of them going in - just not right now | 13:55 |
mhayden | andymccr: i wish i could put a short circuit on the revert to be like "if review == 492539; then exit 0; done" | 14:00 |
mhayden | :P | 14:00 |
andymccr | mhayden: ahhahaha yes | 14:00 |
*** gouthamr has joined #openstack-ansible | 14:00 | |
andymccr | mhayden: alas :( | 14:00 |
mhayden | i could, but i would feel horribly unethical | 14:00 |
andymccr | BGB merges - ahh how i miss them | 14:00 |
mhayden | well, on that topic, can someone administratively merge that revert for us? since we're so close to release time? | 14:01 |
andymccr | we can just hope for the best i guess ;D | 14:02 |
*** mrch has joined #openstack-ansible | 14:04 | |
*** SerenaFe_ has quit IRC | 14:04 | |
*** vnogin has joined #openstack-ansible | 14:12 | |
mhayden | odyssey4me: 491803 (common pip cache) passed xenial in the gate! | 14:15 |
mhayden | tempest is running on the centos gate | 14:15 |
mhayden | centos timed out :/ | 14:20 |
mhayden | on the unit test disable part | 14:20 |
mhayden | i'll bump the patch to get it running again since we'd have to wait forever for a recheck | 14:21 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily https://review.openstack.org/492494 | 14:21 |
odyssey4me | mhayden two patches going now - whichever one wins :) | 14:22 |
randy^^ | mhm, is there any "caching" of ansible facts within OSA? neutron install wants to connect to a "wrong" ip address.. | 14:22 |
randy^^ | (beside of /etc/openstack_deploy/ansible_facts/) | 14:23 |
lvdombrkr | guys, is there worh to think deploy openstack ansible on Centos in production env.? | 14:25 |
lvdombrkr | or only on Ubuntu? | 14:25 |
randy^^ | lvdombrkr: i'm just trying with cents 7 :) | 14:25 |
lvdombrkr | randy^^: im also build my test env on Centos alredy, but now thinks about production env | 14:27 |
*** lbragstad has quit IRC | 14:28 | |
lvdombrkr | randy^^: there was some direct Centos issue during deployment thats why im asking | 14:31 |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Use common pip cache for host & containers https://review.openstack.org/491803 | 14:31 |
lvdombrkr | *issues | 14:31 |
*** sxc731 has joined #openstack-ansible | 14:32 | |
*** tobberyd_ has joined #openstack-ansible | 14:32 | |
eoseq | lvdombrkr: what issues? | 14:33 |
eoseq | I see at least one, that installing packages with yum fail sometimes | 14:34 |
*** drifterza has quit IRC | 14:34 | |
eoseq | but yum update fix the problem and next run pass | 14:34 |
*** tobberydberg has quit IRC | 14:36 | |
eoseq | lvdombrkr: I ask, because we are in the process of deploying production on CentOS 7 | 14:36 |
*** tobberyd_ has quit IRC | 14:37 | |
lvdombrkr | eoseq: there was a problem with file cashing (but its already resolved in 15.1.8,) | 14:38 |
*** yifei has joined #openstack-ansible | 14:38 | |
lvdombrkr | eoseq: which version do you deploy? | 14:38 |
evrardjp | sauloaislan: Hey. I didn't. If you are just looking for ironic + ansible, have you ever heard of bifrost? | 14:40 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs https://review.openstack.org/492551 | 14:41 |
evrardjp | sauloaislan: this way you don't need a full openstack cloud. | 14:41 |
evrardjp | but I could watch that later with you. | 14:41 |
eoseq | lvdombrkr: I don't know, where should I check? git clone -b stable/ocata | 14:42 |
*** yifei has quit IRC | 14:43 | |
mhayden | odyssey4me: yay, the common pip wheel directory merged | 14:43 |
mhayden | that should help a little | 14:43 |
evrardjp | mhayden: I was just about to say that | 14:44 |
evrardjp | you are fast sir! | 14:44 |
* mhayden is watching zuul status like a hawk | 14:44 | |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-ceph_client master: Move to use filtered packages/services/clients https://review.openstack.org/492556 | 14:44 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-ceph_client master: Move to use filtered packages/services/clients https://review.openstack.org/492556 | 14:45 |
sauloaislan | evrardjp: I need Neutron | 14:47 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-ceph_client master: Move to use filtered packages/services/clients https://review.openstack.org/492556 | 14:55 |
odyssey4me | eoseq git checkout -b stable/ocata will create a new local branch with that name... you wouldn't be using stable/ocata unless your current head is already there | 14:57 |
*** lbragstad has joined #openstack-ansible | 14:59 | |
mattt | mhayden: what'd you break | 15:03 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-galera_server master: Add upgrade check for dnf https://review.openstack.org/492564 | 15:03 |
andymccr | mattt: mhayden was auditing our review processes - we failed :( | 15:03 |
mattt | andymccr: that guy :( | 15:04 |
*** vnogin has quit IRC | 15:04 | |
*** SerenaFe_ has joined #openstack-ansible | 15:05 | |
*** lvdombrkr has quit IRC | 15:06 | |
eoseq | odyssey4me: I did git clone, bootstrapped and that's all as for now | 15:06 |
*** vnogin has joined #openstack-ansible | 15:07 | |
*** lvdombrkr has joined #openstack-ansible | 15:07 | |
andymccr | mhayden: btw we will need https://review.openstack.org/#/c/492564/ before dnf will work | 15:09 |
andymccr | for galera server at least | 15:10 |
mhayden | andymccr: already deuced it | 15:10 |
andymccr | you are too fast for me | 15:10 |
mhayden | so i did some digging on the RDO repo | 15:10 |
mhayden | the rpm that we install for RDO just configures repos that already exist in the centos-extras repo | 15:10 |
mhayden | so we could avoid downloading that random RPM in pip-install and just use the packages in extras | 15:11 |
mhayden | the end result is the same -- points to the same repo | 15:11 |
odyssey4me | sounds good to me | 15:11 |
mhayden | but we could use the nodepool mirrors easier | 15:11 |
mhayden | to implement | 15:11 |
odyssey4me | although I remember we went through a bunch of these, so perhaps mgariepy should weigh in | 15:12 |
*** vnogin has quit IRC | 15:12 | |
xgerman_ | I have trouble with the linter on https://review.openstack.org/#/c/484440/ but I am not sure if it’s jenkins or me - anybody seen something similar | 15:14 |
xgerman_ | ? | 15:14 |
andymccr | xgerman_: its not you most likely :) | 15:14 |
mhayden | xgerman_: yeah, waiting on a patch to merge | 15:14 |
mhayden | xgerman_: https://review.openstack.org/492494 | 15:14 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-haproxy_server master: Pass list of packages instead of "with_items" https://review.openstack.org/492569 | 15:15 |
xgerman_ | ah, ok | 15:15 |
*** Oku_OS is now known as Oku_OS-away | 15:15 | |
mhayden | well but installing those repo packages via yum causes dependencies to be added that we don't want | 15:16 |
* mhayden will hack arond a little | 15:16 | |
*** sdake_ is now known as sdake | 15:27 | |
spotz | Greetings my fellow OSAers! •cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccoll | 15:33 |
spotz | um, darrenc, JRobinson__, asettle, colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen | 15:33 |
spotz | Friendly reminder we will be meeting in 27 minutes in #openstack-meeting-4 Agenda is available at https://wiki.openstack.org/wiki/Meetings/openstack-ansible#Agenda_for_next_meeting | 15:33 |
openstackgerrit | Andy McCrae proposed openstack/openstack-ansible-os_aodh master: Standardize services list and package installation https://review.openstack.org/492580 | 15:33 |
andymccr | oh yeah lemme update hahaha | 15:35 |
andymccr | im terribad | 15:35 |
odyssey4me | andymccr mhayden FYI cloudnull has made arrangements, so once this merges things should speed up a bit: https://review.openstack.org/#/c/492566/ | 15:37 |
odyssey4me | cloudnull for prez | 15:37 |
mhayden | indeedy! | 15:37 |
andymccr | cloudnull: for prez! | 15:37 |
* cloudnull hides | 15:37 | |
andymccr | did you threaten infra team with fire and fury cloudnull?! | 15:37 |
mhayden | i passed the person who approved that change in the hall and attempted to hug him | 15:37 |
cloudnull | did he accept your hugs ? | 15:38 |
mattt | who wouldn't accept a hug from mhayden | 15:40 |
mattt | liekrly | 15:40 |
odyssey4me | mhayden is a hug-er-ator | 15:42 |
*** chyka has joined #openstack-ansible | 15:46 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl https://review.openstack.org/492601 | 15:53 |
mhayden | odyssey4me: ^^ so infra mirrors the entire centos repo, which contains virt/cloud directories already | 15:54 |
mhayden | no need to use the RDO proxy -- can use the existing CentOS mirror ;) | 15:54 |
odyssey4me | oh neat | 15:54 |
odyssey4me | but for our normal, production builds, what should happen? | 15:55 |
mhayden | ugh, both fixes to openstack-ansible-tests failed on centos | 15:55 |
mhayden | :| | 15:55 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Revert "Add linter for passing pkgs as list" https://review.openstack.org/492539 | 15:55 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Disable linter unit tests temporarily https://review.openstack.org/492494 | 15:55 |
odyssey4me | mhayden perhaps we should avoid any major repo changes until we have a more stable gate | 15:56 |
odyssey4me | although perhaps that may help to stabilise | 15:57 |
mhayden | should speed up os_nova's package install | 15:57 |
odyssey4me | I can't really evaluate whether what you're doing there is right. Is mgariepy around? | 15:57 |
mgariepy | yep i'm here. | 15:58 |
mhayden | i did workflow-1 so we could avoid tinkering until we get these tests patches merged | 15:59 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery https://review.openstack.org/492465 | 16:00 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs https://review.openstack.org/492551 | 16:00 |
mhayden | hah, i failed at jinja on the pip-install one | 16:01 |
spotz | evrardjp: and I are lonely people!!! | 16:02 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl https://review.openstack.org/492601 | 16:02 |
evrardjp | spotz: only if that was true :) | 16:02 |
spotz | heheh | 16:03 |
spotz | I think I needed a comma in there somewhere:) | 16:03 |
*** BjoernT has joined #openstack-ansible | 16:08 | |
spotz | cloudnull, DimGR, andymccr, d34dh0r53, hughsaunders, b3rnard0, palendae, odyssey4me, serverascode, rromans, erikmwilson, mancdaz, _shaps_, BjoernT, claco, echiu, dstanek, jwagner, ayoung, prometheanfire, evrardjp, arbrandes, mhayden, scarlisle, luckyinva, ntt, javeriak, spotz, vdo, jmccrory, alextricity25, jasondotstar, admin0, michaelgugino, ametts, v1k0d3n, severion, bgmccollum, darrenc, JRobinson__, asettle | 16:08 |
spotz | , colinmcnamara, thorst, adreznec, eil397, qwang,nishpatwa_, cathrichardson, drifterza, hwoarang, cshen - we be in meeting room 4!!!! | 16:08 |
BjoernT | .off | 16:12 |
*** kristian__ has quit IRC | 16:18 | |
*** SerenaFe_ has quit IRC | 16:21 | |
*** tobberydberg has joined #openstack-ansible | 16:22 | |
*** pcaruana has quit IRC | 16:25 | |
*** tobberydberg has quit IRC | 16:26 | |
*** lucasxu has quit IRC | 16:27 | |
mhayden | cloudnull: quota increase merged | 16:29 |
odyssey4me | mhayden cloudnull yep, now nodes need to be built and prepped before adding into nodepool | 16:31 |
odyssey4me | I'd expect the backlog to catch up by our morning. | 16:32 |
odyssey4me | hopefully tomorrow it'll be able to keep pace | 16:32 |
odyssey4me | I fully expect mhayden to be rechecking the linter revert all night until it merges. | 16:35 |
odyssey4me | :p | 16:36 |
*** mbuil has quit IRC | 16:36 | |
* mhayden sads | 16:37 | |
mhayden | so both patches to openstack-ansible-tests reached tempest at the 30 min mark, which is promising! | 16:38 |
*** jvidal has quit IRC | 16:40 | |
*** sxc731 has quit IRC | 16:42 | |
mhayden | okay, both of the openstack-ansible-tests passed centos | 16:49 |
andymccr | mhayden: you are an inspiration. | 16:49 |
andymccr | although i guess they could time out infinitely on the image retrieval :P | 16:49 |
mhayden | haha, well it's gotta pass ubuntu and get into the gate :| | 16:49 |
andymccr | well there isnt much we can do rn, im gonna head home - i'll continue my war against package lists and filtered services tomorrow - thanks for following up mhayden. i'll check online later to see how its going. | 16:53 |
*** marst_ has quit IRC | 16:54 | |
*** marst_ has joined #openstack-ansible | 16:54 | |
mhayden | wow, triple-o has a buncha nodes | 17:01 |
mhayden | in nodepool | 17:01 |
*** germs has joined #openstack-ansible | 17:01 | |
odyssey4me | yep, they have a special case set of things | 17:01 |
odyssey4me | apparently they've been trying to unwind a bunch of complexity that was there from very early on and it's been rather hellish | 17:02 |
mhayden | i was gandering at http://grafana.openstack.org/dashboard/db/nodepool?panelId=13&fullscreen | 17:03 |
mhayden | looks like the new capacity from rax is kicking in | 17:04 |
palendae | \o/ | 17:04 |
mhayden | still 324 jobs in check, 160 in post :/ | 17:04 |
mhayden | 33 in the gate | 17:04 |
mhayden | everything we've proposed for openstack-ansible-tests has passed centos (or is about to pass), waiting on xenial :/ | 17:05 |
*** tobberydberg has joined #openstack-ansible | 17:05 | |
*** electrofelix has quit IRC | 17:08 | |
*** tobberydberg has quit IRC | 17:10 | |
*** marst_ has quit IRC | 17:13 | |
*** drifterza has joined #openstack-ansible | 17:16 | |
*** markus_z has quit IRC | 17:30 | |
openstackgerrit | Santhosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db https://review.openstack.org/492631 | 17:36 |
*** craigs__ has joined #openstack-ansible | 17:38 | |
*** shardy has quit IRC | 17:38 | |
openstackgerrit | Santhosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db https://review.openstack.org/492631 | 17:39 |
openstackgerrit | Santhosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db https://review.openstack.org/492631 | 17:44 |
sauloaislan | Can someone help me? fatal: [aio1]: FAILED! => {"failed": true, "msg": "No file was found when using with_first_found. Use the 'skip: true' option to allow this task to be skipped if no files are found"} | 17:46 |
*** sanfern has joined #openstack-ansible | 17:46 | |
evrardjp | sauloaislan: didn't I just helped you on that? | 17:49 |
evrardjp | sauloaislan: on what playbook/role do you have that appearing? | 17:50 |
*** gouthamr_ has joined #openstack-ansible | 17:51 | |
*** gouthamr has quit IRC | 17:51 | |
sauloaislan | evrardjp: this is my .sh http://paste.openstack.org/show/a2KSP6RHuqD5XWuNzTDt/ | 17:53 |
evrardjp | where is your run log? | 17:54 |
sauloaislan | evrardjp: erro apper in setup-hosts.yml | 17:54 |
evrardjp | more precisely? | 17:54 |
sauloaislan | evrardjp: TASK [resolvconf : Gather variables for each operating system] | 17:54 |
sauloaislan | evrardjp: /etc/ansible/roles/resolvconf/tasks/main.yml:16 | 17:55 |
evrardjp | There is a patch pending for that I think. | 17:55 |
evrardjp | our gates are jammed right now, so we'll unlock this situation, but we cannot unlock now. Can you run on a tag instead? | 17:55 |
sauloaislan | this https://review.openstack.org/#/c/491508/1 ? | 17:55 |
evrardjp | sauloaislan: https://review.openstack.org/#/c/491508/ | 17:56 |
evrardjp | yes | 17:56 |
evrardjp | sauloaislan: can you afford to run on stable branch? | 17:57 |
*** tobberydberg has joined #openstack-ansible | 18:01 | |
sauloaislan | evrardjp: the case is that we use this master in order to setup dev environments with master code for OS components | 18:01 |
evrardjp | oh ok. | 18:02 |
sauloaislan | evrardjp: Is it possible to launch the containers with stable ocata ansible and master code for Os components? | 18:02 |
evrardjp | the openstack-infra is under heavy contention right now. | 18:02 |
evrardjp | are you in a rush? | 18:03 |
sauloaislan | ping me back when you have some time | 18:04 |
evrardjp | it's the end of the day for me | 18:06 |
evrardjp | but this patch will be in our recheck list I guess, when our lint bug is fixed. | 18:06 |
sauloaislan | Ok thks!!! | 18:07 |
*** chhavi has quit IRC | 18:08 | |
*** rodrigofm has joined #openstack-ansible | 18:09 | |
mhayden | Ansible 2.4 due out mid September | 18:11 |
*** tobberydberg has quit IRC | 18:12 | |
openstackgerrit | Santhosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db https://review.openstack.org/492631 | 18:13 |
eoseq | hi, does anyone keeps hidden in the pocket (and want to share) a recipe how to change MTU for interfaces in containers? I've run "lxc-containers-create.yml" and waiting, waiting, waiting, drinking coffee, staring at the screen, seeing "ok: [container_name]", grepping "mtu /var/lib/lxc/*/*.ini | grep -v 1500" ... | 18:14 |
openstackgerrit | Santhosh Fernandes proposed openstack/openstack-ansible-os_octavia master: Option to enable provisioning status to be sync with neutron db https://review.openstack.org/492631 | 18:15 |
*** sanfern has quit IRC | 18:27 | |
*** germs has left #openstack-ansible | 18:28 | |
*** smatzek has quit IRC | 18:32 | |
mw_ | eoseq: You want to change the MTU for the lxcbr0 network? | 18:33 |
*** smatzek has joined #openstack-ansible | 18:36 | |
*** germs1 has joined #openstack-ansible | 18:37 | |
*** BjoernT has quit IRC | 18:37 | |
*** BjoernT has joined #openstack-ansible | 18:38 | |
*** nollide has joined #openstack-ansible | 18:40 | |
*** rodrigofm has left #openstack-ansible | 18:43 | |
mw_ | eoseq: Ping :) | 18:48 |
tasker | cloudnull: hey, thanks! I thought might have to happen. Good to know that OSA helps out with that. | 18:55 |
*** pbandark has quit IRC | 18:57 | |
*** BjoernT has quit IRC | 19:01 | |
*** portdirect is now known as eteppete | 19:02 | |
*** jamesdenton has quit IRC | 19:03 | |
*** openstackgerrit has quit IRC | 19:03 | |
*** jamesdenton has joined #openstack-ansible | 19:03 | |
*** eteppete is now known as portdirect | 19:03 | |
*** BjoernT has joined #openstack-ansible | 19:06 | |
*** perniciouscaffei has joined #openstack-ansible | 19:13 | |
tasker | some clarification, if you mention "run the hap(roxy) role", is there a specific syntax to that? I'm not sure how to "run a role". I parse the suggestion to mean "run the haproxy playbook". is that the right way to read that? | 19:14 |
cloudnull | ++ | 19:14 |
cloudnull | openstack-ansible haproxy-install.yml | 19:14 |
cloudnull | should be all you need | 19:14 |
*** portdirect has quit IRC | 19:17 | |
mgariepy | http://paste.openstack.org/show/618095/ | 19:17 |
mgariepy | anyone seen this ? | 19:17 |
cloudnull | mgariepy: no facts? | 19:17 |
*** portdirect has joined #openstack-ansible | 19:17 | |
cloudnull | or bad facts? | 19:17 |
mgariepy | it's in /etc/openstack_deploy/ansible_facts/controller03_galera_container-e57742ca | 19:17 |
cloudnull | maybe delete the facts and then run again ? | 19:18 |
cloudnull | whenever i see things like that I typically nuke the facts dir | 19:18 |
tasker | cloudnull: thanks. that's what I was thinking. | 19:18 |
*** vnogin has joined #openstack-ansible | 19:19 | |
mgariepy | cloudnull, removed /etc/openstack_deploy/ansible_facts/controller03_galera_container-e57742ca and got the same result. | 19:22 |
*** vnogin has quit IRC | 19:24 | |
mgariepy | hmm gather_fact + -l doesnt' seems to work well.. | 19:24 |
*** kristian__ has joined #openstack-ansible | 19:28 | |
*** kristian__ has quit IRC | 19:33 | |
*** nollide has quit IRC | 19:35 | |
*** nollide has joined #openstack-ansible | 19:37 | |
*** kristian__ has joined #openstack-ansible | 19:38 | |
*** tobberydberg has joined #openstack-ansible | 19:38 | |
*** tobberydberg has quit IRC | 19:42 | |
*** tobberydberg has joined #openstack-ansible | 19:47 | |
*** openstackgerrit has joined #openstack-ansible | 19:50 | |
openstackgerrit | Merged openstack/openstack-ansible-os_tempest stable/newton: Support installing plugins from packages https://review.openstack.org/491026 | 19:50 |
*** kristian__ has quit IRC | 19:50 | |
*** tobberydberg has quit IRC | 19:52 | |
mhayden | oh my, 492539 moved into the gate | 19:56 |
* mhayden holds his breath | 19:56 | |
evrardjp | mhayden: woot. Quite an important milestone. | 19:56 |
evrardjp | I was talking about ansible 2.4, but this applies too. | 19:57 |
*** tobberydberg has joined #openstack-ansible | 19:57 | |
*** kristian__ has joined #openstack-ansible | 20:00 | |
mhayden | odyssey4me: i added the depends-on to the pip_install review, not https://review.openstack.org/492551 | 20:00 |
mhayden | do i have it backwards? | 20:00 |
mhayden | oh nvm i think i see where you're going | 20:01 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs https://review.openstack.org/492551 | 20:03 |
mhayden | xenial passed, but centos is crawling | 20:03 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl https://review.openstack.org/492601 | 20:04 |
*** jwitko has joined #openstack-ansible | 20:04 | |
*** smatzek has quit IRC | 20:07 | |
*** tobberydberg has quit IRC | 20:09 | |
mhayden | wow, the check jobs are down from 326 to 98 | 20:10 |
* mhayden high fives cloudnull | 20:10 | |
*** aludwar has quit IRC | 20:11 | |
spotz | woot mhayden cloudnull!!!! | 20:12 |
mhayden | tempest tests started 41 minutes into the job. this is gonna be close | 20:13 |
*** aludwar has joined #openstack-ansible | 20:13 | |
prometheanfire | :D | 20:16 |
evrardjp | yeah. | 20:16 |
evrardjp | more thrilling than watching a horse race. | 20:16 |
spotz | heheh | 20:17 |
*** tobberydberg has joined #openstack-ansible | 20:18 | |
tasker | running the haproxy-install playbook again did not result in a single config file. I'm using OSA 13.3.7; do I need to change versions? or maybe an old fact is getting in my way (though, it gathered facts right before running)? moving the old configs out of the way also did not help. | 20:20 |
*** hamzy has quit IRC | 20:24 | |
*** pbandark has joined #openstack-ansible | 20:29 | |
*** pbandark has quit IRC | 20:29 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Revert "Add linter for passing pkgs as list" https://review.openstack.org/492539 | 20:32 |
*** sdake is now known as k2so | 20:37 | |
*** kristian__ has quit IRC | 20:38 | |
mhayden | YAY! | 20:38 |
*** yusef has joined #openstack-ansible | 20:38 | |
mhayden | #success mhayden cleaned up his own mess and unblocked the gate (but it did take about 8 hours) | 20:38 |
openstackstatus | mhayden: Added success to Success page | 20:39 |
mhayden | haha | 20:39 |
*** jamesdenton has quit IRC | 20:39 | |
*** aludwar has quit IRC | 20:41 | |
*** asura has joined #openstack-ansible | 20:42 | |
*** aludwar has joined #openstack-ansible | 20:42 | |
SamYaple | :+1: | 20:42 |
asura | Anyone seen the following error on this task: | 20:42 |
asura | fatal: [infra1_horizon_container-9ef7698e]: FAILED! => {"failed": true, "msg": "Timeout (7s) waiting for privilege escalation prompt: mesg: ttyname failed: Success\r\n"} | 20:42 |
asura | task [os_horizon : Collect and compress static files] ************************** | 20:42 |
*** jamesdenton has joined #openstack-ansible | 20:42 | |
asura | Appears when I try to sudo -i inside the infra1_horizon_container-9ef7698e container | 20:43 |
tasker | sudo usually requires access to the TTY so that it can ask for a password. look at the ansible keyword "become" when you need to get elevated permissions. | 20:44 |
asura | Yeah, the container appears to not be able to acquire the TTY | 20:44 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl https://review.openstack.org/492601 | 20:45 |
asura | root@infra1-horizon-container-9ef7698e:~# sudo -i mesg: ttyname failed: Success root@infra1-horizon-container-9ef7698e:~# | 20:45 |
tasker | oh .. interesting. can you reboot the container? or log out / log back in? | 20:46 |
*** esberglu has quit IRC | 20:47 | |
*** gouthamr_ has quit IRC | 20:50 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-pip_install master: Allow override of RDO repo baseurl https://review.openstack.org/492601 | 20:51 |
tasker | looks like I need at least OSA 14.0.0 in order to concatenate my haproxy config. 14.0.0 references the (at the time) new "openstack-ansible-haproxy_server" repo and uses the ansible module "assemble" to concatenate the /etc/haproxy/conf.d files into a single haproxy.cfg | 20:51 |
*** nollide has left #openstack-ansible | 20:52 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs https://review.openstack.org/492551 | 20:54 |
asura | I rebooted it and the error is still there. I'm going to try and destroy it and rerun the setup-hosts.yml | 20:54 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery https://review.openstack.org/492465 | 20:54 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-tests master: Discover CentOS mirror in nodepool jobs https://review.openstack.org/492551 | 20:54 |
*** perniciouscaffei has quit IRC | 20:59 | |
*** esberglu has joined #openstack-ansible | 21:01 | |
*** tobberydberg has quit IRC | 21:02 | |
*** esberglu_ has joined #openstack-ansible | 21:02 | |
*** esberglu has quit IRC | 21:02 | |
*** tobberydberg has joined #openstack-ansible | 21:02 | |
*** tobberydberg has quit IRC | 21:07 | |
openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Install MariaDB-shared https://review.openstack.org/491930 | 21:07 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Run resolvconf role on hosts only after unbound is deployed https://review.openstack.org/491508 | 21:08 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible-os_octavia master: Enable V2 Octavia API (Experimental) https://review.openstack.org/484440 | 21:08 |
spotz | things are going through!!!!! | 21:10 |
asura | After destroying the horizon container, would the following be a good approach: openstack-ansible setup-hosts.yml --limit infra1_horizon_container-9ef7698e; openstack-ansible setup-infrastructure.yml --limit infra1_horizon_container-9ef7698e; openstack-ansible setup-openstack.yml --limit infra1_horizon_container-9ef7698e ? | 21:11 |
*** jwitko has quit IRC | 21:11 | |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Update fastest-infra-wheel-mirror https://review.openstack.org/491195 | 21:12 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Improve proxy vars in user_variables.yml https://review.openstack.org/491791 | 21:13 |
openstackgerrit | Major Hayden proposed openstack/openstack-ansible master: Revert "Reduce container counts for cinder, ironic and trove" https://review.openstack.org/471822 | 21:13 |
* mhayden rechecked/rebased a bunch | 21:16 | |
* mhayden heads out | 21:16 | |
cloudnull | tasker: are you running newton ? | 21:18 |
cloudnull | asura: if you're just looking to kick the new container | 21:18 |
cloudnull | openstack-ansible lxc-container-create.yml --limit horizon_all | 21:18 |
cloudnull | openstack-ansible os-horizon-install.yml | 21:18 |
cloudnull | and you should be good | 21:18 |
asura | I'm trying with 14.2.7; got stuck on the final step openstack-ansible setup-openstack.yml | 21:19 |
cloudnull | mgariepy: sorry was driving home | 21:19 |
cloudnull | did you get it to go ? | 21:19 |
asura | well i destroyed that container and I'm trying again openstack-ansible setup-openstack.yml | 21:19 |
asura | but that container still has that error message when I sudo -i inside it | 21:20 |
cloudnull | if you destroyed it, you'll need to recreate it using lxc-container-create.yml | 21:20 |
asura | so, it'll probably error again | 21:20 |
cloudnull | if you've not run that already | 21:20 |
tasker | cloudnull: mitaka -- I'm working out an upgrade path to get to Newton. | 21:20 |
cloudnull | tasker: ah! | 21:20 |
cloudnull | so mitaka didn't actually support 16.04 | 21:20 |
tasker | right. | 21:21 |
cloudnull | so you'll need to checkout the newton playbook, resolve the roles | 21:21 |
cloudnull | and then run again | 21:21 |
cloudnull | this is why the playbook is not fixing things for you. | 21:21 |
cloudnull | but you can just concatenate the files yourself ? | 21:21 |
cloudnull | if you just need it fixed here and now | 21:22 |
cloudnull | and then you can map out the upgrade. | 21:22 |
tasker | I could -- I'm just a lazy programmer. <g> | 21:22 |
cloudnull | newton supports both 14.04 and 16.04 at the same time | 21:22 |
cloudnull | so you should be safe to checkout the newton branch of osa, | 21:22 |
cloudnull | run ./scripts/bootstrap-ansible.sh | 21:23 |
cloudnull | and then run the haproxy-oinstall.yml playbook | 21:23 |
*** gouthamr has joined #openstack-ansible | 21:24 | |
*** thorst has quit IRC | 21:24 | |
tasker | i figured changing the OS first, then using OSA to update the OpSt. it almost sounds like your hinting that doing OpSt first and then the operating system. | 21:24 |
cloudnull | ++ | 21:24 |
cloudnull | we built the newton branch to do just that | 21:25 |
cloudnull | you can get to newton, then do the os upgrades without having to deal with the openstack upgrades too | 21:25 |
tasker | I must've missed that during my research sprint. | 21:25 |
cloudnull | and newton can run in a mixed 1404 and 1604 environment | 21:25 |
tasker | that's fantastic. | 21:26 |
cloudnull | so folks can upgrade with time | 21:26 |
cloudnull | the only requirement is you have at least 1 infra node (for the repo servers) in whatever os you wish to support | 21:26 |
tasker | as opposed to a repo_container? | 21:26 |
*** thorst has joined #openstack-ansible | 21:27 | |
cloudnull | which means you could have cent7, trusty, suse, and xenial as your control plane and you'd be able to run computes or containers in all the os's | 21:27 |
cloudnull | the containers are built using the base os | 21:27 |
cloudnull | of the host | 21:28 |
cloudnull | so you need 1 repo container running the os of the type you wish to support | 21:28 |
tasker | I think I get what you're saying .. the host from which I run OSA? | 21:28 |
cloudnull | yes. | 21:29 |
cloudnull | so infra1 = trusty, infra2 = trusty, infra3 = xenial and you'd be good to go | 21:29 |
cloudnull | then you can role through the rest of your environment rekicking or upgrading in place to get everything to xenial | 21:30 |
tasker | great! thanks for your insight. | 21:30 |
*** thorst has quit IRC | 21:31 | |
spotz | mhayden no beuno on neutron dbf | 21:35 |
spotz | dnf even | 21:35 |
openstackgerrit | Merged openstack/openstack-ansible-lxc_hosts master: Correct lxc_image_cache_server value https://review.openstack.org/492452 | 21:40 |
evrardjp | thanks mhayden for following this | 21:44 |
*** thorst has joined #openstack-ansible | 21:49 | |
*** thorst has quit IRC | 21:54 | |
*** aludwar has quit IRC | 21:57 | |
openstackgerrit | Merged openstack/openstack-ansible-galera_client master: Allow MariaDB gpg overrides without extra-vars https://review.openstack.org/492074 | 21:58 |
*** aludwar has joined #openstack-ansible | 21:58 | |
spotz | cloudnull evrardjp mhayden - https://review.openstack.org/#/c/491089/9 passed!!!!! | 22:00 |
cloudnull | woot! | 22:00 |
*** schwicht has quit IRC | 22:01 | |
spotz | cloudnull: give it a hand across the finish line! | 22:01 |
cloudnull | done | 22:01 |
spotz | :) | 22:01 |
*** kylek3h has quit IRC | 22:07 | |
evrardjp | well let's see that it passes the merge | 22:08 |
evrardjp | :D | 22:08 |
evrardjp | odyssey4me: you'll like to know that this passed: https://review.openstack.org/#/c/492074/ too :p | 22:12 |
*** vnogin has joined #openstack-ansible | 22:13 | |
*** openstackgerrit has quit IRC | 22:18 | |
*** vnogin has quit IRC | 22:18 | |
*** exodusftw has quit IRC | 22:19 | |
*** exodusftw has joined #openstack-ansible | 22:23 | |
*** schwicht has joined #openstack-ansible | 22:24 | |
cloudnull | so what all needs to be babysat to make master happy once again ? | 22:32 |
evrardjp | I had the impression that we had another series of patches, but I rechecked what you didn't recheck yet cloudnull | 22:40 |
evrardjp | at least what I know Jesse cared :p | 22:40 |
evrardjp | and the bare minimum to be honest, so I'd probably missed some | 22:40 |
evrardjp | I am tired, I'm going to bed ... See you tomorrow! | 22:40 |
cloudnull | chao evrardjp | 22:42 |
cloudnull | see you tomorrow | 22:42 |
spotz | night evrardjp | 22:44 |
spotz | cloudnull: if you have a link of things to watch I should be about after we run out to the store | 22:45 |
cloudnull | im just keeping an eye on zuul | 22:45 |
*** openstackgerrit has joined #openstack-ansible | 22:45 | |
openstackgerrit | Merged openstack/openstack-ansible-ceph_client master: Update UCA to Pike https://review.openstack.org/491880 | 22:45 |
*** BjoernT has quit IRC | 22:47 | |
*** esberglu_ has quit IRC | 22:47 | |
*** yusef has quit IRC | 22:48 | |
*** schwicht has quit IRC | 22:51 | |
*** craigs__ has quit IRC | 23:01 | |
openstackgerrit | Merged openstack/openstack-ansible-os_swift master: Optimize swift gate https://review.openstack.org/491089 | 23:02 |
*** rodolof has quit IRC | 23:11 | |
*** rodolof has joined #openstack-ansible | 23:11 | |
*** gouthamr has quit IRC | 23:12 | |
openstackgerrit | Merged openstack/openstack-ansible-tests master: Use LXC reverse proxy and improve UCA repo discovery https://review.openstack.org/492465 | 23:14 |
*** chyka has quit IRC | 23:15 | |
openstackgerrit | OpenStack Proposal Bot proposed openstack/openstack-ansible-os_swift master: Updated from OpenStack Ansible Tests https://review.openstack.org/490548 | 23:16 |
*** rodolof has quit IRC | 23:25 | |
*** thorst has joined #openstack-ansible | 23:38 | |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Download LXC image with async via aria2 https://review.openstack.org/491798 | 23:55 |
openstackgerrit | Kevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Download LXC image with async via aria2 https://review.openstack.org/491798 | 23:59 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!