Wednesday, 2017-12-13

cloudnullthanks spotz!00:01
*** hybridpollo has joined #openstack-ansible00:09
*** yifei has joined #openstack-ansible00:11
openstackgerritMerged openstack/openstack-ansible-os_nova master: Updated from OpenStack Ansible Tests  https://review.openstack.org/52582100:12
*** vnogin has joined #openstack-ansible00:13
*** yifei has quit IRC00:15
openstackgerritJerry Zhao proposed openstack/openstack-ansible master: make include tasks dynamic when there is rescue  https://review.openstack.org/52754600:16
*** vnogin has quit IRC00:19
*** hamzy has joined #openstack-ansible00:21
*** yifei has joined #openstack-ansible00:23
*** openstackgerrit has quit IRC00:33
*** chyka_ has quit IRC00:34
*** openstackgerrit has joined #openstack-ansible00:45
openstackgerritOpenStack Proposal Bot proposed openstack/openstack-ansible-repo_build stable/pike: Updated from OpenStack Ansible Tests  https://review.openstack.org/52755100:45
openstackgerritMerged openstack/openstack-ansible-galera_server master: Further simplify the upgrade check  https://review.openstack.org/52408600:52
openstackgerritMerged openstack/openstack-ansible stable/pike: Only build ARA report when test fails  https://review.openstack.org/51221700:57
*** masuberu has quit IRC00:59
*** vnogin has joined #openstack-ansible01:08
*** liangqi has joined #openstack-ansible01:19
openstackgerritMerged openstack/openstack-ansible stable/pike: Allow disabling container restarts  https://review.openstack.org/52725601:22
*** woodard has joined #openstack-ansible01:23
*** hw_wutianwei has joined #openstack-ansible01:26
*** vnogin has quit IRC02:01
*** gouthamr has joined #openstack-ansible02:06
*** chyka has joined #openstack-ansible02:06
*** jafeha__ has joined #openstack-ansible02:07
*** jafeha has quit IRC02:11
*** chyka has quit IRC02:11
*** rodolof has quit IRC02:12
*** lbragstad has quit IRC02:25
*** masber has joined #openstack-ansible02:27
spotzwelcome cloudnull02:31
*** poopcat has quit IRC03:10
*** pbandark has quit IRC03:19
*** poopcat has joined #openstack-ansible03:22
*** poopcat1 has joined #openstack-ansible03:27
*** poopcat has quit IRC03:27
*** cuongnv has joined #openstack-ansible03:40
*** jwitko_ has quit IRC03:40
openstackgerritMerged openstack/openstack-ansible master: Add pip config to lxc_hosts  https://review.openstack.org/52730803:42
*** nshetty has joined #openstack-ansible03:48
*** m|y|k has joined #openstack-ansible04:06
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-plugins master: Remove the vars plugin as it's no longer used  https://review.openstack.org/52741504:09
*** threestrands has joined #openstack-ansible04:14
*** threestrands has quit IRC04:14
*** threestrands has joined #openstack-ansible04:14
*** jappleii__ has quit IRC04:15
*** threestrands has quit IRC04:15
*** threestrands has joined #openstack-ansible04:16
*** threestrands has quit IRC04:16
*** threestrands has joined #openstack-ansible04:16
*** jwitko_ has joined #openstack-ansible04:17
*** udesale has joined #openstack-ansible04:17
*** openstackgerrit has quit IRC04:18
*** chhavi__ has joined #openstack-ansible04:22
*** openstackgerrit has joined #openstack-ansible04:22
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-pip_install master: Set pip to use the pypi-server when locked down  https://review.openstack.org/52688904:22
*** dave-mcc_ has quit IRC04:25
*** pmannidi has quit IRC04:27
*** jwitko_ has quit IRC04:29
*** pmannidi has joined #openstack-ansible04:32
*** taseer1 is now known as Taseer04:32
*** threestrands has quit IRC04:36
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_container_create master: Unify container network interfaces with networkd  https://review.openstack.org/52321804:37
*** threestrands has joined #openstack-ansible04:43
*** threestrands has quit IRC04:44
*** threestrands has joined #openstack-ansible04:44
*** threestrands has quit IRC04:44
*** threestrands has joined #openstack-ansible04:44
*** threestrands has quit IRC04:45
*** threestrands has joined #openstack-ansible04:46
*** threestrands has quit IRC04:47
*** threestrands has joined #openstack-ansible04:47
*** m|y|k has quit IRC04:49
*** m|y|k has joined #openstack-ansible04:50
*** m|y|k has quit IRC04:59
*** jose-phillips has quit IRC05:13
*** poopcat1 has quit IRC05:16
*** m|y|k has joined #openstack-ansible05:20
*** jose-phillips has joined #openstack-ansible05:21
*** chyka has joined #openstack-ansible05:23
*** chyka has quit IRC05:27
*** nshetty_ has joined #openstack-ansible05:28
*** woodard has quit IRC05:30
*** nshetty has quit IRC05:31
*** woodard has joined #openstack-ansible05:31
*** Smeared_Beard has quit IRC05:42
*** m|y|k has quit IRC05:45
*** m|y|k has joined #openstack-ansible05:47
*** hybridpollo has quit IRC05:57
*** threestrands has quit IRC06:03
*** nshetty__ has joined #openstack-ansible06:03
*** nshetty_ has quit IRC06:07
*** armaan_ has joined #openstack-ansible06:11
*** armaan has quit IRC06:11
*** armaan_ has quit IRC06:16
*** SmearedBeard has joined #openstack-ansible06:17
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Set the default machinectl limit to unlimited  https://review.openstack.org/52759206:20
*** SmearedBeard has quit IRC06:22
*** nshetty__ is now known as nshetty|BMGR06:34
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Show debug message when cert is not found  https://review.openstack.org/52759806:38
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Show debug message when cert is not found  https://review.openstack.org/52759806:39
*** m|y|k has quit IRC06:47
*** m|y|k_ has joined #openstack-ansible06:47
*** gouthamr has quit IRC06:48
*** chhavi__ has quit IRC06:49
*** chhavi__ has joined #openstack-ansible06:49
*** udesale__ has joined #openstack-ansible07:01
*** arbrandes has joined #openstack-ansible07:01
*** udesale has quit IRC07:03
*** arbrandes1 has quit IRC07:03
*** udesale has joined #openstack-ansible07:04
*** chhavi__ has quit IRC07:05
*** chhavi__ has joined #openstack-ansible07:06
*** udesale__ has quit IRC07:06
*** armaan has joined #openstack-ansible07:12
*** chhavi has joined #openstack-ansible07:14
*** chhavi__ has quit IRC07:16
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Fix SSL cert distribution tasks  https://review.openstack.org/52759807:28
*** pmannidi has quit IRC07:29
*** epalper has joined #openstack-ansible07:32
*** sxc731 has joined #openstack-ansible07:41
openstackgerritMerged openstack/openstack-ansible master: Converge neutron agents onto Baremetal  https://review.openstack.org/45445007:42
*** nshetty|BMGR is now known as nshetty|lunch07:44
*** shardy has joined #openstack-ansible07:46
*** udesale__ has joined #openstack-ansible07:46
*** udesale has quit IRC07:49
*** armaan has quit IRC07:53
*** armaan has joined #openstack-ansible07:53
*** mbuil has joined #openstack-ansible07:59
*** DanyC has joined #openstack-ansible08:00
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701708:01
evrardjpcloudnull: I will unpin indeed08:04
evrardjpcloudnull: now that the convergence into baremetal and more converged stuff exists, will you focus on the migration?08:05
evrardjpso that everyone upgrading can be in the state of master?08:05
*** ThomasS has joined #openstack-ansible08:09
*** jvidal has joined #openstack-ansible08:09
ThomasShi08:09
ThomasSi wanted to reconfiigure keystone08:10
ThomasSand it looks like it "hangs" forever at08:10
ThomasSTASK [pip_install : Install UCA repository key]08:10
*** jafeha__ has quit IRC08:10
ThomasSno error no timeout08:10
ThomasSi am on 16.0.408:10
ThomasSafter reruning it it says fatal: [infra1_keystone_container-3cbadb01]: FAILED! => {"changed": false, "failed": true, "msg": "Failed to lock apt for exclusive operation"}08:11
evrardjpyou already have an apt running then08:12
ThomasStrying to restart the affected container08:12
ThomasSi guess so08:12
ThomasSlooks like it is "hanging" now again at TASK [pip_install : Install UCA repository key]08:13
ThomasSwhat could this be?08:13
evrardjpmay you uncleanly interrupted something, and you still have apt locks?08:17
evrardjpconnect on the machine and try to do an apt update / apt upgrade to see the issue08:17
evrardjpdon't do the upgrade08:17
evrardjpjust do a fake one08:18
evrardjpjust to see08:18
ThomasSrestarted the container and the lock is gone08:19
ThomasSnow the tasks "hangs" at the TASK [pip_install : Install UCA repository key]08:20
ThomasSit sits there forever08:20
ThomasShow can i test in the container it this works?08:20
evrardjpyeah08:22
ThomasSi am in the container08:22
ThomasSapt-get update hangs08:22
ThomasSrestart repo cotainers?08:23
ThomasSinternet works flawlessly from the container08:23
evrardjpno there is something wrong on your container that happened08:23
evrardjpyou have to fix it08:23
evrardjpthen you can restart it if you want08:23
evrardjpbut it looks like all your containers got an issue08:23
evrardjpso I'd be worried08:23
evrardjpmaybe try to restart then all just in case08:23
evrardjpbut I'd check at the root cause08:24
ThomasSi am on a different host08:24
ThomasSsame keystone container08:24
ThomasSapt-get also hanging08:24
ThomasSlooks like all containers08:25
evrardjpI would be worried that your base template was broken due to something you did.08:25
ThomasSso restart the repo?08:25
evrardjpis that a new environment?08:25
evrardjpyou're still in testing phase right?08:25
ThomasSa test one works fine so far08:25
evrardjpWhat did you do before this happened08:25
ThomasSyes but i would not want to destroy it again08:25
evrardjp?08:25
evrardjpThomasS: why?08:26
ThomasSreconfigured haproxy with a cutsom service08:26
evrardjpno I mean something that touches apt08:26
ThomasSand then added ldap to users var08:26
ThomasSnothing08:26
evrardjpDid you control C on something?08:26
ThomasSyes08:26
ThomasSbut only after i noticed that the task was hanging08:26
evrardjpmmm08:27
evrardjprestart your containers see if it goes better.08:27
evrardjpbut I am worried that there would be something wrong somewhere.08:27
evrardjpI don't have time to look at that in more details, I am sorry08:27
evrardjpbut this is definitely something in your env08:28
ThomasSok08:28
evrardjpfinding the root cause is the key to know how to not have it happen again08:28
ThomasSi think i know what has happend....08:32
*** sxc731 has quit IRC08:35
*** yolanda__ has joined #openstack-ansible08:37
evrardjpThomasS: yes?08:37
*** yolanda has quit IRC08:40
evrardjpSamYaple: your advice with permissions of yesterday didn't change anything it's something else08:44
evrardjpif you have another idea08:45
evrardjpon keystone I meant08:45
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Build everything on metal  https://review.openstack.org/50422408:46
*** yolanda__ has quit IRC08:46
*** yolanda__ has joined #openstack-ansible08:46
*** yolanda__ is now known as yolanda08:47
*** nshetty|lunch is now known as nshetty08:48
*** vnogin has joined #openstack-ansible08:49
*** jafeha__ has joined #openstack-ansible08:51
*** pmannidi has joined #openstack-ansible08:52
*** vnogin has quit IRC08:53
ThomasSjust for the records08:56
ThomasSit was a problem in the front firewall :-)08:56
ThomasSthanks evrardjp for your help08:56
evrardjpI couldn't help I am sorry08:57
evrardjpbut I am glad you found the root cause08:57
evrardjpfront firewall gave wrong headers and broke apt?08:57
evrardjpor is there a more hidden issue like mtu?08:57
*** jafeha has joined #openstack-ansible08:59
*** chyka has joined #openstack-ansible08:59
ThomasSoh no08:59
ThomasSnow i am getting the "getting modern pip" error again....09:00
*** jafeha__ has quit IRC09:00
ThomasSTASK [pip_install : Install pip packages (fall back mode)]09:00
ThomasSthis fails...09:00
ThomasSall containers can reach the internet09:00
ThomasSthe first task which fails on os-keystone is this one09:01
ThomasSTASK [pip_install : Get Modern PIP]09:01
*** chyka has quit IRC09:03
*** pmannidi has quit IRC09:04
ThomasSok09:04
ThomasSit wants to pull a file from the repo http://10.0.100.9:8181/os-releases/16.0.5/ubuntu-16.04-x86_64/get-pip.py09:04
ThomasSwhich is not there09:04
ThomasShow can this be fixed?09:04
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: Fix automatic log copying in Zuul runs  https://review.openstack.org/51644809:05
*** pmannidi has joined #openstack-ansible09:05
evrardjpThomasS: run repo build09:06
ThomasSok09:06
ThomasSshould i checkour 16.0.5 ?09:06
ThomasSi have the system on 16.0.409:06
evrardjpYou probably already did09:06
evrardjpelse it would not know09:06
evrardjpso when you checkout a new version you should always bootstrap ansible again and run all the playbooks09:07
evrardjpin your case just repo build would do the trick09:07
ThomasSi will follow the minor upgrade guide09:08
*** masber has quit IRC09:09
ThomasSi really know how to break things ;:-(09:09
*** sxc731 has joined #openstack-ansible09:15
*** pradiprwt has joined #openstack-ansible09:19
pradiprwtHi Everyone, I am trying to configure networking in centos 7 but I don't have much experience with centos. Can any one please provide or refer the sample configuration for interface, vlan interface and bridge interface.09:22
*** rpittau has quit IRC09:26
evrardjppradiprwt: we have a wishlist bug item for that. Until it's solved you'll have to sort it out yourself because I sadly can't help you :(09:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests master: Revert "Revert "Use Ansible 2.4""  https://review.openstack.org/52720009:29
evrardjpis there no redhat network configuration guide?09:29
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-tests stable/pike: Allow additional parameters for ansible-lint  https://review.openstack.org/52764509:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Skip ansible-lint test against roles  https://review.openstack.org/52764709:31
pradiprwtevrardjp : There is only ubuntu and centos is available in documentation but there is example is  available for network configuration in centos09:32
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Reduce console output in gate jobs  https://review.openstack.org/52764809:32
*** nshetty is now known as nshetty|afk09:32
pradiprwtevrardjp : No example for centos09:33
hwoaranggood morning09:34
odyssey4meo/09:36
evrardjpgood morning hwoarang09:38
*** rpittau has joined #openstack-ansible09:42
*** Taseer has quit IRC09:44
*** vnogin has joined #openstack-ansible09:44
*** nshetty|afk is now known as nshetty09:46
evrardjphwoarang: could you vote on https://review.openstack.org/#/c/527127/ ? Neutron gates are broken right now due to this: http://logs.openstack.org/07/526307/1/check/openstack-ansible-functional-ubuntu-xenial/3704b3b/job-output.txt.gz#_2017-12-13_09_10_36_33900909:46
hwoarangon it09:47
evrardjpthanks09:47
*** yifei has quit IRC09:49
odyssey4meevrardjp needs adjustment09:52
odyssey4meyou'll have to add that into each of the existing overrides files, otherwise it won't work09:52
*** hw_wutianwei has quit IRC09:56
*** electrofelix has joined #openstack-ansible09:57
openstackgerritMerged openstack/openstack-ansible-os_glance stable/pike: Fix systemd init template for program override  https://review.openstack.org/52708010:01
*** dun has quit IRC10:01
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Include neutron plugins for neutron testing  https://review.openstack.org/52712710:04
odyssey4meevrardjp you've misunderstood the feedback in the review10:04
evrardjpwasn't clear enough then10:04
evrardjpyou wanted to use os_neutron-overrides10:05
evrardjpright?10:05
evrardjpwe are not using it by default so it seems10:05
odyssey4methat is the default10:05
odyssey4meand every functional test has its own override file10:06
evrardjpyes10:06
evrardjpI see that10:06
odyssey4meso don't change tox, just add the plugins to the existing override files10:06
evrardjpcould you show me where it's used by default?10:06
evrardjpth os_neutron-overrides file10:06
odyssey4methe default is to ise <role_name>-overrides.yml: https://github.com/openstack/openstack-ansible-tests/blob/master/test-ansible-functional.sh#L3810:06
odyssey4me*use10:06
odyssey4meso we only need to set the override if we want to change that, like for a scenario for example10:07
evrardjpmaybe I am blind but I don't see it sourced from run tests10:08
odyssey4meevery single functional test uses that script: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tox.ini#L10410:08
evrardjprun_tests -> run tests common -> tox10:08
odyssey4metox -> test-ansible-functional.sh10:08
evrardjpright.10:09
evrardjpok10:09
evrardjpso why does it fail then?10:09
evrardjpmmm10:09
odyssey4mewhy does what fail?10:09
odyssey4meyou're adding a new override file which is missing all the other bits to make that test work10:09
evrardjpthe tests for neutron, because the plugins are installed10:09
evrardjpno I mean they have the same content10:09
odyssey4meoh right, I see: https://github.com/openstack/openstack-ansible-os_neutron/blob/master/tests/os_neutron-overrides.yml#L18-L2110:09
*** cuongnv has quit IRC10:10
odyssey4meok, where's a fail?10:10
odyssey4meare yu sure it's not meant to switch to https://github.com/openstack/neutron-tempest-plugin ? it's a community goal to have plugins in their own repositories IIRC10:10
*** dun has joined #openstack-ansible10:16
openstackgerritMerged openstack/openstack-ansible-os_tempest stable/newton: Fix tempest plugins installation  https://review.openstack.org/52707010:18
openstackgerritManuel Buil proposed openstack/openstack-ansible master: Add networking-sfc repo to repo_packages  https://review.openstack.org/52526410:19
jafehagood morning10:19
*** Taseer has joined #openstack-ansible10:28
*** nshetty_ has joined #openstack-ansible10:32
*** nshetty__ has joined #openstack-ansible10:34
*** vnogin has quit IRC10:35
*** nshetty has quit IRC10:35
*** stuartgr has joined #openstack-ansible10:36
*** nshetty_ has quit IRC10:37
*** vnogin has joined #openstack-ansible10:41
*** nshetty__ has quit IRC10:51
*** nshetty__ has joined #openstack-ansible10:52
*** hamza21 has joined #openstack-ansible10:56
*** gun1x has joined #openstack-ansible11:02
gun1xhey guys11:02
gun1xhow do you upgrade everything (including galera cluster) ?11:02
gun1xand rabbit mq ... all from one command. is that possible?11:02
*** SmearedBeard has joined #openstack-ansible11:03
*** pmannidi has quit IRC11:06
*** pmannidi has joined #openstack-ansible11:07
*** udesale__ has quit IRC11:08
evrardjpopenstack-ansible setup-infrastructure.yml11:10
*** armaan has quit IRC11:11
*** m|y|k_ has quit IRC11:12
*** armaan has joined #openstack-ansible11:12
evrardjpgun1x: that's what we do in our major upgrades: https://github.com/openstack/openstack-ansible/blob/master/scripts/run-upgrade.sh#L182-L18911:12
evrardjpsorry11:12
evrardjphttps://github.com/openstack/openstack-ansible/blob/master/scripts/run-upgrade.sh#L174-L19711:12
*** pmannidi has quit IRC11:13
gun1xevrardjp: i just mean from pike to pike11:15
*** SmearedBeard has quit IRC11:16
evrardjptechnically re-running the playbooks should do. That's what we said we should do at least... Maybe worth asking ppl on this chan here if that changed.11:16
*** m|y|k has joined #openstack-ansible11:18
gloksiniaevrardjp: I just wanna know, What should i focus or concern about deploy openstack using OSA like scaling, upgrading, updating for production at scale.11:26
*** pbandark has joined #openstack-ansible11:28
gloksiniaevrardjp: I'm newbie with this things but I need to build a production asap right now I'm concerned T_T11:31
*** chhavi has quit IRC11:33
*** chhavi has joined #openstack-ansible11:33
ThomasSgloksinia: this is definitively very hard even with OSA11:37
*** armaan has quit IRC11:41
*** armaan has joined #openstack-ansible11:41
*** armaan has quit IRC11:41
odyssey4megloksinia a three node control plane will give you scale up to around 250 computes, depending on your usage profile11:41
odyssey4meif you're network heavy, then rather dedicate some hosts for the network control plane11:42
*** armaan has joined #openstack-ansible11:42
odyssey4meif you're using telemetry, then build a dedicated telemetry rabbitmq cluster11:42
odyssey4meOSA allows you to architect in any way you want, but you have to understand architecting openstack and your use-case's performance profile11:42
odyssey4meif you don't know, then just build something standard and have a really good set of monitoring systems so that you can observe where bottlenecks are and can adjust your arch accordingly11:43
gloksiniaThomasS: Do you experienced using OSA on production ?11:43
*** m|y|k has quit IRC11:43
odyssey4methe only things that matter initially are your choices of network infra (use linuxbridge or something else) and your choices of storage... see the deploy guide's architecture section for more info11:44
*** Guest7416 has quit IRC11:44
*** yifei has joined #openstack-ansible11:44
gloksiniaodyssey4me: That much information let me digest a sec LOL11:45
*** nshetty__ is now known as nshetty11:47
openstackgerritMerged openstack/openstack-ansible stable/pike: Change the galera health check for better cluster health  https://review.openstack.org/52709911:47
gloksiniaodyssey4me: Okay for now i have got a standard deployment using OVS as network and Ceph as backend for testing.11:48
gloksiniaodyssey4me: But only one problem of mine is how can i monitoring it well ?11:50
gloksiniaodyssey4me: Do you have any suggestion ?11:50
odyssey4megloksinia that's going to be up to you - we don't have a convenient suggestion unfortunatey11:52
odyssey4mesome use zabbix, some use nagios, some use prometheus, some use sensu11:52
*** pradiprwt has quit IRC11:52
odyssey4meothers still use various proprietary bits11:52
odyssey4methe only stuff we have which could be useful is https://github.com/openstack/openstack-ansible-ops/tree/master/cluster_metrics but that's just metrics, not alerting afaik11:53
gokhanhi folks, I see a bug on magnum on openstack ansible pike . Because of keystone public endpoint we can not create kubernates and swarm cluster. keystone public endpoint uses keystone version 2. But magnum need v311:56
odyssey4megokhan we've been using v3 for the public endpoint since kilo11:57
gloksiniaodyssey4me: Oh yeah that's one cloudnull suggest me too so i'm implementing but it can be monitoring only resource usage right ? Does it enough ? Do i need to monitoring on specific for some service ?11:57
odyssey4meif you have a v2 endpoint, then something's not right11:57
gokhanit creates public endpoint https://example.org:5000 but magnum needs https://example.org:5000/v311:57
odyssey4megokhan what we do find, though, sometimes is that the conf for the service is set to use v2 because of the service not understanding how to use v3... so usually it's a misconfig in the service conf, nothing to do with keystone11:58
odyssey4megokhan that means that magnum is not able to use versionless endpoints, which is a bug in magnum... or it's a misconfig in the magnum.conf because the config tells it how to use it and the keystoneauth library does the version discovery and stuff11:59
CloudTokogloksinia, we use check_mk11:59
odyssey4meI'd suggest comparing the cinder/nova/neutron/glance keystone client config and service config bits to spot differences11:59
CloudTokocustom scripts , rally to test the platform from time to time ... check_mk for the hosts11:59
odyssey4megloksinia if you want to scale, you want to monitor everyting - you need all the data you can get to be informed11:59
odyssey4mea word of advice though, don't try to get it perfect first time - that is an impossible task12:00
odyssey4meprepare the environment to change, and change often12:01
odyssey4memake sure you have a good test env, one that you can build/rebuild over and over again to try different things to figure out how you can evolve and improve12:01
gokhanodyssey4me, magnum use keystone public endpoint for trustee_keystone_interface. it does not get it from keystone auth. You said we have been using v3 but when I run on any openstack instance curl -vk https://example.org:5000 it says it is using v212:04
gloksiniacloudtoko: Thank you so much for your advice. I will working on it.12:07
*** yifei has quit IRC12:09
odyssey4megokhan ok, so https://github.com/openstack/openstack-ansible-os_magnum/blob/master/templates/magnum.conf.j2 contains a bunch of different keystone stuff12:10
odyssey4methere is the magnum service bit which is the keystone_authtoken section, which is not what your concern is12:11
odyssey4methere is the trust section, which sets some things but may not be setting everything, and it's plausible that magnum's defaults set it to use v2 instead of v312:11
gloksiniaodyssey4me: Yep fighting, I will working hard on it. So last question what about 3 site openstack any suggestion ??12:12
odyssey4methen there are all the client sections which, as you can see, we do minimal config for in the hope that magnum has good defaults12:12
odyssey4menot sure if this helps, but in neutron there is also a trust thing, which we configure like https://github.com/openstack/openstack-ansible-os_neutron/blob/master/templates/neutron.conf.j2#L107-L11612:13
odyssey4mebut I think you'll need to look into what's being configured in your env, what the defaults are, and therefore what might need changing to make it do the right things12:13
odyssey4megloksinia what about 3 site openstack? you can do it in many, many ways - it depends what you're trying to achieve12:13
*** sxc731 has quit IRC12:14
gloksiniaodyssey4me: Okay, Thank you so much :)12:16
openstackgerritMerged openstack/openstack-ansible-os_nova master: Update static files  https://review.openstack.org/52630812:16
*** chhavi__ has joined #openstack-ansible12:18
*** chhavi has quit IRC12:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/ocata: Implement a proper WSREP check for galera  https://review.openstack.org/52767912:22
ThomasSgloksinia: one suggestion from my side keep it as simple as possible, i would also go with linuxbrigdes instead of ovs12:23
*** dave-mccowan has joined #openstack-ansible12:23
*** armaan has quit IRC12:31
*** armaan has joined #openstack-ansible12:32
*** masuberu has joined #openstack-ansible12:33
*** armaan has quit IRC12:37
*** armaan has joined #openstack-ansible12:38
openstackgerritMarkos Chandras (hwoarang) proposed openstack/ansible-hardening master: tasks: auth: Use standard Grub2 authentication mechanism  https://review.openstack.org/52768212:39
*** yifei has joined #openstack-ansible12:42
*** jamesdenton has joined #openstack-ansible12:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/newton: Implement a proper WSREP check for galera  https://review.openstack.org/52768412:48
*** smatzek has joined #openstack-ansible12:51
*** nshetty has quit IRC12:53
openstackgerritMarkos Chandras (hwoarang) proposed openstack/ansible-hardening master: tasks: Add missing tags for async tasks  https://review.openstack.org/52768512:55
*** vnogin has quit IRC12:56
*** armaan has quit IRC12:56
*** armaan has joined #openstack-ansible12:57
gokhanodyssey4me, magnum use keystone v3, magnum doesn't work with v2. because of that it doesn't work clearly. is it possible to change keystone public endpoint from https://example.com:5000 to https://example.com:5000/v3 ? is it be problem on other services ?12:57
odyssey4megokhan the way things are moving, all endpoints are going versionless12:57
odyssey4methe libraries that magnum uses understand how to discover the version12:58
odyssey4meif magnum is not able to consume a versionless endpoint, then find out from them how to configure it so that it either overrides the endpoint or uses the library to derive it from the versionless endpoint12:58
*** udesale has joined #openstack-ansible12:58
odyssey4meso yes, the issue is with magnum's code, or magnum's configuration12:59
gokhanodyssey4me, ok thanks for your help I guess issue is with magnum's code13:02
*** m|y|k has joined #openstack-ansible13:11
*** vnogin has joined #openstack-ansible13:12
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_server stable/newton: Implement a proper WSREP check for galera  https://review.openstack.org/52768413:16
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Fix tempest tests  https://review.openstack.org/52768613:17
odyssey4meevrardjp good find and fix, just one question in there13:20
mhaydengood morning, folks13:28
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Create and use a local LXC RPM repo  https://review.openstack.org/52673913:31
*** woodard has quit IRC13:37
*** woodard has joined #openstack-ansible13:38
mhaydenhwoarang: thanks for tackling that grub2 issue13:41
mhaydenbut i had a question or two > https://review.openstack.org/52768213:41
hwoarangyeah i needed that for suse today and i noticed it didn't work there too13:42
hwoaranglet me check13:42
hwoarangmhayden: i moved  grub_custom_file to vars/main.yml because it's common across all distros13:43
hwoarangso i dropped it from all the distro files13:43
hwoarangis that what you mean?13:43
mhaydenoh, i think i see what's going on now13:43
mhaydenLGTM -- let's give this a try13:44
*** hw_wutianwei_ has joined #openstack-ansible13:47
openstackgerritMajor Hayden proposed openstack/openstack-ansible-os_nova master: Handle Pike changes for Nova  https://review.openstack.org/52551513:49
gun1xany ideea why i always get this wenn trying to add an image: "403 Forbidden: It's not allowed to add locations if locations are invisible. (HTTP 403)" ?13:54
*** hw_wutianwei has joined #openstack-ansible13:55
bndzorcheck glance log gun1x14:04
bndzorpossibly https://bugs.launchpad.net/glance/+bug/1595335 ?14:04
openstackLaunchpad bug 1595335 in Glance "Add image location fails when show_multiple_locations = false" [Undecided,Confirmed]14:04
*** sxc731 has joined #openstack-ansible14:08
openstackgerritMerged openstack/openstack-ansible-plugins master: Remove the vars plugin as it's no longer used  https://review.openstack.org/52741514:13
*** smatzek has quit IRC14:19
mhaydencloudnull: interesting LWN post about process tagging and how it can help identify processes in containers -> https://lwn.net/Articles/741261/14:22
mhaydenthought that might be interesting to ya since you did the slice work in systemd14:22
evrardjpmhayden: subscription required!14:30
mgariepymorning everyone14:31
evrardjpmorning14:32
evrardjphow is the leap?14:32
evrardjpof faith14:32
evrardjp;p14:32
mgariepyit works14:32
evrardjpohoh I just received a notification that my snes mini is waiting for me at a shop! wooot. I hope I will get the chance to go to the shop this week :)14:33
mgariepynow need to upgrade to xenial :) haha14:33
evrardjphahaha14:33
evrardjpdo you have a blog where you can post your war stories?14:33
mgariepyalmost updating to  an EOL if fine14:34
mgariepynop no blog.14:34
mgariepyhaha14:34
mgariepywent pretty easy.14:34
mgariepyjust had to do 2-3 patches to fix stuff ;)14:34
mgariepyhaha14:34
openstackgerritMerged openstack/openstack-ansible-os_glance master: Update glance NFS for systemd  https://review.openstack.org/52693014:34
*** openstackstatus has quit IRC14:36
*** openstackstatus_ has joined #openstack-ansible14:36
*** openstackstatus has joined #openstack-ansible14:37
*** ChanServ sets mode: +v openstackstatus14:37
*** lbragstad has joined #openstack-ansible14:37
*** openstackstatus_ has quit IRC14:37
*** openstackstatus has quit IRC14:38
*** openstackstatus_ has joined #openstack-ansible14:38
*** openstack has quit IRC14:39
*** openstack has joined #openstack-ansible14:42
*** ChanServ sets mode: +o openstack14:42
*** openstack has quit IRC14:43
*** openstack has joined #openstack-ansible14:47
*** ChanServ sets mode: +o openstack14:47
*** strattao has left #openstack-ansible14:49
*** strattao has joined #openstack-ansible14:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Fix automatic log copying in Zuul runs  https://review.openstack.org/52770114:50
*** strattao has left #openstack-ansible14:51
*** marst has joined #openstack-ansible14:56
mgariepyhwoarang, i responded to your comment on : https://review.openstack.org/#/c/525654/14:59
gun1xcan i run apt dist-upgrade on systems running osa ? :D14:59
mgariepyif you want i can remove the file created on that task.14:59
hwoarangmgariepy: what I mean was that if you run this script twice, the file will hold the IPs from the first invocation15:00
hwoarangas well as those from the second run15:00
*** hw_wutianwei has quit IRC15:00
hwoarangnot sure if that's a problem really, i just thought to point that out :) but if it mixes ips from different runs then it would be hard to extract info from it15:01
*** armaan has quit IRC15:01
*** armaan has joined #openstack-ansible15:02
*** dun has quit IRC15:02
*** sxc731 has quit IRC15:03
*** ianychoi has quit IRC15:04
mgariepywell i'm not sure it would cause an issue.15:04
mgariepyand this script will only be run once anyway, there are several files created not to repeat steps along the run.15:05
gun1xbndzor: glance log: https://bpaste.net/show/9768a14a566015:05
*** gouthamr has joined #openstack-ansible15:06
*** udesale has quit IRC15:07
mgariepyhwoarang, https://github.com/openstack/openstack-ansible-ops/blob/master/leap-upgrades/re-deploy.sh#L3715:07
hwoarangok i see what you mean15:09
mgariepybut still the file is not used anywhere so i can just remove it.15:09
mgariepyand it's more for the community because my leap upgrade is done and i will not need it in the future (I really hope) haha15:10
hwoarang:p15:12
mgariepylol15:12
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_keystone master: [DNM] debug why on metal fails on gates and not on my machine.  https://review.openstack.org/52495415:15
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [DNM] Build everything on metal  https://review.openstack.org/50422415:15
*** dun has joined #openstack-ansible15:18
*** sxc731 has joined #openstack-ansible15:19
openstackgerritKaio Kassiano Moura Oliveira proposed openstack/openstack-ansible-os_monasca-agent master: Initial OSA zuul v3 role jobs  https://review.openstack.org/52564515:19
*** smatzek has joined #openstack-ansible15:20
*** SerenaFeng has joined #openstack-ansible15:22
*** SerenaFeng has quit IRC15:22
*** SerenaFeng has joined #openstack-ansible15:23
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible-os_neutron master: Update static files  https://review.openstack.org/52630715:23
*** hamza21 has quit IRC15:24
gun1xi found this on the neutron container: /etc/neutron/plugins/ml2/linuxbridge_agent.ini:physical_interface_mappings = flat:eth12,vlan:eth1115:25
gun1xi can't figure the difference between eth12 and eth1115:25
dmsimardodyssey4me: so fwiw our not-awesome workaround for the time being was to get a private network and then provide a jump box15:29
dmsimardwe'll have to think this one through for the next time15:29
mgariepygun1x, it's defined in your openstack_user_config.yml15:32
mgariepygun1x, https://github.com/openstack/openstack-ansible/blob/master/etc/openstack_deploy/openstack_user_config.yml.aio#L76-L9315:33
*** wspthr has quit IRC15:35
gun1xmgariepy: yea but the difference between the vlan and the flat is not clear. however, that is basic openstack knowledge and has nothing to do with OSA.15:36
mgariepygun1x, vlan interface will be able to have tagged vlan for tenant network15:36
mgariepyfor network**915:36
gun1xmgariepy: yea, i read something similar online. but you usually have only one subnet on the physical network, so i fail to see how vlan will help if they all end up on the same layer 3 segment :D15:36
*** wspthr has joined #openstack-ansible15:37
*** yifei has quit IRC15:38
gun1xmgariepy: oh, the system is designed so that you can supply the vlan segregation that was already configured on the switches.15:38
*** SerenaFeng has quit IRC15:38
mgariepyyep.15:38
gun1xmgariepy: "disable gateway" means you don't have a L3 gateway on the physical router, right? and if you add the gateway, that will be supplied via DHCP openstack will NOT create an gateway there, right?15:39
openstackgerritMerged openstack/openstack-ansible-galera_server stable/newton: Implement a proper WSREP check for galera  https://review.openstack.org/52768415:39
mgariepylike you can have your external network on vlan XXX and then create the external network in openstack with that vlan for the external traffic.15:40
logan-hwoarang: hey, on the ceph-ansible stuff you were asking about.. here is how they're doing the role breakout: https://github.com/ceph/ceph-ansible/blob/master/contrib/push-roles-to-ansible-galaxy.sh .. I think their CI is broken or the script they use is broken but somehow it is not fully reliable. that push-roles-to-ansible-galaxy.sh is a modified version of a script I wrote for https://git.lstn.net/mirror which is published here: https://gis15:40
logan-t.github.com/Logan2211/528a7fd661e759181875d6edf4dd7c3f ... i have a CI job that just triggers on git changes to upstream ceph-ansible and runs this and have never had any issue. not sure why ceph's thing is so unreliable :/15:40
hwoaranglogan-: so what can we do about it ? :(15:41
hwoarangwoud switching to ceph-ansible solve our issues?15:41
*** phalmos has joined #openstack-ansible15:42
logan-it has pros and cons but yes it would workaround this particular issue15:42
mgariepygun1x, where are you reading that ?15:42
logan-should be possible without too much difficulty15:43
logan-you'll have to modify the osa roles_path I think?15:43
gun1xmgariepy: this is not specified anywhere, that's why i am asking. i tried the following websites: redhat, openstack, ubuntu ...15:43
gun1xmgariepy: all the info is "well if you disable gateway, you don't have a gateway." wow omg that helped, what if i already have an external gateway? :D15:44
jamesdentongun1x are you talking --no-gateway on subnet creation?15:46
gun1xjamesdenton: i am talking about the "disable gateway" option in horizon, when creating a subnet on a flat network15:46
jamesdentonOk. By default, when you create a subnet, openstack assigns the first IP of that CIDR as the gateway IP for that subnet15:47
gun1xjamesdenton: it's unclear for me if "disable gateway" means openstack does not create a router, or if it means that it doesn't tell the VMs they already have a gateway on that network15:47
jamesdentonand that IP will be used when pushing DHCP info to clients, or when attaching networks/subnets to routers15:47
gun1xjamesdenton: ok, so it doesn't create a router.15:48
logan-hwoarang: maybe we could advocate IRR upstream there :D15:48
jamesdentonno15:49
jamesdentonerr. correct, it does not create a router15:49
*** sxc731 has quit IRC15:50
hwoaranglogan-: :) well i think it's worth switching to the monolithinc role. seems upstream has no expectations regarding the split roles15:50
hwoarangi tried to bug them to the IRC channel but nope...15:50
*** udesale has joined #openstack-ansible15:51
*** udesale has quit IRC15:51
*** udesale has joined #openstack-ansible15:58
*** Neptu_ has joined #openstack-ansible16:00
evrardjpodyssey4me: where do I know that a project has subscribed to be follow the requirements process or not?16:01
evrardjpmaybe in governance?16:01
*** CloudToko has quit IRC16:01
*** Yvan has quit IRC16:01
evrardjpprometheanfire: ^16:01
*** Yvan has joined #openstack-ansible16:01
*** udesale has quit IRC16:01
odyssey4meevrardjp https://github.com/openstack/requirements/blob/master/projects.txt16:03
evrardjpthanks16:04
odyssey4melogan- hwoarang yeah, andymccr mentioned that all he does is add the path of /etc/ansible/roles/ceph-ansible to the roles path env var, and tada - everything's awesome16:04
evrardjpodyssey4me: could you remind me why we are in there, while we don't produce anything python related, except maybe our inventory?16:05
evrardjpconsuming and producing seems different to me16:05
odyssey4meevrardjp to keep our requirements/test-requirements in sync with all of openstack16:05
*** ianychoi has joined #openstack-ansible16:06
odyssey4mewe could switch to no longer using tox, and therefore no longer needing either of those files - and therefore not be part of that process16:06
hwoarangodyssey4me: i will have a look thanks!16:07
odyssey4methe question I have is, why does it pain you?16:07
evrardjpI need to weight in the pros and cons16:07
evrardjpwell the tox should indeed not exist for us16:07
odyssey4meif the docs requirements split into their own file, which I think is the plan, then we very likely won't need to use anything else from there any more16:07
evrardjpbut that's not really a problem16:08
evrardjpcould you tell me more about that?16:08
evrardjpthere is a plan to manage requirements inside repos directories like releasenotes/ and docs/ ?16:09
odyssey4meyes, I thought I saw a notification about that being part of the movements for docs16:09
evrardjpso proposal bot will change then16:09
odyssey4mebasically eventually releasenotes and docs will all share a common conf file, and a common requirements file16:09
evrardjpoh I see.16:10
odyssey4meand those requirements will split from the python requirements file16:10
evrardjpI understand16:10
evrardjpI like this16:10
odyssey4meyeah, me too16:11
odyssey4mebut we have to be patient - it will take a few cycles to get done16:11
*** dave-mccowan has quit IRC16:11
odyssey4mesee in https://specs.openstack.org/openstack/docs-specs/specs/pike/os-manuals-migration.html#proposed-change the 'during a later phase'16:11
*** vnogin has quit IRC16:13
odyssey4mehwoarang could you review https://review.openstack.org/527679 (ocata version) given that you approved the newton version? :)16:15
evrardjpoh great more features backport16:16
prometheanfireevrardjp: yep, projects.txt, we have a gate job that checks when people update that they actually subscribe to it16:18
evrardjpthanks16:18
evrardjpprometheanfire: what will be the impact of this future change of plans with the docs?16:18
evrardjpdo you expect ppl leaving the process?16:19
prometheanfireI missed something, what?16:19
hwoarangevrardjp: they are not features. They are extended fixes :D16:19
evrardjphwoarang: haha I heard that before :)16:19
prometheanfireyou only want requirements fixes for docs related stuff?16:20
evrardjpprometheanfire: no, I was just curious how all of this will happen in the future16:20
odyssey4meevrardjp no differently16:20
evrardjpI know nothing will change, but there are maybe projects that will say "we don't need this anymore"16:21
odyssey4mecurrently two files are maintained, in the future there may be more16:21
evrardjplike we could.16:21
odyssey4mewhy would we do that?16:21
openstackgerritMerged openstack/openstack-ansible master: Update test tooling for manual testing  https://review.openstack.org/52713716:21
prometheanfireno one has unsubscribed from reqs16:21
openstackgerritMerged openstack/openstack-ansible master: Fix release-yaml-file-prep.py to include ansible-hardening  https://review.openstack.org/50308316:21
odyssey4melet's not go in circles about the click library again, please16:22
prometheanfirelol16:22
odyssey4meif you would like to subscribe to some changes by the reqs repo, but not others and have a good reason for it, then that should be discussed as an option at the PTG with the teams involved16:22
evrardjpI just noticed we install click as part of our process in gate-check-commit .16:22
evrardjpbecause we install ara16:22
odyssey4meit may or may not be acceptable, depending on the proposal's presentation16:22
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Fix tempest tests  https://review.openstack.org/52768616:22
evrardjpbut let's not talk about that.16:23
evrardjpI am just wondering why are we bothering having things if they are more constraints than solutions. Right now it's more solutions than constraints so we are good.16:23
odyssey4meI'd be happy to actually raise the discussion actually, because both us and infra are using python things outside of g-r and it would be nice if we could not have to do it with hacks16:24
openstackgerritMerged openstack/openstack-ansible-tests stable/pike: Allow additional parameters for ansible-lint  https://review.openstack.org/52764516:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/pike: Fix release-yaml-file-prep.py to include ansible-hardening  https://review.openstack.org/52773416:24
prometheanfirefor osa and infra it's almost as if you have your own external global-constraints, because you don't really do openstack, you manage it16:24
evrardjpodyssey4me: if you like to add that to your to do list, go ahead, I won't prevent you.16:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/ocata: Fix release-yaml-file-prep.py to include ansible-hardening  https://review.openstack.org/52773516:24
evrardjpprometheanfire: exactly.16:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/newton: Fix release-yaml-file-prep.py to include ansible-hardening  https://review.openstack.org/52773616:25
evrardjpand we manage also a proposal bot16:25
prometheanfireya16:25
evrardjpodyssey4me: don't bother changing release-yaml-file-prep, I am not using it.16:26
odyssey4meevrardjp maybe you aren't, but the next PTL might - or someone else might16:26
evrardjpif there is someone else doing releases, maybe worth doing16:26
evrardjpI expect that I'd give a more recent version of things that work16:27
odyssey4meit's a bit sad that you aren't using the tooling we have - if it doesn't work for you, why aren't you making it work for you?16:27
odyssey4meour git repositories are supposed to be the collective knowledge over time - when we start working in isolation and not sharing, the collective wisdom breaks down16:27
evrardjpodyssey4me: I tried, but when I started this, both you and andymccr were not available, so after a few hours I decided to do my own thing that works better at the end.16:27
odyssey4meand we are doomed to repeat the same mistakes again and again16:28
odyssey4meit works better?16:28
evrardjpfor me16:28
*** Yvan has quit IRC16:28
odyssey4meis that why we haven't had static file updates for ages, until you did the patches manually recently?16:28
evrardjpdo you really want to go that way on the critics?16:29
odyssey4meand why we've also had a few releases with mismatching versions?16:29
odyssey4methese are all problems which were solved16:29
odyssey4methey're not perfect, but they are waiting to be improved16:29
evrardjpthe mismatch of version happened when I used the old tooling16:29
odyssey4meso, I'm asking, please improve what's there and use it16:29
*** Yvan has joined #openstack-ansible16:29
odyssey4methat way we all benefit, and we get consistent results16:29
evrardjpbecause of a messup I did. That happens. Humar error.16:29
evrardjpthe files are broken for me, and you've seen it when we tried a release together. At the end you said, you were NEXT TO ME, to drop it down.16:30
evrardjpdoing it again now has the same issues.16:30
evrardjpanyway16:30
odyssey4meuh, dude - no need to shout, no animosity here16:30
evrardjpI am not here to be criticized16:30
evrardjpI am here to help you all16:31
odyssey4meI'm just trying to respond to "don't bother updating that tool" with, well, you should - or delete it.16:31
evrardjpI want to delete it indeed16:31
evrardjpor clean it up16:31
evrardjpkeep the parts that matter16:31
odyssey4medon't delete it without replacing it please16:31
cloudnullmornings16:32
*** sxc731 has joined #openstack-ansible16:32
prometheanfiremoin16:33
Bico_FinoHello!16:33
evrardjphello!16:35
evrardjpcloudnull: Bico_Fino how are things?16:35
odyssey4mewell, now that's quite a thing! http://lists.openstack.org/pipermail/openstack-dev/2017-December/125473.html16:35
Bico_Finonot bad and you evrardjp ?16:36
*** openstacking_123 has joined #openstack-ansible16:36
evrardjpokay I guess, is there anything I can do to help you Bico_Fino ?16:37
Bico_Finoto change external_lb_vip_address, just run haproxy playbook again right?16:37
*** vnogin has joined #openstack-ansible16:38
*** jvidal has quit IRC16:39
evrardjpodyssey4me: yay!16:39
odyssey4meevrardjp yeah, I think it's good too actually16:40
evrardjpBico_Fino: no, because it will be used for the endpoints16:40
Bico_Finohum16:40
Bico_Finowhat else I need to run evrardjp ?16:40
evrardjpYou can either update your endpoints manually, or run the playbooks, I think we now update the endpoints16:40
cloudnullevrardjp: good, and you ?16:41
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Fix SSL cert distribution tasks  https://review.openstack.org/52759816:41
evrardjpcloudnull: depends on who asks I guess :)16:41
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Fix SSL cert distribution tasks  https://review.openstack.org/52759816:41
Bico_Finothanks for the info evrardjp16:42
Bico_FinoOn another subject, it's possible to remove a controller node and add another(Like the compute nodes)?16:42
evrardjpBico_Fino: I think you can manage the endpoints in the openstack cli16:42
evrardjpif you want, directly on the utility container16:42
evrardjp:p16:42
evrardjpBico_Fino: that is more tricky16:43
evrardjpyou want to reduce galera cluster size then increase it again?16:43
evrardjpBico_Fino: the alternative would be to recover from a failure16:43
cloudnullevrardjp: https://review.openstack.org/#/c/477017/ what would you like to see split out ?16:43
cloudnullI can break out the contianer tech changes and then add nspawn after ?16:44
evrardjpcloudnull: I was just scared, and I saw a list of "notable changes", so I thought each of them could be a commit :p16:44
Bico_Finoevrardjp want to remove the full hardware and add another as controller, and use the old hardware to be only a compute node16:44
Bico_Finomaybe I should just deploy it again? :P16:44
evrardjpBico_Fino: can you switch IPs?16:44
Bico_Finoevrardjp yes16:45
evrardjpelse you could say your node infra is dead, you remove its mgmt ip, and reconfigure it with a new ip as compute node, cleanup and reinstall as compute16:45
openstackgerritManuel Buil proposed openstack/openstack-ansible-os_neutron master: Provide support for SFC deployments  https://review.openstack.org/51090916:45
evrardjpthe new node will take the infra node IP, and will get reinstalled to be part of the cluster16:45
Bico_Finoevrardjp bingo. Good idea!16:46
evrardjp"will take" -> "need to be configured with"16:46
openstackgerritMerged openstack/openstack-ansible master: Remove symlinked git cache functionality  https://review.openstack.org/52174916:46
evrardjpthis way you separate the issue in two16:46
evrardjpand I would start with removing the infra and readding it with a new node, then only use the old node as compute16:47
evrardjpbut that's just me16:47
*** chhavi__ has quit IRC16:47
odyssey4mewow, touch wood but the gates appear to be much more reliable today than they have been for ages16:48
evrardjpcloudnull: I trust you can do the right thing to make it more digestable :) But if it's not possible, we'll deal with it later, like we usually do :)16:48
evrardjpthe last series of changes made the builds faster.16:49
odyssey4meit does appear to be helping, yes16:49
evrardjpa ceph build under 1h20 is good16:49
odyssey4mewe're no longer hitting timeouts except on *some( providers16:49
evrardjpI am waiting for all of this to become bare metal16:49
evrardjpto shave 40 minutes.16:50
evrardjpwell16:50
evrardjpnot ALL16:50
odyssey4mebut that will only be one test, surely?16:50
evrardjpbut you understand the idea, faster to test16:50
odyssey4mewe'll still have other tests using containers, so it will still take time16:50
evrardjpodyssey4me: for now yes, but what if ... ?16:50
odyssey4meof course, it opens new options16:51
evrardjpI agree, but I like the proposition of cloudnull to have more smaller jobs16:51
evrardjpso we could have smaller jobs with containers, larger jobs with bare metal16:51
odyssey4meI'd still prefer to sprinkle those across many repositories, instead of all in one repo16:51
*** pbandark1 has joined #openstack-ansible16:52
odyssey4meif we have a 5% chance of failure, and 20 tests, then we're not far from having at least one of those fail in the check/gate cycle and be in recheck hell16:52
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_server master: Update default paths of SSL cert files  https://review.openstack.org/52774016:54
*** pbandark has quit IRC16:54
*** pbandark1 is now known as pbandark16:54
cloudnullI have to agree. the more I work on the gate refactor the more I think having the nova tests for the nova scenarios in the nova role makes the most sense.16:55
hwoarangyeah makes sense16:55
evrardjpYeah16:55
evrardjpWe are just talking about integration here16:55
cloudnullif that means we need to build the jobs out in the integrated repo so the roles can consume them, wonderful16:55
evrardjpI don't think the importance is where we write the jobs16:56
cloudnullall that said, the AIO needs to get smaller.16:56
evrardjpI think what's good is increasing the scenarios coverage while reducing integrated job lengths16:56
*** vnogin has quit IRC16:56
evrardjpmore responibilities to roles and more reuse is good16:57
evrardjpas a side product16:57
cloudnullas seen with that PR to refactor the jobs, the suse tests mostly pass in time.16:57
*** armaan has quit IRC16:57
cloudnullbut with the current AIO they're timing out due to the 2 hour limit16:57
evrardjpcloudnull: suse is not a timeout offender, suse is generally a quick fail when there is a temporarily issue, which doesn't happen that often anymore16:58
*** armaan has joined #openstack-ansible16:58
evrardjpcloudnull: there are still slower than ubuntu though :)16:58
*** vnogin has joined #openstack-ansible17:00
*** chyka has joined #openstack-ansible17:01
hwoarangsuse timesout normally on tempest17:02
hwoarangwhich is better because it used to timeout way before that in the past17:02
cloudnullhave a look at the results for PS 3917:03
cloudnullhttps://review.openstack.org/#/c/516002/3917:03
cloudnullsuse is almost all passing17:03
hwoarangas i told mhayden in the past, centos and suse spend double the time buidling the wheel artifacts17:03
hwoarangand i have no clue why we need so much time for centos and suse17:03
hwoarangthe rest of the tasks are pretty similar17:03
hwoarangbut that wheel building is killing us17:03
*** m|y|k has quit IRC17:03
*** Prateek has quit IRC17:04
mhaydeni haven't figured that out either17:08
mhaydenit's not a network thing as far as i can tell17:08
*** vnogin has quit IRC17:08
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_server master: Update default paths of SSL cert files  https://review.openstack.org/52774017:12
openstackgerritMerged openstack/openstack-ansible-galera_server stable/ocata: Implement a proper WSREP check for galera  https://review.openstack.org/52767917:14
openstackgerritMerged openstack/openstack-ansible-repo_server master: Remove sylinked git cache functionality  https://review.openstack.org/52175017:14
evrardjphwoarang: what would be nice is to know in which part of the process of the repo build, is that when building the wheel themselves, or when doing the venvs?17:17
evrardjpbecause else the change that odyssey4me is introducing will help17:17
odyssey4mehwoarang evrardjp well, regardless of the double-time - my next step is to kill most of whe wheel building by default - only build the hweels we *need* and then build the venvs17:19
evrardjpthat's hwat I meant.17:19
evrardjpwhat*17:19
evrardjpthanks for clarifying17:19
odyssey4mehwoarang mhayden evrardjp hmm, one thing that may be worth checking is whether there are wheels pre-build in infra for the other platforms17:19
odyssey4meif not, that might be ok - but the question is then whether we're enabling the use of the pre-built wheels done on ubuntu, for suse/centos17:20
odyssey4melemme finish what I'm doing here and I'll take a peek17:20
evrardjpthanks odyssey4me17:20
mhaydenso if i look at the repo_build wheel results17:25
mhaydencentos builds wheels 20 seconds slower17:25
mhaydenbut i don't think we have many wheels there17:25
mhaydenin that role17:25
*** dun has quit IRC17:27
hwoarangno the role itself is fine17:29
hwoarangit's in the AIO builds that takes forever17:29
evrardjphwoarang: IO related?17:29
hwoarangin the repo_build role all distros are +/- about the same. but in AIO there is a huge difference17:29
hwoarangevrardjp: i dont know17:29
mhaydenwe do the builds in a container in the repo_build role, too17:30
evrardjpthere is one good way to find out, bare metal!17:30
mhaydenso i doubt it's lxc being silly17:30
evrardjpoh17:30
evrardjpwell it still has its toll17:30
hwoarangodyssey4me: i couldn't figure out whether we use the infra wheel stuff at all but it's been a while since i checked17:30
evrardjpis there anyone willing to help on my bare metal? It's been two weeks I am stuck now.17:30
evrardjpmaybe 3.17:31
evrardjpI have all the logs, the best logs.17:31
evrardjpwow ceph in 1h06 today even17:32
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add scafolding for multiple container techs  https://review.openstack.org/52774917:33
evrardjpping me anytime if you feel up to the challenge!17:33
cloudnullevrardjp: ^17:33
evrardjpcloudnull: great!17:33
cloudnullfirst part of the break down17:33
cloudnullopps, missing things.17:34
cloudnullbut im pulling the commit in two17:34
mhaydenso if i examine a couple of gate jobs, i notice that the wheel building is almost doubled, but building venvs on centos is only 5-10% longer17:35
mhaydenso i'm not sure if this is I/O17:35
*** cshen has joined #openstack-ansible17:35
mhaydeni wish we had container logs when openstack-ansible runs17:36
evrardjpcloudnull: when splitting it allows a more thorough review17:37
evrardjpthanks!17:38
evrardjpmaybe we should push odyssey4me 's changes in the future as a priority then17:39
*** dun has joined #openstack-ansible17:39
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add scafolding for multiple container techs  https://review.openstack.org/52774917:40
evrardjpcloudnull: haha17:40
cloudnull?17:41
odyssey4memhayden maybe you should do a version of https://github.com/openstack/openstack-ansible-tests/commit/b2a1f4e8792337d6de668f77b1d21da4f4a7cb24 for theintegrated build?17:41
odyssey4meor, perhaps even better, we should try to use the same log collection script for the integrated build and the roles17:41
mhaydentrue17:42
evrardjpyou were almost good on the first commit, you'd have kept the aio name and that commit was good.17:42
* mhayden is building a centos vm to see if i can figure out why it can't start LXC containers now :/17:42
cloudnullevrardjp: yea, but i needed to include the actual variable changes in the playbooks17:43
cloudnullI'll reset the upgrade to aio17:43
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add scafolding for multiple container techs  https://review.openstack.org/52774917:44
cloudnull^ that sets the upgrade jobs back to aio17:44
*** germs has joined #openstack-ansible17:45
*** cshen has quit IRC17:46
*** vnogin has joined #openstack-ansible17:46
*** cshen has joined #openstack-ansible17:46
spotzcloudnull: multiple container techs aka not just LXC anymore?17:46
gun1xi get this after a fresh install: "No valid host was found. There are not enough hosts available." ... both kvm hosts are up and running17:47
gun1xafaik other people encountered this, is there a quick fix?17:47
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add scafolding for multiple container techs  https://review.openstack.org/52774917:47
cloudnullspotz: yes. I'm adding nspawn17:47
spotzcool17:47
cloudnullI added all these bits in this PR https://review.openstack.org/#/c/477017/17:48
cloudnullbut it was asked I break that change up, So the first commit will add the required scafolding and I'll rebase the original to be just the inclusion of nspawn17:49
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add scafolding for multiple container techs  https://review.openstack.org/52774917:52
cloudnullsorry evrardjp, last edit i think17:52
*** germs has quit IRC17:52
cloudnulli believe that's all the bits i can break out from the larger nspawn addition17:52
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701717:54
gun1xnevermind, i am on a good path, i can solve this. hosts don't have kvm capabilities17:56
*** mbuil has quit IRC17:57
*** octo-fs has joined #openstack-ansible18:04
*** vnogin has quit IRC18:05
openstackgerritMajor Hayden proposed openstack/openstack-ansible stable/pike: Avoid using gather_facts as a variable  https://review.openstack.org/52775318:09
*** vnogin has joined #openstack-ansible18:09
evrardjpI am off, see you next year guys!18:10
evrardjpwell I will probably be around18:10
mhaydenevrardjp: enjoy!18:10
evrardjpbut have nice winter holidays and enjoy xmas and all that18:11
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701718:11
cloudnulltake care evrardjp18:11
cloudnullsee you in a couple weeks18:11
evrardjpif someone got the chance to look at why my bare metal doesn't work I'd be super happy18:11
spotzseeya evrardjp18:11
evrardjpor ping me when (s)he have cycles for anything for the future :)18:12
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Create and use a local LXC RPM repo  https://review.openstack.org/52673918:16
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add scafolding for multiple container techs  https://review.openstack.org/52774918:17
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701718:18
*** cshen has quit IRC18:18
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible master: Add nspawn container driver  https://review.openstack.org/47701718:19
cloudnullok. sorry for the spam18:19
cloudnullbut i believe they're all broken out18:19
cloudnullif folks have time to review those patches it'd be greatly appreciated.18:21
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Always template a localhost config when server  https://review.openstack.org/52775618:22
*** vnogin has quit IRC18:23
*** Yvan has quit IRC18:24
*** vnogin has joined #openstack-ansible18:25
*** octo-fs has quit IRC18:26
jrossercloudnull: have you tried your nspawn stuff with zfs?18:26
*** vnogin has quit IRC18:26
mhaydenmgariepy: ah, i ran into that lxc container stop hang today for the first time on master18:34
mgariepymhayden, yep i noticed that it wasnt fixed..18:35
mgariepyi wonder what's happening there..18:36
mhaydenso the container is doing something18:37
mhaydenbecause i get booted out over ssh18:37
mgariepyyeah,18:37
*** sxc731 has quit IRC18:37
mhaydenso journald is the only process left running in the container18:38
mgariepyI guess there is only one process left in the container18:38
mhaydenhttp://paste.openstack.org/show/628890/18:38
mgariepyis systemd-sysv installed ?18:39
mhaydenyeah18:39
mhaydeni'm stracing journald while stopping the container18:39
mhaydenall of the cgroups get cleared up, then it goes into epoll_wait18:40
mhaydenfinally gets a SIGKILL18:40
mgariepylxc try to stop the container then kill every process after 60sec.18:40
mhaydenso it umounts the root fs18:41
*** poopcat has joined #openstack-ansible18:41
mhaydenbut doesn't get to that "Reached target shutdown" part18:41
mgariepyI wonder when it changed.18:42
mgariepyand why master but not pike or ocata18:42
mgariepysomething we changed ?18:42
mhaydenno idea18:43
mhaydenthis is funky deluxe18:43
*** electrofelix has quit IRC18:43
mhaydenif i issue the poweroff inside the vm, all is well18:43
mhaydenerr inside the container18:44
*** poopcat1 has joined #openstack-ansible18:44
*** dave-mccowan has joined #openstack-ansible18:44
mhaydenand it's not specific to a certain container18:45
mhaydendoes it to repo + rabbitmq18:45
mgariepyfrom what i've seen it all the containers.18:46
*** poopcat has quit IRC18:46
*** hamza21 has joined #openstack-ansible18:48
*** germs has joined #openstack-ansible18:53
cloudnulljrosser: I've not18:53
cloudnullhopefully soon though :)18:54
*** stuartgr has quit IRC18:54
*** smatzek has quit IRC18:54
jrossercloudnull: hopefully :) our recent boxes have (almost) nothing else18:56
cloudnullThe backend should support it, it's just a matter of getting the right testing in18:58
cloudnullonce I can get the initial commit through, I'll work on that.18:58
jrosserthat would be cool. these servers are small and only have two disks, so for a mirrored setup its somewhat all or nothing one the zfs front18:59
cloudnullthe lxc implementation w/ ZFS is working wonderfully though :)19:04
odyssey4meanyone happy to give this backport another review? https://review.openstack.org/#/c/527648/119:06
cloudnullI have machinectl, zfs, and lvm all running within the same deployment, the machinectl and zfs backends have been great so far.19:06
jrossercloudnull: https://github.com/jimsalterjrs/sanoid/blob/master/README.mdƵ19:06
cloudnullodyssey4me: looking19:06
cloudnulljrosser: that's cool!19:07
cloudnullare you running that /19:08
cloudnull**?19:08
jrosserim half way through writing a role for it19:08
jrosserbeen doing that today19:08
cloudnullnice19:09
gun1xok, so, i fixed virtualization for the hosts but i still get "No valid host was found. There are not enough hosts available."19:10
cloudnullodyssey4me: trade you https://review.openstack.org/#/c/527513/  :)19:10
cloudnullgun1x: is this on an instance build?19:10
gun1xcloudnull: multiple VMs on my home desktop. 2 kvm hosts, 1 controller, 1 cinder, 1 swift19:11
gun1xi can't start the first instance19:11
cloudnullthe logs from the nova scheduler should indicate why filters it hit19:12
cloudnulland the compute node logs should should the check-ins w/ the available resources.19:12
gun1xi can grep after requiest ID19:12
cloudnull...node logs should show the...19:12
cloudnullif the flavor is larger than the reported resources and the overcommit hasn't been set to allow for whatever is hitting the over provisioning you'll get that error19:13
mhaydenmgariepy: okay, i'm getting somewhere19:14
mhaydenif i install the @Core package group, it shuts off in 2-3 seconds19:14
*** sxc731 has joined #openstack-ansible19:14
mhaydenso there's something in there that pleases lxc19:14
mgariepyok. the other day only systemd-sysv was ok for me..19:14
gun1xcloudnull: https://bpaste.net/show/5e3e4a82392e19:15
gun1xcloudnull: flavor has 1 cpu, 256 mb ram ... i have 3 cpus per host and 3 GB per host :D19:15
*** vnogin has joined #openstack-ansible19:16
mhaydenmgariepy: got meetings now -- will take a look later on19:17
mgariepyhmm19:18
mgariepydigging..19:18
*** smatzek has joined #openstack-ansible19:21
cloudnullgun1x: Binding failed for port 0cb9dc22-6891-4b0e-92ea-36f1b6b61f45, please check neutron logs for more information.19:23
cloudnullis there an issue with neutron19:24
cloudnull?19:24
gun1xoh i didn't see that19:25
*** openstackstatus has quit IRC19:27
gun1xcloudnull: there seems to be an error for the falt network i was talking about on the channel before. i will switch to vxlan19:27
cloudnulloh, did you remove the flat network type in the openstack_user_config.yml ?19:28
cloudnullthen rerun the os-neutron-playbooks to cleanup the flat network references.19:29
gun1xit failed on vxlan too19:30
gun1xosa-controller_nova_conductor_container-47c69f85/nova/nova-conductor.log:2017-12-13 21:30:02.571 195 ERROR nova.scheduler.utils [req-e4a9c39a-baa6-445b-86f8-d8484b27ec53 470153175f344be7a62d0b855abc32f7 a607ae87d705424f94f275888ac34258 - default default] [instance: 0de1b90e-3b83-4da6-b4f8-eee6a8391585] Error from last host: osa-lxd-1 (node osa-lxd-1): [u'Traceback (most recent call last):\n', u'19:31
gun1xFile "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/compute/manager.py", line 1829, in _do_build_and_run_instance\n    filter_properties)\n', u'  File "/openstack/venvs/nova-16.0.3/lib/python2.7/site-packages/nova/compute/manager.py", line 2059, in _build_and_run_instance\n    instance_uuid=instance.uuid, reason=six.text_type(e))\n', u'RescheduledException: Build of instance19:31
gun1x0de1b90e-3b83-4da6-b4f8-eee6a8391585 was re-scheduled: Binding failed for port 0388e530-1832-490b-bbb9-e2e1d3f01407, please check neutron logs for more information.\n']19:31
gun1xsame error on VXLAN19:31
cloudnullwhat does the neutron logs say?19:32
cloudnullif it's complaining about access to a flat network you'll have to correct the config things before it'll work19:32
openstackgerritDavid Wilde proposed openstack/openstack-ansible-specs master: Add spec for ELK stack in openstack-ansible  https://review.openstack.org/52776919:34
gun1xcloudnull: i will look into it19:34
cloudnulld34dh0r53: nice!19:36
d34dh0r53cloudnull: tys19:37
*** vnogin has quit IRC19:39
*** pbandark1 has joined #openstack-ansible19:44
*** pbandark has quit IRC19:45
*** pbandark1 is now known as pbandark19:45
*** Trident has joined #openstack-ansible19:47
*** Trident has quit IRC19:47
gun1xcloudnull: the error i keep getting is https://bpaste.net/show/dead21c3612119:49
gun1xfor neutron19:49
*** Trident has joined #openstack-ansible19:55
*** Trident has quit IRC19:55
*** cshen has joined #openstack-ansible19:59
*** Trident has joined #openstack-ansible20:00
mgariepymhayden, diff between master and pike: https://github.com/openstack/openstack-ansible/blob/master/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L177 https://github.com/openstack/openstack-ansible/blob/stable/pike/tests/roles/bootstrap-host/templates/user_variables.aio.yml.j2#L18220:02
*** poopcat1 is now known as poopcat20:03
openstackgerrittonytan4ever proposed openstack/openstack-ansible-tests master: Force gzip compression when file has a lot of links  https://review.openstack.org/52747820:05
*** schwicht has joined #openstack-ansible20:06
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Always template a localhost config when server  https://review.openstack.org/52775620:07
*** hybridpollo has joined #openstack-ansible20:09
*** chyka has quit IRC20:21
*** chyka has joined #openstack-ansible20:21
*** epalper has quit IRC20:22
mgariepymhayden, it's very weird, some are ok others aren't20:26
*** openstackstatus has joined #openstack-ansible20:26
*** ChanServ sets mode: +v openstackstatus20:26
mgariepyon my install I have memcach and utility container that are ""ok"" but others aren't20:27
openstackgerritMerged openstack/openstack-ansible-galera_server master: Update default paths of SSL cert files  https://review.openstack.org/52774020:31
openstackgerritJimmy McCrory proposed openstack/openstack-ansible master: Remove galera_address from playbook vars  https://review.openstack.org/52777820:34
mgariepymhayden, start: stop fast, works correctly, wait for the network to be up and then it fails.20:37
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_server master: Remove the galera_ssl_address variable  https://review.openstack.org/52777920:37
*** mattt has quit IRC20:43
*** neillc has quit IRC20:43
*** charz has quit IRC20:43
*** prometheanfire has quit IRC20:43
*** logan- has quit IRC20:43
*** tobberydberg has quit IRC20:43
*** logan- has joined #openstack-ansible20:43
*** mattt has joined #openstack-ansible20:43
*** charz has joined #openstack-ansible20:43
*** neillc has joined #openstack-ansible20:44
*** gouthamr has quit IRC20:45
*** tobberydberg has joined #openstack-ansible20:45
cloudnullgun1x: mind sharing your openstack_user_config20:52
gun1xcloudnull: i found that both my br-storage and my vxlan were on 172.29.244.0/22 ... so i reverted everything to snapshot, i am going over the network config again and starting the deployment another time20:53
cloudnullmgariepy: are you finding that the machinectl bits are slowing things down ?20:54
cloudnullgun1x: ok20:55
mgariepycloudnull, not sure.20:55
cloudnullis this related to the wheel build slowness ?20:55
mgariepyjust pointing in every direction to make mhayden work.. lol20:55
cloudnullhahaha20:55
mgariepycloudnull, nop20:55
*** sxc731 has quit IRC20:56
mgariepycloudnull, http://logs.openstack.org/33/527333/1/check/openstack-ansible-deploy-aio-centos-7/e63e213/job-output.txt.gz#_2017-12-13_15_54_17_02008820:56
mhaydenif i disable systemd-networkd, i'm good to go20:57
mhaydensystemd-networkd and the old sysv network scripts are both coming up at boot20:57
mhaydenyeah, if systemd-networkd + network are both enabled, it hangs20:58
mgariepyhmm we might want to keep systemd-networkd and trash old crufty stuff.20:58
mhaydenif only one of them are enabled, all is well20:58
cloudnullmhayden: i added that package to the lxc-hosts role a while back, https://github.com/openstack/openstack-ansible-lxc_hosts/commit/6c953712108415f9ba4bbae4a2ebd8dcea568b3220:58
mhaydenbut systemd-networkd isn't bringing up the net devices properly20:58
cloudnullmaybe that service should  just be disabled20:58
cloudnullthe hope was to get this in https://review.openstack.org/#/c/523218/20:59
mhaydeni think we've gotta pick one or the other20:59
cloudnullbut until i can work on that maybe the package should be removed / service disabled ?20:59
mgariepynew one !20:59
mhaydeneither we go full systemd, or we use the old sysv network stuff20:59
mhaydenmgariepy: well, if we use networkd, we need to change our configs20:59
mgariepygoing systemd would unify network config.20:59
cloudnull++21:00
cloudnullI have to put the suse network scripts back to make that pr pas21:00
cloudnull**pass21:00
cloudnullsadly there's no networkd in leap21:00
mhaydencloudnull: perhaps we need to revert the installation of networkd until we can hammer this out21:01
cloudnull++21:01
mgariepy++21:01
mhaydeni'll go push the button21:01
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Revert "Add the systemd-networkd to centos 7 installations"  https://review.openstack.org/52778321:02
cloudnullmhayden: mgariepy: reverted21:02
*** japestinho has quit IRC21:02
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts master: Revert "Add the systemd-networkd to centos 7 installations"  https://review.openstack.org/52778321:03
mgariepyrevert my systemd-sysv21:03
mhaydenjust bumped the commit msg21:03
mgariepyalso21:03
mhaydenmerge conflict ;)21:03
mhaydencloudnull: i'm in a mtg -- can you get networkd + systemd-sysv removed21:03
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Revert "Add the systemd-networkd to centos 7 installations"  https://review.openstack.org/52778321:04
cloudnulloh both packages need to be removed  ?21:04
mgariepyi though the systemd-sysv was needed.21:05
mgariepyhmm.21:05
mgariepywait a sec i'll test quickly21:05
openstackgerritKevin Carter (cloudnull) proposed openstack/openstack-ansible-lxc_hosts master: Revert "Add the systemd-networkd to centos 7 installations"  https://review.openstack.org/52778321:06
cloudnulldone.21:06
cloudnulloh.21:06
cloudnullhahaha21:06
cloudnullwelp we can change the pr if needed21:06
mgariepyit's fine without it.21:07
*** bndzor has quit IRC21:08
openstackgerritMarc GariĆ©py (mgariepy) proposed openstack/openstack-ansible-lxc_hosts master: Revert "Add the systemd-networkd to centos 7 installations"  https://review.openstack.org/52778321:09
*** bndzor has joined #openstack-ansible21:09
mgariepyfixed it;p21:09
*** Pingue_ has quit IRC21:09
mgariepyhave a nice evening everyone21:09
*** Pingue has joined #openstack-ansible21:10
gun1xcloudnull: this is the build i am starting:21:10
gun1xhttps://bpaste.net/show/f9afa8c2bd0b21:10
cloudnulldid we figure anything out regarding the wheel building slowness ?21:10
gun1xlast time i removed lxd flag so that i get kvm. but i want to try it out with lxd now21:10
cloudnullgun1x: I'd get rid of line 43:5121:12
cloudnullthe section for flat networks21:12
cloudnulland just make sure br-{mgmt,storage,vlan,vxlan} are on the required hosts.21:12
gun1xcloudnull: why? i want vlan ...21:13
cloudnullvlan is good flat is not21:13
gun1xcloudnull: i have a network with ip 192.168.100.0/24, dedicated for provider network ... so that i test that out too21:13
cloudnullok.21:13
gun1xcloudnull: why is flat bad?21:13
cloudnullit's not bad21:14
cloudnullit's just causes a lot of confusion21:14
gun1xwhy is it not good? :D21:14
cloudnullif you have an upstream dhcp service running you'll have conflicts21:15
cloudnullin that setup you'll need eth12 as a veth pair plugged into your br-vlan bridge21:15
gun1xcloudnull: https://bpaste.net/show/ffd4bb10165021:15
gun1xi do have dhcp on that network21:15
gun1xshould i remove dhcp and leave only gateway?21:16
openstackgerritMajor Hayden proposed openstack/openstack-ansible-lxc_hosts stable/pike: Create and use a local LXC RPM repo  https://review.openstack.org/52778621:16
cloudnulllike this https://github.com/openstack/openstack-ansible/blob/master/etc/network/interfaces.d/aio_interfaces.cfg#L44-L5921:16
cloudnullyes for the flat network to work you will need to disable dhcp and only use it for floating ip space.21:16
gun1xcloudnull: the veph pair is there on every host, for the br-vlan network21:16
cloudnullcool!21:17
gun1xcloudnull: so does it make sense to disable vlan and leave flat in this case?21:17
cloudnullvlan won't conflict21:17
*** hamza21 has quit IRC21:17
cloudnullneutron will tag all of the traffic passing through the br-vlan bridge21:17
cloudnullso all of that will be fine.21:18
*** threestrands has joined #openstack-ansible21:18
*** threestrands has quit IRC21:18
*** threestrands has joined #openstack-ansible21:18
*** smatzek has quit IRC21:20
*** smatzek has joined #openstack-ansible21:20
*** smatzek has quit IRC21:20
gun1xcloudnull: ok, than i leave vlan and disable flat, as you set21:22
gun1xso when creating a network from horizon, i have to select vlan, not flat?21:22
gun1xbtw, here is how network looks on hosts: https://bpaste.net/show/b5d8d747d46021:22
cloudnulldon't get me wrong, they can co-exist.21:22
cloudnulli've just seen folks run into issues with flat21:22
cloudnullnice!21:23
cloudnullthat looks like it'll work great21:23
*** pramodrj07 has joined #openstack-ansible21:24
gun1xok. are there differences in behaviour between lxd and kvm?21:25
*** cshen has quit IRC21:27
*** prometheanfire has joined #openstack-ansible21:31
mhaydengun1x: network behavior differences? or generally differences between the two?21:33
gun1xmhayden: differences from the point of view of the openstack user ... like, does everything work? like networks, backups, storage and so on ...21:34
mhaydeni haven't used lxd quite yet -- i'm trying to remember who put that code in...21:34
*** sep_ has joined #openstack-ansible21:36
openstackgerritMerged openstack/openstack-ansible-os_monasca-agent master: Initial OSA zuul v3 role jobs  https://review.openstack.org/52564521:37
*** sep has quit IRC21:38
gun1xmhayden: you just convinced me to use kvm instead of lxd21:40
mhaydenkvm is heavily tested ;)21:40
*** openstacking_123 has quit IRC21:43
gun1xmhayden: yea i know21:44
gun1xmhayden: but people usually want the new shiny21:44
*** openstacking_123 has joined #openstack-ansible21:44
*** openstacking_123 has quit IRC21:45
cloudnullthe only think i can think of, in terms of setup difference, is lxd will need raw images.21:46
cloudnullhttps://docs.openstack.org/openstack-ansible-os_nova/latest/#compute-driver-compatibility21:47
cloudnulland that's about all that's required to get it going21:47
openstackgerritMerged openstack/openstack-ansible-lxc_hosts master: Revert "Add the systemd-networkd to centos 7 installations"  https://review.openstack.org/52778321:48
mhaydenmaster openstack-ansible should be happy with centos + lxc now21:50
mhaydenthanks mgariepy / cloudnull21:50
prometheanfireyou mean people use centos?21:51
mhayden:|21:52
prometheanfire:D21:52
mhaydeni'm consdering putitng in some patches to set state=present for epel-release/yum-priorities21:56
mhaydenbecause it's not worth checking to see if there's a new one there21:56
cloudnullmhayden:  i think that'd be useful22:01
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Add MySQL connection SSL support  https://review.openstack.org/52779822:23
*** marst has quit IRC22:24
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Add MySQL connection SSL support  https://review.openstack.org/52779822:28
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Add MySQL connection SSL support  https://review.openstack.org/52779822:32
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Add MySQL connection SSL support  https://review.openstack.org/52779822:38
openstackgerritMerged openstack/openstack-ansible stable/pike: Reduce console output in gate jobs  https://review.openstack.org/52764822:38
openstackgerritMerged openstack/openstack-ansible stable/pike: Fix automatic log copying in Zuul runs  https://review.openstack.org/52770122:38
openstackgerritAntony Messerli proposed openstack/openstack-ansible-ops master: Allows for the VMs preseed mirror to be overridden  https://review.openstack.org/52780222:39
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Add MySQL connection SSL support  https://review.openstack.org/52779822:41
*** schwicht has quit IRC22:44
*** pmannidi has joined #openstack-ansible22:54
*** vnogin has joined #openstack-ansible22:57
openstackgerritMerged openstack/openstack-ansible master: Add networking-sfc repo to repo_packages  https://review.openstack.org/52526422:57
openstackgerritJimmy McCrory proposed openstack/openstack-ansible master: Move inventory files to folder in root of repo  https://review.openstack.org/51603223:04
*** Neptu_ has quit IRC23:11
*** CloudToko has joined #openstack-ansible23:12
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-galera_client master: Fix SSL cert distribution tasks  https://review.openstack.org/52759823:12
*** dxiri has joined #openstack-ansible23:15
*** Neptu_ has joined #openstack-ansible23:20
*** dave-mccowan has quit IRC23:23
openstackgerritMerged openstack/openstack-ansible-galera_server master: Remove the galera_ssl_address variable  https://review.openstack.org/52777923:23
*** esberglu has quit IRC23:30
gun1xguys, any reason why the keyston checksum is missing from venvs ?23:34
gun1xTASK [repo_build : Execute the venv build scripts asynchonously]23:40
gun1xthis one must be messed up. it doesn't build checksum or .tgz for keystone23:40
*** esberglu has joined #openstack-ansible23:43
*** CloudToko has quit IRC23:45
*** CloudToko has joined #openstack-ansible23:46
*** CloudToko has quit IRC23:46
*** esberglu has quit IRC23:48
gun1xok,i am stuck23:50
gun1xit seems the list of venvs gets populated here: roles/repo_build/vars/main.yml23:51
gun1xi THINK this points to roles/repo_build/tests/test-vars.yml23:51
gun1xso somewhere here keystone is missing23:51
gun1xi guess23:51
openstackgerritJimmy McCrory proposed openstack/openstack-ansible-os_keystone master: Add MySQL connection SSL support  https://review.openstack.org/52779823:54

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!