Wednesday, 2018-08-01

openstackgerritMerged openstack/openstack-ansible-tests master: Implement clouds.yaml for root user  https://review.openstack.org/58737600:02
*** cshen has joined #openstack-ansible00:14
*** mattinator has joined #openstack-ansible00:16
*** cshen has quit IRC00:17
*** mattinator has quit IRC00:21
cloudnullanyone around mind giving the passing reviews a look https://review.openstack.org/#/q/topic:common-systemd-service+(status:open+OR+status:open)00:27
*** tux_ has joined #openstack-ansible00:52
*** mattinator has joined #openstack-ansible00:54
*** mattinator has quit IRC00:58
*** mattinator has joined #openstack-ansible01:16
*** tonyontopic has joined #openstack-ansible01:20
*** mattinator has quit IRC01:21
*** mmercer has quit IRC01:36
*** gyee has quit IRC01:40
*** Sove has joined #openstack-ansible01:45
SoveWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/01:45
SoveI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/01:45
SoveRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate01:45
SoveA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/01:45
*** Sove has quit IRC01:46
*** Elwell_9 has joined #openstack-ansible01:50
*** okdas has joined #openstack-ansible01:52
okdasWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/01:52
okdasI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/01:52
okdasRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate01:52
okdasA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/01:52
*** balrog0 has joined #openstack-ansible01:53
balrog0With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/01:53
balrog0I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/01:53
balrog0Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate01:53
balrog0A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/01:53
*** johnlage18 has joined #openstack-ansible01:53
johnlage18With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/01:53
johnlage18I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/01:53
johnlage18Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate01:53
johnlage18A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/01:53
*** okdas has quit IRC01:54
*** balrog0 has quit IRC01:54
*** johnlage18 has quit IRC01:54
*** EmilienM has quit IRC01:56
*** EmilienM has joined #openstack-ansible01:57
*** tonyontopic has quit IRC01:57
mnaserso frustrating02:08
cloudnullindeed.02:15
*** mattinator has joined #openstack-ansible02:16
openstackgerritMerged openstack/openstack-ansible-os_blazar master: Convert role to use a common systemd service role  https://review.openstack.org/58711402:19
*** mattinator has quit IRC02:20
tux_cloudnull: yt?02:24
tux_cloudnull:  on Horizon dashboard my neutron-agent showing down after pike to queen upgrade  http://paste.openstack.org/show/727004/02:25
tux_Linux bridge agentneutron-linuxbridge-agent02:25
cloudnulldoes the neturon service show the agents as down ?02:30
tux_yes in container it is down02:30
* cloudnull is getting ready for bed so wont be here all that long02:30
*** rs-afk has joined #openstack-ansible02:31
rs-afkWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/02:31
tux_logs "Interface br-vlan for physical network vlan does not exist. Agent terminated!"02:31
cloudnullthe container should be down assuming you have completed the upgrade02:31
rs-afkI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/02:31
rs-afkRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate02:31
rs-afkA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/02:31
*** rs-afk has quit IRC02:31
tux_do i need that service "neutron-linuxbridge-agent" or i should stop that?02:32
tux_i thought that service is only for compute node02:32
tux_cloudnull: ^^02:32
tux_After upgrade my instance stopped getting IP address from DHCP02:32
*** ChanServ sets mode: +o cloudnull02:33
cloudnullthe os-neutron-install playbook should have deployed neutron agents onto the hosts02:34
cloudnullat the end of the upgrade script there are several cleanup-tasks that get done to migrate from the containers to the hosts02:35
cloudnulldid you run all that?02:35
tux_they its asking for br-vlan interface ?  "Interface br-vlan for physical network vlan does not exist. Agent terminated!"02:35
tux_I did run those cleanup and i got error in nova cleanup02:35
tux_but there wasn't any neutron cleanup script02:35
cloudnulldoes the host not have br-vlan ?02:36
tux_host has br-vlan02:36
tux_everything was working in pike02:36
cloudnullmaybe the interface is down ?02:36
-tux_- [root@ostack-infra-01 ~]# ethtool br-vlan02:36
-tux_- Settings for br-vlan:02:36
-tux_- Link detected: yes02:36
tux_it is up02:36
*** klx``19 has joined #openstack-ansible02:36
klx``19With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/02:37
klx``19I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/02:37
klx``19Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate02:37
klx``19A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/02:37
*** cloudnull sets mode: +b klx``19!*@*02:37
*** cloudnull sets mode: +b rs-afk!*@*02:37
cloudnulltux_ can you restart the neutron-agents on that host ?02:38
tux_container?02:38
cloudnullwhat was saying log was indicating the failure?02:39
tux_same thing happening on my LAB OSA02:39
cloudnull**what log...02:40
cloudnulland where.02:40
*** anticrisis has joined #openstack-ansible02:40
tux_http://paste.openstack.org/show/727005/02:40
tux_cloudnull: this is my logs02:40
cloudnullthat's from the host, right?02:41
cloudnull or in the container?02:42
tux_that is logs of neutron-linuxbridge-agent service running inside container02:42
-tux_- ostack-infra-01_neutron_agents_container-e67d42f3 RUNNING 1 onboot, openstack 10.0.3.152, 172.28.1.231, 172.29.5.5 -02:42
-tux_- ostack-infra-01_neutron_server_container-fbf14420 RUNNING 1 onboot, openstack 10.0.3.192, 172.28.1.160 -02:42
cloudnullon that host, is the neutron-linuxbridge-agent service presnet?02:42
openstackgerritMerged openstack/openstack-ansible-os_congress master: Convert role to use a common systemd service role  https://review.openstack.org/58719102:42
*** klx``19 has quit IRC02:43
tux_on that host no neutron-linuxbidge running02:43
tux_I have only two container neutron_agents_container & neutron_server_container02:43
tux_I am curious why do we need neutron-linuxbridge-agent on infra nodes?02:44
tux_I thought neutron-linuxbridge-agent is for compute node onlye02:44
*** anticrisis has quit IRC02:44
openstackgerritMerged openstack/openstack-ansible-os_cloudkitty master: Convert role to use a common systemd service role  https://review.openstack.org/58718702:45
cloudnullin the container, can you paste the config for linuxbridge_agent.ini.j202:46
tux_what path its located in container?02:47
cloudnulli think /etc/neutron/plugins/02:47
tux_here http://paste.openstack.org/show/727006/02:47
tux_cloudnull: ^^02:47
*** tonyontopic has joined #openstack-ansible02:48
cloudnulltux_ interesting. do your environments have any overrides in /etc/openstack_deploy/env.d02:50
tux_it was functional cluster so i doubt its issue of networking02:50
tux_i don't have anything special /etc/openstack_deploy/env.d02:51
cloudnullnothing at all ?02:51
tux_it has lots of file.. but i never touch anyone02:51
tux_it has all yml files02:52
*** mattinator has joined #openstack-ansible02:52
cloudnullany that end in .yml02:52
cloudnullor are they all .example02:52
tux_all of them .yml02:53
tux_NO .example02:53
cloudnullwhat does `ls /etc/openstack_deploy/env.d`02:53
tux_let me post02:53
tux_http://paste.openstack.org/show/727008/02:53
openstackgerritMerged openstack/openstack-ansible-os_barbican master: Convert role to use a common systemd service role  https://review.openstack.org/58710102:54
cloudnulli have a queens cloud im looking at right now and I have nofiles there.02:54
cloudnulldid the environment start out as an AIO ?02:55
cloudnullmind pasting `/etc/openstack_deploy/env.d/neutron.yml`02:55
tux_let me post02:55
cloudnullthe defailt dir is also empty https://github.com/openstack/openstack-ansible/tree/stable/queens/etc/openstack_deploy/env.d02:56
tux_http://paste.openstack.org/show/727009/02:56
cloudnullI wonder where those files came from02:56
*** mattinator has quit IRC02:57
tux_Date is July 29 same day i upgrade02:57
tux_Interesting that you don't have those files02:57
tux_what are those files?02:58
*** tonyontopic has quit IRC02:58
cloudnulleffectively those override how the environment is laid out.02:58
* cloudnull wonders if there's an upgrade task that is doing this 02:58
tux_can you post your /etc/neutron/plugins/ml2/linuxbridge_agent.ini02:59
cloudnullcan you http://paste.openstack.org/show/727011/02:59
tux_do you have that neutron-linuxbridge-agent.service running in your container ?03:00
cloudnullno. its running on the host.03:00
tux_hmmm?03:00
cloudnullwhich is a network node in my case.03:00
tux_hold.. let me understand03:00
cloudnulldo you have network_hosts defined in the openstack_user_config.yml03:01
tux_on my host ostack-infra-02   i don't have any "neutron-linuxbridge-agent.service" service running03:01
tux_cloudnull: see this http://paste.openstack.org/show/727013/03:03
openstackgerritMerged openstack/openstack-ansible-os_ceilometer master: Add systemd journal logging to the service config  https://review.openstack.org/58717003:04
tux_yes i do have network_hosts:03:04
tux_3 days ago this was functional cluster, everything was working.. :)03:04
tux_cloudnull: ^^03:04
cloudnullI'd say move those env.d files out of the way and rerun the `os-neutron-install.yml`03:05
tux_All i did upgrade pike to queens and now my instance not pinging outside and not getting IPs03:05
tux_ok let me try03:05
cloudnullthe neutron dhcp server has died.03:05
cloudnullyou could modify the linuxbridge agent ini file on the agents containers and set it to the ethXXX interface.03:06
cloudnullthen restart the agent03:06
cloudnullthat would get your instances back03:06
cloudnullthen run the playbooks.03:06
tux_what interface i need to set in container?03:06
*** lannister has joined #openstack-ansible03:07
lannisterWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/03:07
lannisterI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/03:07
lannisterRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate03:07
lannisterA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/03:07
*** cloudnull sets mode: +b lannister!*@*03:07
tux_This is list of IP in container http://paste.openstack.org/show/727014/03:07
cloudnullor better yet. run the playbooks targetting the neutron containers with the extra arg is_metal=no03:07
cloudnullopenstack-ansible os-neutron-install.yml --limit all_containers -e 'is_metal=no'03:08
tux_what will do is_metal=no?03:08
*** lannister has quit IRC03:08
tux_running it now03:08
tux_cloudnull: you are saying linuxbridge agent service should be on host machine not in container?03:10
cloudnullyes the agents should be on the hosts03:11
cloudnullwe moved them out of the containers in queens03:12
tux_wait... how that is possible ?03:12
tux_in Pike it was running in neutron_server container03:12
tux_you are saying you removed from neutron_server container to physical host machine?03:12
tux_why?03:13
tux_if that is the case then pike -> queens upgrade process is broken somewhere03:13
cloudnullneutron-server is still in a container03:15
cloudnullneutron-agent is on the host .03:15
tux_playbook failed let me post error03:15
tux_http://paste.openstack.org/show/727015/03:16
tux_if you are saying neutron-agent is on host then why do i have container "ostack-infra-02_neutron_agents_container-efee3d96 RUNNING 1         onboot, openstack 10.0.3.50, 172.28.1.163, 172.29.6.228 -"03:16
*** mattinator has joined #openstack-ansible03:16
cloudnullI believe its because of those env.d files03:17
cloudnullthe container should still exist03:17
tux_i have moved all env.d files03:18
cloudnulljust run the playbook normally03:18
cloudnullsee if that is successful03:19
tux_ok03:19
tux_openstack-ansible os-neutron-install.yml03:19
tux_can you post me your lxc-ls -f03:19
tux_i want to compare with mine03:19
tux_on my host machine i don't have any neutron agent running yet03:20
tux_[root@ostack-infra-02 ~]# systemctl | grep neutron03:20
*** mattinator has quit IRC03:21
tux_again it failed same place "FAILED - RETRYING: Ensure neutron service (5 retries left)."03:21
-tux_- TASK [os_neutron : Ensure neutron service] ******************************************************************************************************************************************03:21
-tux_- Tuesday 31 July 2018 23:20:52 -0400 (0:00:00.873) 0:01:15.310 **********03:21
-tux_- FAILED - RETRYING: Ensure neutron service (5 retries left).03:21
tux_what this playbook trying to do "Ensure neutron service" what ensuring it?03:22
tux_i have check on container service is running neutron-server.service - neutron openstack service03:23
cloudnullhere is my container list03:23
cloudnullhttp://paste.openstack.org/show/727016/03:23
cloudnullmaybe something else is going on in the environment that's trying to talk to keystone03:23
tux_you don't have agent container03:23
tux_you have only 1 container "infra1_neutron_server_container-e4358ee5 container systemd-nspawn"03:24
tux_I have 2 container03:24
cloudnullcorrect03:24
-tux_- ostack-infra-01_neutron_agents_container-e67d42f3 RUNNING 1 onboot, openstack 10.0.3.152, 172.28.1.231, 172.29.5.5 -03:24
-tux_- ostack-infra-01_neutron_server_container-fbf14420 RUNNING 1 onboot, openstack 10.0.3.192, 172.28.1.160 -03:24
tux_see03:24
tux_that is very odd03:25
tux_something is broken in upgrade03:27
tux_but interesting thing.. after queens migration i did perform live-migration etc03:28
tux_crap!! i was happy with pike and now i stuck in queens :)03:30
tux_my customer waiting for cluster to load application and now i have to fix it ASAP03:31
tux_cloudnull: yt?03:34
tux_are you looking or going to get some sleep :)03:34
* cloudnull looking to go to sleep 03:35
cloudnullso running `openstack-ansible os-neutron-install.yml`  is failing?03:35
tux_yes03:35
*** RoBz4 has joined #openstack-ansible03:35
tux_here http://paste.openstack.org/show/727015/03:35
RoBz4With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/03:36
RoBz4I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/03:36
RoBz4Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate03:36
RoBz4A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/03:36
tux_if you feeling sleepy then lets work on this tomorrow with more eyeballs03:36
tux_i am going to open BUG so people can see it03:36
*** RoBz4 has quit IRC03:36
tux_cloudnull: now its failing here http://paste.openstack.org/show/727017/03:37
tux_I have enabled no_log: False03:38
tux_running with -vvv to see03:38
cloudnullseems like that's an auth failure03:38
cloudnulla 40103:38
tux_i did changed my admin password of horizon03:39
tux_does that related to that?03:39
cloudnullyes if you changed the admin pw you have to update that in the user_secrets file03:40
tux_crap!!03:40
cloudnullthat would explain the 40103:40
tux_let me revert my admin password back03:40
tux_do you want me to run normal playbook ? or with no_metal?03:42
tux_cloudnull: ^^03:42
cloudnulljust rerun the playbook to see if that goes with the pw reverted03:43
tux_ok03:43
tux_running with openstack-ansible os-neutron-install.yml03:43
*** prasen has quit IRC03:46
tux_you think that playbook will install agent on host machine right?03:46
*** udesale has joined #openstack-ansible03:46
tux_then we have to delete neutron_agent container03:47
cloudnullit should do both, however at a minimum it should update the neutron agents in the containers03:49
*** Corvus`11 has joined #openstack-ansible03:49
Corvus`11With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/03:49
Corvus`11I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/03:49
Corvus`11Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate03:49
Corvus`11A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/03:49
*** cloudnull sets mode: +b Corvus`11!*@*03:49
tux_playbook ran successful03:49
tux_on host machine no agent03:50
-tux_- [root@ostack-infra-02 ~]# systemctl | grep agent03:50
-tux_- [root@ostack-infra-02 ~]#03:50
-tux_- [root@ostack-infra-02 ~]# systemctl | grep neutron03:50
-tux_- [root@ostack-infra-02 ~]#03:50
*** Corvus`11 has quit IRC03:50
*** aruns__ has joined #openstack-ansible03:50
cloudnulldoes the container have the proper config ?03:50
tux_checking03:51
cloudnulldoes it still have the br-vlan in config ?03:51
cloudnullif so rerun the playbook with the extra options and limits03:51
cloudnullthat should at least get you back onlin e03:52
tux_still "physical_interface_mappings = vlan:br-vlan"03:52
cloudnulland we can figure out how to get it stable.03:52
tux_tell me how can i fix by hand?03:52
tux_i need to fix this "vlan:br-vlan" and put ethXXX here?03:52
cloudnullif you run with the extra args and limit it should correct that03:53
tux_no_meta=  ?03:53
tux_openstack-ansible os-neutron-install.yml --limit all_containers -e 'is_metal=no'   you want me run this?03:54
cloudnullyes.03:54
tux_ok doing it03:54
tux_Why we decided to put neutron-agent on metal ? any specific reason ?03:58
cloudnullyes. there were quite a few issues.03:59
tux_hmm03:59
cloudnullthe main one was that all of the kenel modules had to be mounted into the container.03:59
cloudnulland the container could make changes on the hosts outside of the typical apparmor constraints.03:59
tux_oh!04:00
cloudnulladditionally our other container tech, nspawn, was not able to run the agents in containers due to the above issues being prohibited04:00
cloudnullthere were a few usability issues too04:01
tux_playbook completed04:01
cloudnullespecially when l3 is in use04:01
tux_and nothing installed on host machine04:01
cloudnullnothing changed?04:01
cloudnullthat limited command should only target containers.04:01
-tux_- [root@ostack-infra-02 ~]# systemctl | grep neutron04:01
-tux_- [root@ostack-infra-02 ~]#04:01
tux_yes nothing changed04:01
tux_i am not seeing any neutron service on host machine04:02
cloudnullcan you log into the container and check the config04:02
tux_ok04:02
cloudnullthat command should just get you back to operational state.04:02
tux_ /etc/neutron/plugins/ml2/linuxbridge_agent.ini04:02
tux_still pointing physical_interface_mappings = vlan:br-vlan04:03
cloudnull:\04:03
cloudnullok. maybe remove the old containers from inventory and rerun the playbook to see if it corrects the agent issue04:04
tux_if i want to make manual change here "physical_interface_mappings = vlan:br-vlan"04:04
cloudnullyou can make a copy of inventory just in case.04:04
cloudnullyea you just need to figure out what ethXXX maps to br-vlan04:05
tux_you want me to destroy container ?04:05
cloudnullno.04:05
tux_and re-run04:05
tux_ok doing it now04:05
*** vnogin has joined #openstack-ansible04:05
tux_doing it on only single infra node04:05
tux_if it work then will do everywhere04:05
cloudnullcopy the inventory to the home dir, remove the agents containers from inventory, then rerun os-neutron-install04:06
tux_i did copy inventory04:06
tux_why do i need to remove from inventory ?04:07
tux_can't just destroy on host and re-run?04:07
*** mattinator has joined #openstack-ansible04:07
*** poopcat has quit IRC04:07
cloudnullsomething like04:08
cloudnullcp /etc/openstack_deploy/openstack_inventory.json ~/04:08
cloudnullcd /opt/openstack-ansible/playbooks04:08
cloudnullopenstack-ansible os-neutron-install.yml04:08
cloudnullsorry04:08
cloudnull# cp /etc/openstack_deploy/openstack_inventory.json ~/04:08
cloudnull# /opt/openstack-ansible/scripts/inventory-manage.py -l | grep neutron_agent04:08
cloudnull# /opt/openstack-ansible/scripts/inventory-manage.py -r $NAMES04:08
cloudnull# cd /opt/openstack-ansible/playbooks04:08
cloudnull# openstack-ansible os-neutron-install.yml04:08
* cloudnull was lazy and didn't use a pastebin04:08
tux_ok let me try04:08
*** vnogin has quit IRC04:09
tux_running playbook now04:09
tux_do you want me destroy container or its ok?04:09
tux_cloudnull: ^^04:10
cloudnullno leave it for now04:10
tux_k04:10
tux_running...04:10
cloudnullinventory-manage.py -l | grep neutron_agent should return a list of container names which you'll use with the `inventory-manage.py -r`. that will cleanly purge the container name from inventory04:11
*** mattinator has quit IRC04:12
cloudnullthe hope is that purging the old container names from inventory will get neutron installed on the hosts04:13
cloudnullbut we need to figure out what is causing that04:13
tux_its different output04:13
tux_http://paste.openstack.org/show/727019/04:13
tux_what is "neutron_sriov_nic_agent"04:14
tux_i have never seen that before04:14
tux_cloudnull: ^^04:14
cloudnullone of the many reasons to move neutron agents to the hostss.04:14
cloudnullbut its just a compontent name04:14
tux_ok04:14
cloudnullthe table takes the last component name when it shoes the info04:15
tux_got error in playbook http://paste.openstack.org/show/727020/04:15
tux_oh crap!!!04:15
tux_shit i need to fix this04:15
tux_my /root is smaller so i have created symlink to /openstack -> /var/openstack04:16
*** mattinator has joined #openstack-ansible04:16
tux_should i create hardlink instead of symlink here?04:17
cloudnulla hard link should work, or a bind mount04:17
tux_do you have syntax ?04:17
tux_otherwise i will google it.. its been long time i did that04:17
cloudnullsomething like `mount -o bind /var/openstack /openstack`04:19
tux_let me try04:19
cloudnullremove the symlink, make the dir, run the bind mount04:19
tux_can i just do ln /var/openstack /openstack ?04:19
tux_just hardlink not mount ?04:19
cloudnullsure04:20
tux_lets try easy way04:20
tux_hold on04:20
tux_carp!!! ln: ‘/var/openstack’: hard link not allowed for directory04:20
cloudnullwell. a hardlink wont work outside the filesysstem04:20
tux_let me do mount04:20
*** mattinator has quit IRC04:21
tux_mount -o bind /var/openstack /openstack  works look like04:21
tux_going to do on all 3 node and then running playbook04:21
*** gsdg has joined #openstack-ansible04:22
tux_running playbook04:22
*** gsdg has quit IRC04:22
tux_do i need to add "mount -o bind /var/openstack /openstack" in /etc/fstab ?04:22
cloudnullyou will04:23
tux_next time reboot preserve it04:23
cloudnull++04:23
tux_will do that latr04:23
tux_still playbook running04:26
tux_look like its installing bunch of stuff on infra* nodes04:27
tux_cloudnull: is that good thing?04:27
cloudnullyes04:28
cloudnullthat's good news04:28
tux_i can see it created /etc/neutron directory and dumping files..04:28
tux_http://paste.openstack.org/show/727023/04:30
tux_cloudnull: ^^ look like it install agent on infra* host04:30
tux_and its running04:30
cloudnullthats progress04:31
tux_where are my "ip netns"04:31
tux_i lost all my namespace ?04:31
cloudnullthey should all be recreated when the agents move to the active nodes.04:31
cloudnulldid the playbook complete04:31
cloudnull?04:31
tux_playbook finished successfully04:31
cloudnullok.04:31
*** gregoryo has joined #openstack-ansible04:32
tux_all neutron_agents running fine...04:32
tux_i can't see ip netns04:32
tux_do i need to restart neutron server ?04:32
tux_how that will get re-created04:33
cloudnullin the neutron server running?04:33
tux_let me check04:33
tux_i think its running but let me see04:33
tux_i have still "ostack-infra-02_neutron_agents_container-efee3d96" running04:34
cloudnullstop the old neutron-agent containers04:34
tux_i think we should destroy this04:34
tux_otherwise it will create duplicate issue04:34
tux_let me stop it first04:34
cloudnulljust stop them across the board04:34
cloudnullthe neutron-server containers should be all good04:35
tux_doing it...04:35
tux_now going to restart neutron server04:35
*** Guest38978 has quit IRC04:36
tux_still i am not seeing any ip netns list04:37
cloudnullok, i gotta go get some sleep04:37
tux_cloudnull: sure i will see what i can do04:37
tux_cloudnull: Thanks for the help again...04:37
cloudnullcan you restart one of your vms04:37
tux_let me do that04:37
cloudnullok, ttys gotta go04:38
tux_as soon as i restart "systemctl restart neutron-dhcp-agent.service" it works04:39
tux_cloudnull: i think i am all set :)04:39
cloudnullah good !04:39
tux_cloudnull: Thanks again man!! to stay this long...04:39
cloudnullsomething we should look into for the general upgrade04:39
tux_cloudnull: appreciated04:39
cloudnullidk what caused that04:39
tux_yup! need good document i think04:39
*** seba has joined #openstack-ansible04:39
tux_i can ping now :)04:42
-tux_- [root@ops ~]# ping 10.31.1.704:42
-tux_- PING 10.31.1.7 (10.31.1.7) 56(84) bytes of data.04:42
-tux_- 64 bytes from 10.31.1.7: icmp_seq=1 ttl=62 time=1654 ms04:42
-tux_- 64 bytes from 10.31.1.7: icmp_seq=2 ttl=62 time=655 ms04:42
tux_Great!!!! i am alive now :)04:42
tux_cloudnull: you are awesome!! it was wonderful learning with you!!!04:42
tux_cloudnull: good night04:42
*** Lumpi18 has joined #openstack-ansible04:58
openstackgerritCorey Wright proposed openstack/openstack-ansible-haproxy_server master: Allow rsyslog to log HAProxy locally  https://review.openstack.org/58768704:58
*** Lumpi18 has quit IRC04:58
*** mrkirby15326 has joined #openstack-ansible05:03
mrkirby15326With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/05:03
mrkirby15326I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/05:03
mrkirby15326Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate05:03
mrkirby15326A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/05:03
*** mrkirby15326 has quit IRC05:04
*** Raito_Bezarius19 has joined #openstack-ansible05:06
Raito_Bezarius19With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/05:06
Raito_Bezarius19I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/05:07
Raito_Bezarius19Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate05:07
Raito_Bezarius19A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/05:07
*** Lord_of_Life20 has joined #openstack-ansible05:07
Lord_of_Life20With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/05:07
Lord_of_Life20I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/05:07
Lord_of_Life20Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate05:07
Lord_of_Life20A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/05:07
*** Lord_of_Life20 has quit IRC05:07
*** mattinator has joined #openstack-ansible05:11
*** Raito_Bezarius19 has quit IRC05:13
*** mattinator has quit IRC05:15
*** mattinator has joined #openstack-ansible05:16
*** mattinator has quit IRC05:21
*** pradiprwt has joined #openstack-ansible05:21
pradiprwtHi Everyone, I am getting issue while installing pike version, >> fatal: [infra1_repo_container-80179ef4]: FAILED! => {"attempts": 5, "changed": false, "failed": true, "msg": "failed to create temporary content file: [Errno 104] Connection reset by peer"}05:22
pradiprwtcan anyone please suggest me what I am missing here05:23
*** cshen has joined #openstack-ansible05:23
*** cshen has quit IRC05:28
*** VampiricPadraig has joined #openstack-ansible05:29
VampiricPadraigWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/05:29
VampiricPadraigI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/05:29
VampiricPadraigRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate05:29
VampiricPadraigA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/05:29
*** VampiricPadraig has quit IRC05:30
*** tux_ has quit IRC05:31
*** We has joined #openstack-ansible05:38
WeWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/05:38
WeI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/05:38
*** We has quit IRC05:38
*** ecks25 has joined #openstack-ansible05:40
*** ecks25 has quit IRC05:40
*** yolanda has joined #openstack-ansible05:48
*** Strog17 has joined #openstack-ansible05:48
Strog17With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/05:48
Strog17I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/05:48
*** Strog17 has quit IRC05:48
*** gvrangan has joined #openstack-ansible05:53
*** Atlas4 has joined #openstack-ansible05:55
Atlas4With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/05:55
Atlas4I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/05:55
Atlas4Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate05:55
Atlas4A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/05:55
*** Atlas4 has quit IRC05:56
*** udesale has quit IRC06:00
*** udesale has joined #openstack-ansible06:00
*** Checking has joined #openstack-ansible06:00
*** Checking has quit IRC06:00
*** madorn has quit IRC06:02
*** madorn has joined #openstack-ansible06:04
*** mattinator has joined #openstack-ansible06:16
*** mattinator has quit IRC06:21
*** aruns__ has quit IRC06:22
*** shyamb has joined #openstack-ansible06:28
openstackgerritMaksim Malchuk proposed openstack/openstack-ansible master: Use standard env variables for the AIO bootstrap  https://review.openstack.org/57765206:28
*** tnogisto has quit IRC06:32
shyamb#openstack-meeting-406:32
shyambsorry06:33
*** Jacob84317 has joined #openstack-ansible06:35
Jacob84317With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/06:35
Jacob84317I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/06:35
Jacob84317Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate06:35
Jacob84317A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/06:35
*** Jacob84317 has quit IRC06:36
openstackgerritwangqi proposed openstack/openstack-ansible-lxc_hosts master: Add the project source code repository in README  https://review.openstack.org/58703006:38
*** pcaruana has joined #openstack-ansible06:42
*** aruns__ has joined #openstack-ansible06:43
*** priteau has joined #openstack-ansible06:45
*** Dan_Bennett has joined #openstack-ansible06:49
Dan_BennettWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/06:49
Dan_BennettI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/06:49
Dan_BennettRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate06:49
Dan_BennettA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/06:49
*** Dan_Bennett has quit IRC06:50
*** brykr0 has joined #openstack-ansible06:51
brykr0With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/06:51
brykr0I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/06:51
brykr0Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate06:51
brykr0A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/06:51
openstackgerritMaksim Malchuk proposed openstack/openstack-ansible stable/queens: Use standard env variables for the AIO bootstrap  https://review.openstack.org/57765306:51
*** mattinator has joined #openstack-ansible06:52
*** brykr0 has quit IRC06:52
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Install virtualenv vor CentOS via distro packages  https://review.openstack.org/58763706:54
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Remove unused openstack_host_use_distro_pip var  https://review.openstack.org/58763506:56
*** mattinator has quit IRC06:56
*** cshen has joined #openstack-ansible06:58
*** shyamb has quit IRC07:02
*** mattinator has joined #openstack-ansible07:02
*** shyamb has joined #openstack-ansible07:03
*** priteau has quit IRC07:04
*** mattinator has quit IRC07:07
*** epalper has joined #openstack-ansible07:09
*** Croepha3 has joined #openstack-ansible07:10
Croepha3With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/07:11
Croepha3I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/07:11
Croepha3Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate07:11
Croepha3A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/07:11
*** Croepha3 has quit IRC07:12
*** wodencafe13 has joined #openstack-ansible07:17
wodencafe13With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/07:17
wodencafe13I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/07:17
wodencafe13Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate07:17
wodencafe13A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/07:17
*** wodencafe13 has quit IRC07:17
jrossermorning o/07:18
pradiprwtIs anyone aware of this issue? http://paste.openstack.org/show/727041/07:23
*** rpittau has quit IRC07:24
pradiprwtI am trying to install openstack pike with 3 nodes >> 1 controller 2 compute07:24
*** threestrands has quit IRC07:26
*** gillesMo has joined #openstack-ansible07:34
*** tosky has joined #openstack-ansible07:39
*** junction00 has joined #openstack-ansible07:46
junction00With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/07:46
junction00I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/07:46
junction00Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate07:46
junction00A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/07:46
*** junction00 has quit IRC07:48
*** shyamb has quit IRC07:49
openstackgerritMerged openstack/openstack-ansible-os_designate master: Disable functional tests temporarily  https://review.openstack.org/58764507:49
openstackgerritMerged openstack/openstack-ansible-os_designate master: Default MQ RPC/Notify credentials/vhosts to match  https://review.openstack.org/58702007:49
*** DanyC has joined #openstack-ansible07:52
openstackgerritMerged openstack/openstack-ansible-os_designate master: Remove unnecessary MQ vhost/user creation tasks/vars  https://review.openstack.org/58653207:55
openstackgerritMerged openstack/openstack-ansible-os_designate master: Move handler flush to after MQ setup  https://review.openstack.org/58709707:55
*** shyamb has joined #openstack-ansible07:56
*** hachi has joined #openstack-ansible07:57
jrosserthis looks odd https://github.com/openstack/openstack-ansible/blob/master/scripts/scripts-library.sh#L13607:58
jrossershould that be find_log_files ?07:58
odyssey4memorning07:59
odyssey4mejrosser: perhaps, that's odd - how are we getting log files without it08:00
odyssey4meoh, that just does the rename/compression08:01
jrosserhttp://logs.openstack.org/07/586607/3/check/openstack-ansible-deploy-aio_lxc-ubuntu-bionic/382ce0b/job-output.txt.gz#_2018-07-31_17_11_04_25247708:01
jrosserand therefore no log files08:01
evrardjpI am tired of these spammers, should I ask for +r ?08:02
odyssey4megood find jrosser - please fix!08:02
odyssey4meevrardjp: +r ?08:02
evrardjpit's taking too much of screen estate08:02
evrardjpodyssey4me: only registered users can talk08:02
jrosserok will do - there is find_files in the tests repo which is probably how this happened08:02
odyssey4meyeah, maybe that's a good idea08:03
evrardjpit increases the barrier of entry08:03
odyssey4mejrosser: ah yes, 'cos that was a copy/paste so I clearly got it wrong when adjusting it08:03
odyssey4meevrardjp: well, either that or they need to update their kill pattern08:03
evrardjpbut I am fine with this -- we are becoming a help channel, minimum thing ppl can do is at least register for us, no?08:03
odyssey4menot sure if we need to perhaps ask on the ML?08:04
evrardjpI am asking and will inform on the ML08:05
*** vnogin has joined #openstack-ansible08:05
evrardjpwe can revert if that's a problem08:05
hakonwWell the bots are spamming the same old thing, so an easy filter to kick people saying that?08:06
odyssey4mehakonw: that's already been done by the admins, but they keep changing the pattern ever so slightly08:06
odyssey4mejrosser: FYI I'm figuring out what's gone wrong with the octavia patches for the MQ task moves - I should have a patch for it some time soon08:07
odyssey4methat'll unblock the bionic stuff08:07
*** vnogin has quit IRC08:10
jrosserodyssey4me: cool thanks08:10
evrardjphakonw: there is a thread on the ML for the explanation08:11
*** priteau has joined #openstack-ansible08:11
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Fix gate log collection  https://review.openstack.org/58770808:13
*** shyamb has quit IRC08:14
*** xfil has joined #openstack-ansible08:14
xfilWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/08:14
xfilI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/08:14
xfilRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate08:14
xfilA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/08:15
*** xfil has quit IRC08:16
*** A5A has joined #openstack-ansible08:16
A5AWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/08:16
A5AI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/08:16
A5ARead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate08:16
A5AA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/08:17
*** A5A has quit IRC08:18
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-tests master: Collect netplan config  https://review.openstack.org/58770908:19
*** DanyC has left #openstack-ansible08:19
*** electrofelix has joined #openstack-ansible08:25
*** aruns__ has quit IRC08:25
*** gvrangan has quit IRC08:25
prometheanfireevrardjp: ty, did the same for reqs08:27
evrardjpprometheanfire: we'll see how it goes08:28
evrardjpI don't think it hurts that much for OSA and requirements, for different reasons08:28
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_designate master: Use generic vars file for ubuntu  https://review.openstack.org/58669108:28
openstackgerritMerged openstack/openstack-ansible-os_nova stable/ocata: Map instances to cell_v2 only once.  https://review.openstack.org/58515808:29
prometheanfireevrardjp: I think it hurts osa more than reqs, as people sometimes come here for support08:31
odyssey4meevrardjp: oh boo, looks like having virtualenv installed via package is breaking centos: http://logs.openstack.org/46/587646/1/gate/openstack-ansible-functional-centos-7/daa7207/job-output.txt.gz#_2018-08-01_07_58_51_62953208:31
prometheanfirebut not too much to ask to register08:31
prometheanfireodyssey4me: :( that's the start of the encapsulation train08:31
odyssey4methat's only happening because pip isn't installed08:32
evrardjpprometheanfire: exactly, that's what I wrote on the email08:32
evrardjpodyssey4me: weird08:32
evrardjpit shouldn't08:32
evrardjpI have tested this on my machine08:32
evrardjpinstalling virtualenv without pip works on centos08:33
odyssey4meyes, that installs fine, but because pip isn't there, pip_install is trying to install pip08:33
evrardjpafter that some things might require pip and not pass through venv, and that's a problem we need to solve08:33
*** vnogin has joined #openstack-ansible08:33
evrardjpbut because we removed all the pip packages to install on the host, it should be fine, no?08:33
odyssey4meyeah, should we just revert that one now to unblock gates - then take the time to look into figuring out whether we can now be rid of using pip_install08:34
evrardjpodyssey4me: fine for me08:35
prometheanfiretracker bug for the revert (unless you are activly working on it)?08:35
prometheanfireevrardjp: you going to the ptg?08:35
evrardjpprometheanfire: I am08:36
prometheanfireI think I asked that08:36
prometheanfirenice08:36
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_swift master: Move centos tests to voting  https://review.openstack.org/58771208:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Revert "Install virtualenv vor CentOS via distro packages"  https://review.openstack.org/58771308:36
odyssey4meevrardjp jrosser ^08:36
*** vnogin has quit IRC08:37
*** vnogin has joined #openstack-ansible08:37
*** ivve has quit IRC08:40
pradiprwtHi evrardjp, can you please help me to solve this issue http://paste.openstack.org/show/727041/, first time I am getting this kind of issue08:40
*** gvrangan has joined #openstack-ansible08:41
*** indistylo has joined #openstack-ansible08:44
openstackgerritMerged openstack/openstack-ansible-os_designate master: Use generic vars file for ubuntu  https://review.openstack.org/58669108:46
*** udesale has quit IRC08:47
*** udesale has joined #openstack-ansible08:47
*** udesale has quit IRC08:47
*** udesale has joined #openstack-ansible08:48
pradiprwtThis is verbose enabled output >> http://paste.openstack.org/show/727033/08:49
*** pmannidi has quit IRC08:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer master: Remove python-keystoneclient package install  https://review.openstack.org/58771908:50
*** jwitko_ has quit IRC08:50
*** udesale has quit IRC08:50
openstackgerritJean-Philippe Evrard proposed openstack/openstack-ansible master: [WIP] Do no use tempest  https://review.openstack.org/58754408:51
*** udesale has joined #openstack-ansible08:51
*** skyscraper has quit IRC08:52
*** sm806 has quit IRC08:52
*** ivve has joined #openstack-ansible08:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Remove python-keystoneclient package install  https://review.openstack.org/58772208:54
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Remove python-keystoneclient package install  https://review.openstack.org/58772408:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat master: Remove python-keystoneclient package install  https://review.openstack.org/58772508:56
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_ironic master: Switch to using project-templates  https://review.openstack.org/58681508:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_ceilometer master: Remove python-keystoneclient package install  https://review.openstack.org/58771908:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_cinder master: Remove python-keystoneclient package install  https://review.openstack.org/58772208:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_glance master: Remove python-keystoneclient package install  https://review.openstack.org/58772408:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_heat master: Remove python-keystoneclient package install  https://review.openstack.org/58772508:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Remove python-keystoneclient package install  https://review.openstack.org/58772808:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Use generic vars file for ubuntu  https://review.openstack.org/58772909:00
*** vnogin has quit IRC09:00
*** sm806 has joined #openstack-ansible09:01
*** skyscraper has joined #openstack-ansible09:01
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_swift master: Remove python-keystoneclient package install  https://review.openstack.org/58773009:03
*** vnogin has joined #openstack-ansible09:03
*** fractal has joined #openstack-ansible09:03
fractalWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/09:03
fractalI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/09:03
fractalRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate09:03
fractalA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/09:03
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Revert "Install virtualenv vor CentOS via distro packages"  https://review.openstack.org/58771309:06
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_nova master: Remove python-keystoneclient package install  https://review.openstack.org/58773309:07
*** gregoryo has quit IRC09:07
*** fractal has quit IRC09:09
*** thejoecarroll4 has joined #openstack-ansible09:17
thejoecarroll4With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/09:17
thejoecarroll4I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/09:17
thejoecarroll4Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate09:17
thejoecarroll4A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/09:17
*** thejoecarroll4 has quit IRC09:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Move MQ vhost/user creation into role  https://review.openstack.org/58338809:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Clean up test override vars  https://review.openstack.org/58704609:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Clarify the octavia-neutron event stream config options  https://review.openstack.org/58714009:26
openstackgerritJonathan Rosser proposed openstack/openstack-ansible-os_ironic master: Switch to using project-templates  https://review.openstack.org/58681509:26
*** vnogin_ has joined #openstack-ansible09:27
*** madorn has quit IRC09:28
*** johanssone has quit IRC09:28
*** dweaver has quit IRC09:28
*** dweaver has joined #openstack-ansible09:28
*** vnogin has quit IRC09:28
*** antonym has quit IRC09:28
*** johanssone has joined #openstack-ansible09:28
*** ianw has quit IRC09:29
*** ianw has joined #openstack-ansible09:29
*** antonym has joined #openstack-ansible09:29
*** antonym has quit IRC09:30
*** antonym has joined #openstack-ansible09:30
*** madorn has joined #openstack-ansible09:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Correct group names for services  https://review.openstack.org/58773909:31
odyssey4methat took a bit of head scratching09:32
*** aruns has joined #openstack-ansible09:32
*** indistylo has quit IRC09:34
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58232409:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Reduce testing tech debt  https://review.openstack.org/58266809:40
*** dimi34ka23 has joined #openstack-ansible09:42
*** dimi34ka23 has quit IRC09:42
odyssey4memnaser: it looks like trying to run smoke tests brings with it a new problem: http://logs.openstack.org/17/587617/1/experimental/openstack-ansible-integrated-deploy-aio/6cf585f/logs/ara-report/result/fcb830e8-6444-4401-b897-a55528257eec/09:44
odyssey4meperhaps soething that can be fixed relatively easily, I'm not really familiar with what's needed there09:45
*** Guest44836 has joined #openstack-ansible09:53
Guest44836With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/09:53
Guest44836I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/09:53
Guest44836Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate09:53
Guest44836A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/09:53
*** Guest44836 has quit IRC09:54
kaiokmomorning10:00
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Use generic vars file for ubuntu  https://review.openstack.org/58772910:04
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Remove python-keystoneclient package install  https://review.openstack.org/58772810:16
*** jiteka has quit IRC10:22
*** jiteka has joined #openstack-ansible10:22
*** jiteka- has quit IRC10:22
*** jiteka| has joined #openstack-ansible10:22
*** aruns has quit IRC10:31
jrosserodyssey4me: i think theres a whole second round of generic vars for ubuntu to do10:34
odyssey4mejrosser: yeah, there were some merges which added a new set of vars files that are the same, so that's likely10:35
odyssey4mesimilar to https://review.openstack.org/58772910:35
odyssey4menot many though10:36
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_tempest master: Use generic vars file for ubuntu  https://review.openstack.org/58775510:37
*** Nothing4You14 has joined #openstack-ansible10:37
Nothing4You14With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/10:37
Nothing4You14I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/10:37
Nothing4You14Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate10:37
*** suim4 has joined #openstack-ansible10:37
Nothing4You14A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/10:37
suim4With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/10:37
suim4I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/10:38
suim4Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate10:38
suim4A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/10:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_container_create master: Use generic vars file for ubuntu  https://review.openstack.org/58775610:38
*** Nothing4You14 has quit IRC10:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_container_create master: Use generic vars file for ubuntu  https://review.openstack.org/58775710:38
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-ceph_client master: Use generic vars file for ubuntu  https://review.openstack.org/58775810:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_zun master: Use generic vars file for ubuntu  https://review.openstack.org/58775910:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-galera_client master: Use generic vars file for ubuntu  https://review.openstack.org/58776010:39
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-nspawn_hosts master: Use generic vars file for ubuntu  https://review.openstack.org/58776110:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-repo_build master: Use generic vars file for ubuntu  https://review.openstack.org/58776310:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-lxc_hosts master: Use generic vars file for ubuntu  https://review.openstack.org/58776410:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-rabbitmq_server master: Use generic vars file for ubuntu  https://review.openstack.org/58776510:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Use generic vars file for ubuntu  https://review.openstack.org/58776610:41
odyssey4methere we go, that takes care of those10:41
*** israfel has joined #openstack-ansible10:41
israfelWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/10:41
israfelI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/10:41
israfelRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate10:41
israfelA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/10:41
*** suim4 has quit IRC10:43
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Move MQ vhost/user creation into role  https://review.openstack.org/58338810:45
*** israfel has quit IRC10:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate master: Revert "Disable functional tests temporarily"  https://review.openstack.org/58764610:53
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate master: Convert role to use a common systemd service role  https://review.openstack.org/58719610:53
*** indistylo has joined #openstack-ansible10:57
*** udesale has quit IRC10:57
*** udesale has joined #openstack-ansible10:57
*** vnogin_ has quit IRC11:00
*** hachi has quit IRC11:06
*** ThomasWhite has joined #openstack-ansible11:11
jrosserodyssey4me: some roles have bionic in the meta/main.yml already, but theres inconsistency11:11
*** cshen_ has joined #openstack-ansible11:11
jrosserdo we prefre to list them in release order or alphabetically?11:12
odyssey4meI would guess release order?11:12
*** cshen has quit IRC11:13
odyssey4mejrosser: to prevent a merges based on a known set of patches which still need to merge, you can use the syntax11:13
odyssey4meDepends-On: https://review.openstack.org/<review number>11:14
odyssey4mein the commit message11:14
odyssey4meyou can use that for https://review.openstack.org/#/c/587478/11:14
*** vnogin has joined #openstack-ansible11:14
odyssey4meyou can do multiple Depends-On lines for more than one patch11:14
jrosseryeah, that would have been a dozen or so11:14
*** threestrands has joined #openstack-ansible11:15
*** savvas has quit IRC11:15
*** savvas has joined #openstack-ansible11:16
*** zenirc369 has joined #openstack-ansible11:20
odyssey4meit looks like lxc_hosts and lxc_container_create have differing ubuntu vars files, so leaving those as-is11:20
*** hachi has joined #openstack-ansible11:21
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Remove python-keystoneclient package install  https://review.openstack.org/58772811:21
*** ansmith has quit IRC11:22
odyssey4mejrosser: mind looking at these? https://review.openstack.org/587588 & https://review.openstack.org/58758711:23
odyssey4mehttps://review.openstack.org/58773311:24
jrosserlooking11:24
*** udesale has quit IRC11:26
jrosserodyssey4me: done11:29
odyssey4metyvm11:30
odyssey4meevrardjp if you have a moment, https://goo.gl/k9cCfF would help move the bionic work along nicely11:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_molteniron master: Move playbooks/config files into role examples  https://review.openstack.org/58758711:31
odyssey4mejrosser: ^ done11:31
*** rpittau has joined #openstack-ansible11:33
*** manish27 has joined #openstack-ansible11:39
manish27With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/11:39
manish27I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/11:39
manish27Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate11:39
manish27A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/11:39
*** manish27 has quit IRC11:39
jrosserodyssey4me: yesterday there was a long discussion about these changing lxc config keys and upgrades11:40
jrosseri'm wondering if there was confusion between distro upgrades and openstack upgrades11:40
odyssey4mejrosser: yep, I didn't really understand it - unless we're wanting to try and facilitate an in-place distro upgrade11:41
jrosserwell thats precisely it11:41
odyssey4mewhich I think is a terribad idea, for the record11:41
jrosseri'm not sure i understand when you'd want to migrate an lxc2 config to lxc3 in place11:41
odyssey4meexactly11:41
jrosserand if we dont want to - it's a non problem11:41
*** woodface has joined #openstack-ansible11:41
woodfaceWith our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/11:42
odyssey4methat would only make sense if we start using lxc3 on xenial and everywhere else, which is pointless in my eyes11:42
woodfaceI thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/11:42
woodfaceRead what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate11:42
woodfaceA fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/11:42
*** woodface has quit IRC11:42
openstackgerritwangqi proposed openstack/openstack-ansible-os_zun master: Remove rabbit_max_retries option  https://review.openstack.org/58778111:43
jrosserodyssey4me: ok, i'll assume for now that lxc2 -> lxc3 happens over an ubuntu reinstall11:43
odyssey4methat's my assumption11:44
*** canori01 has joined #openstack-ansible11:44
*** indistylo has quit IRC11:44
odyssey4mewe should probably put together a guide to doing distribution upgrades as part of the upgrade guide11:44
odyssey4meperhaps one day we won't expect a full re-install for that, but for now that's our assumption11:45
pradiprwtHi odyssey4me, Can you please tell me how to solve this issue http://paste.openstack.org/show/727055/11:48
pradiprwtFrom morning struggling with this11:49
openstackgerritMerged openstack/openstack-ansible-repo_server master: Remove repo_requires_pip_packages and pip_install meta-dep  https://review.openstack.org/58757511:49
pradiprwtI am following this guide https://docs.openstack.org/project-deploy-guide/openstack-ansible/pike/app-config-test.html11:49
odyssey4mepradiprwt: what branch/tag11:49
pradiprwtpike11:50
odyssey4meok, looks like you have some sort of network connectivity issue11:50
odyssey4mebad mta, bad route, bad cidr config, or something like that11:50
odyssey4mego into the container in question, see if you can curl that URL - if you can't, troubleshoot from there11:51
pradiprwtok11:51
pradiprwtodyssey4me: with curl I am getting this issue curl https://bootstrap.pypa.io/get-pip.py >> curl: (56) GnuTLS recv error (-54): Error in the pull function.11:53
odyssey4mepradiprwt: you're going to have to figure out what's going on there - it could literally be anything from a bad mta/cidr config to an interfering proxy or anything to do with the connectivity, and I'm not in a position to spend the time to dig through every option with you11:54
odyssey4metcpdump is most likely your best friend to figure it out11:55
pradiprwtThank odyssey4me, I will figure out the issue, your hint is helpful for me :)11:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Move MQ vhost/user creation into role  https://review.openstack.org/58338811:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Clean up test override vars  https://review.openstack.org/58704611:56
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Clarify the octavia-neutron event stream config options  https://review.openstack.org/58714011:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Correct group names for services  https://review.openstack.org/58773911:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58232411:57
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Reduce testing tech debt  https://review.openstack.org/58266811:57
odyssey4mepradiprwt: no problem - good luck!11:57
*** exezin23 has joined #openstack-ansible11:59
exezin23With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/11:59
exezin23I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/11:59
exezin23Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate11:59
exezin23A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/11:59
*** exezin23 has quit IRC12:00
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: Remove unused variables  https://review.openstack.org/58779112:03
*** KeithMnemonic has quit IRC12:04
*** KeithMnemonic has joined #openstack-ansible12:04
*** armaan has joined #openstack-ansible12:06
openstackgerritMerged openstack/openstack-ansible-os_rally master: Remove rally_requires_pip_packages  https://review.openstack.org/58758812:09
*** Henry_Jia10 has joined #openstack-ansible12:16
Henry_Jia10With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/12:16
Henry_Jia10I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/12:16
Henry_Jia10Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate12:16
Henry_Jia10A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/12:16
*** Henry_Jia10 has quit IRC12:16
openstackgerritMerged openstack/openstack-ansible-os_nova stable/pike: Map instances to cell_v2 only once.  https://review.openstack.org/58515712:19
*** armaan has quit IRC12:19
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_keystone master: Remove python-keystoneclient package install  https://review.openstack.org/58772812:20
*** unknown22 has joined #openstack-ansible12:21
unknown22With our IRC ad service you can reach a global audience of entrepreneurs and fentanyl addicts with extraordinary engagement rates! https://williampitcock.com/12:21
unknown22I thought you guys might be interested in this blog by freenode staff member Bryan 'kloeri' Ostergaard https://bryanostergaard.com/12:21
unknown22Read what IRC investigative journalists have uncovered on the freenode pedophilia scandal https://encyclopediadramatica.rs/Freenodegate12:21
unknown22A fascinating blog by freenode staff member Matthew 'mst' Trout https://MattSTrout.com/12:21
*** unknown22 has quit IRC12:22
*** aludwar has quit IRC12:24
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install master: Revert "defaults: Add virtualenv to default pip packages"  https://review.openstack.org/58779812:26
odyssey4meevrardjp: https://review.openstack.org/587798 is why using the distro package for virtualenv was not working12:27
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Revert "Revert "Install virtualenv for CentOS via distro packages""  https://review.openstack.org/58780112:31
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_designate master: [TEST] openstack_hosts/pip_install changes  https://review.openstack.org/58780312:35
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: [TEST] openstack_hosts/pip_install changes  https://review.openstack.org/58780412:37
*** openstack has joined #openstack-ansible12:59
*** barjavel.freenode.net sets mode: +ns 12:59
*** barjavel.freenode.net sets mode: -o openstack13:00
-barjavel.freenode.net- *** Notice -- TS for #openstack-ansible changed from 1533128345 to 141683563913:00
*** barjavel.freenode.net sets mode: +crt-s 13:00
*** bradm_ has joined #openstack-ansible13:00
*** tomtom002 has joined #openstack-ansible13:00
*** hachi_ has joined #openstack-ansible13:00
*** KeithMnemonic has joined #openstack-ansible13:00
*** canori01 has joined #openstack-ansible13:00
*** rpittau has joined #openstack-ansible13:00
*** zenirc369 has joined #openstack-ansible13:00
*** savvas has joined #openstack-ansible13:00
*** vnogin has joined #openstack-ansible13:00
*** cshen_ has joined #openstack-ansible13:00
*** ThomasWhite has joined #openstack-ansible13:00
*** jiteka| has joined #openstack-ansible13:00
*** jiteka has joined #openstack-ansible13:00
*** madorn has joined #openstack-ansible13:00
*** antonym has joined #openstack-ansible13:00
*** ianw has joined #openstack-ansible13:00
*** johanssone has joined #openstack-ansible13:00
*** dweaver has joined #openstack-ansible13:00
*** skyscraper has joined #openstack-ansible13:00
*** sm806 has joined #openstack-ansible13:00
*** ivve has joined #openstack-ansible13:00
*** electrofelix has joined #openstack-ansible13:00
*** priteau has joined #openstack-ansible13:00
*** tosky has joined #openstack-ansible13:00
*** gillesMo has joined #openstack-ansible13:00
*** epalper has joined #openstack-ansible13:00
*** pcaruana has joined #openstack-ansible13:00
*** yolanda has joined #openstack-ansible13:00
*** pradiprwt has joined #openstack-ansible13:00
*** seba has joined #openstack-ansible13:00
*** EmilienM has joined #openstack-ansible13:00
*** kaiokmo has joined #openstack-ansible13:00
*** hakonw has joined #openstack-ansible13:00
*** sdake has joined #openstack-ansible13:00
*** dabukalam has joined #openstack-ansible13:00
*** vollman has joined #openstack-ansible13:00
*** kedorlaomer has joined #openstack-ansible13:00
*** Taseer has joined #openstack-ansible13:00
*** hwoarang has joined #openstack-ansible13:00
*** coreywright has joined #openstack-ansible13:00
*** eumel8 has joined #openstack-ansible13:00
*** Guest43527 has joined #openstack-ansible13:00
*** andreykurilin has joined #openstack-ansible13:00
*** jmccrory has joined #openstack-ansible13:00
*** exodusftw has joined #openstack-ansible13:00
*** ArchiFleKs has joined #openstack-ansible13:00
*** joabdearaujo has joined #openstack-ansible13:00
*** monty has joined #openstack-ansible13:00
*** guilhermesp has joined #openstack-ansible13:00
*** idlemind has joined #openstack-ansible13:00
*** parasitid has joined #openstack-ansible13:00
*** devx has joined #openstack-ansible13:00
*** tailDASHeF has joined #openstack-ansible13:00
*** ethfci_ has joined #openstack-ansible13:00
*** dave-mccowan has joined #openstack-ansible13:00
*** jamesdenton has joined #openstack-ansible13:00
*** lbragstad has joined #openstack-ansible13:00
*** dmsimard has joined #openstack-ansible13:00
*** jroll has joined #openstack-ansible13:00
*** mugsie has joined #openstack-ansible13:00
*** biffi has joined #openstack-ansible13:00
*** harry_huang_ has joined #openstack-ansible13:00
*** jonher has joined #openstack-ansible13:00
*** flaper87 has joined #openstack-ansible13:00
*** Adri2000 has joined #openstack-ansible13:00
*** speedmann has joined #openstack-ansible13:00
*** ianychoi has joined #openstack-ansible13:00
*** tinwood has joined #openstack-ansible13:00
*** openstackgerrit has joined #openstack-ansible13:00
*** andymccr has joined #openstack-ansible13:00
*** goldenfri has joined #openstack-ansible13:00
*** mgariepy has joined #openstack-ansible13:00
*** flaviosr has joined #openstack-ansible13:00
*** storshoo has joined #openstack-ansible13:00
*** dcdamien has joined #openstack-ansible13:00
*** hamzy has joined #openstack-ansible13:00
*** jproulx has joined #openstack-ansible13:00
*** Rhvs has joined #openstack-ansible13:00
*** Tahvok has joined #openstack-ansible13:00
*** nyloc has joined #openstack-ansible13:00
*** spsurya has joined #openstack-ansible13:00
*** markvoelker_ has joined #openstack-ansible13:00
*** adcpdk has joined #openstack-ansible13:00
*** tomcsi has joined #openstack-ansible13:00
*** ssbarnea has joined #openstack-ansible13:00
*** mwe1 has joined #openstack-ansible13:00
*** kukacz_ has joined #openstack-ansible13:00
*** adrianreza has joined #openstack-ansible13:00
*** zerick has joined #openstack-ansible13:00
*** ggnel has joined #openstack-ansible13:00
*** oanson has joined #openstack-ansible13:00
*** prometheanfire has joined #openstack-ansible13:00
*** viks_ has joined #openstack-ansible13:00
*** gregwork has joined #openstack-ansible13:00
*** kysse has joined #openstack-ansible13:00
*** mubix has joined #openstack-ansible13:00
*** mancdaz has joined #openstack-ansible13:00
*** d34dh0r53 has joined #openstack-ansible13:00
*** berendt_ has joined #openstack-ansible13:00
*** xgerman_ has joined #openstack-ansible13:00
*** mrhillsman has joined #openstack-ansible13:00
*** evrardjp has joined #openstack-ansible13:00
*** jbadiapa has joined #openstack-ansible13:00
*** MasterofJOKers has joined #openstack-ansible13:00
*** klippo has joined #openstack-ansible13:00
*** arbrandes has joined #openstack-ansible13:00
*** lkoranda has joined #openstack-ansible13:00
*** taildashef-work[ has joined #openstack-ansible13:00
*** lbragstad[m] has joined #openstack-ansible13:00
*** RossSchulman[m] has joined #openstack-ansible13:00
*** linshuicheng[m] has joined #openstack-ansible13:00
*** evrardjp[m] has joined #openstack-ansible13:00
*** jothibasu[m] has joined #openstack-ansible13:00
*** csmart[m] has joined #openstack-ansible13:00
*** keithmnemonic[m] has joined #openstack-ansible13:00
*** NostawRm has joined #openstack-ansible13:00
*** cronix has joined #openstack-ansible13:00
*** aetaric has joined #openstack-ansible13:00
*** rickflare has joined #openstack-ansible13:00
*** mudpuppy has joined #openstack-ansible13:00
*** jmnk has joined #openstack-ansible13:00
*** lhinds has joined #openstack-ansible13:00
*** senk has joined #openstack-ansible13:00
*** chudster_ has joined #openstack-ansible13:00
*** jhesketh has joined #openstack-ansible13:00
*** mbuil has joined #openstack-ansible13:00
*** admin0 has joined #openstack-ansible13:00
*** aspiers has joined #openstack-ansible13:00
*** portdirect has joined #openstack-ansible13:00
*** johnsom has joined #openstack-ansible13:00
*** serverascode_ has joined #openstack-ansible13:00
*** fdegir has joined #openstack-ansible13:00
*** jamespage has joined #openstack-ansible13:00
*** xdfil has joined #openstack-ansible13:00
*** wlmbasson has joined #openstack-ansible13:00
*** mpjetta has joined #openstack-ansible13:00
*** stuartgr has joined #openstack-ansible13:00
*** pathcl_ has joined #openstack-ansible13:00
*** logan- has joined #openstack-ansible13:00
*** marst has joined #openstack-ansible13:00
*** cjloader has joined #openstack-ansible13:00
*** FoXMaN has joined #openstack-ansible13:00
*** errr has joined #openstack-ansible13:00
*** juhak has joined #openstack-ansible13:00
*** cloudnull has joined #openstack-ansible13:00
*** Neptu_ has joined #openstack-ansible13:00
*** chudly_ has joined #openstack-ansible13:00
*** spotz has joined #openstack-ansible13:00
*** toddnni has joined #openstack-ansible13:00
*** geekinutah has joined #openstack-ansible13:00
*** DimGR has joined #openstack-ansible13:00
*** hw_wutianwei_ has joined #openstack-ansible13:00
*** paulfantom has joined #openstack-ansible13:00
*** tobberydberg has joined #openstack-ansible13:00
*** bjolo has joined #openstack-ansible13:00
*** coolj has joined #openstack-ansible13:00
*** dankolbrs has joined #openstack-ansible13:00
*** szaher has joined #openstack-ansible13:00
*** kklimonda has joined #openstack-ansible13:00
*** olivierb- has joined #openstack-ansible13:00
*** jenglisch has joined #openstack-ansible13:00
*** fmccarthy has joined #openstack-ansible13:00
*** spikebyte has joined #openstack-ansible13:00
*** sep has joined #openstack-ansible13:00
*** v1k0d3n has joined #openstack-ansible13:00
*** hogepodge has joined #openstack-ansible13:00
*** ildikov has joined #openstack-ansible13:00
*** ullbeking has joined #openstack-ansible13:00
*** jamespo has joined #openstack-ansible13:00
*** neith has joined #openstack-ansible13:00
*** boxrick has joined #openstack-ansible13:00
*** AndyWojo has joined #openstack-ansible13:00
*** alanmeadows has joined #openstack-ansible13:00
*** fyx has joined #openstack-ansible13:00
*** mnaser has joined #openstack-ansible13:00
*** bauruine has joined #openstack-ansible13:00
*** trident has joined #openstack-ansible13:00
*** jdsilberzahn has joined #openstack-ansible13:00
*** brad- has joined #openstack-ansible13:00
*** bgmccollum has joined #openstack-ansible13:00
*** odyssey4me has joined #openstack-ansible13:00
*** chris_hultin has joined #openstack-ansible13:00
*** xar- has joined #openstack-ansible13:00
*** barjavel.freenode.net sets mode: +o cloudnull13:00
*** galstrom_zzz has joined #openstack-ansible13:00
*** eglute_s has joined #openstack-ansible13:00
*** ebbex_ has joined #openstack-ansible13:00
*** hughsaunders has joined #openstack-ansible13:00
*** ChanServ has joined #openstack-ansible13:00
*** dhellmann has joined #openstack-ansible13:00
*** mhayden has joined #openstack-ansible13:00
*** charz has joined #openstack-ansible13:00
*** Miouge has joined #openstack-ansible13:00
*** eoseq has joined #openstack-ansible13:00
*** mgagne has joined #openstack-ansible13:00
*** geofft has joined #openstack-ansible13:00
*** Bico_Fino_ has joined #openstack-ansible13:00
*** persia has joined #openstack-ansible13:00
*** homerp_ has joined #openstack-ansible13:00
*** raginbajin has joined #openstack-ansible13:00
*** tacco has joined #openstack-ansible13:00
*** neillc has joined #openstack-ansible13:00
*** CobHead has joined #openstack-ansible13:00
*** toan has joined #openstack-ansible13:00
*** git-harry has joined #openstack-ansible13:00
*** Jeffrey4l has joined #openstack-ansible13:00
*** SamYaple has joined #openstack-ansible13:00
*** ioni has joined #openstack-ansible13:00
*** kencjohnston has joined #openstack-ansible13:00
*** jrosser has joined #openstack-ansible13:00
*** jpward has joined #openstack-ansible13:00
*** Tyrantelf has joined #openstack-ansible13:00
*** mcarden has joined #openstack-ansible13:00
*** mattoliverau has joined #openstack-ansible13:00
*** nwonknu has joined #openstack-ansible13:00
*** mattt has joined #openstack-ansible13:00
*** lagman has joined #openstack-ansible13:00
*** barjavel.freenode.net sets mode: +o ChanServ13:00
*** barjavel.freenode.net sets mode: +bbbb Corvus`11!*@* lannister!*@* rs-afk!*@* klx``19!*@*13:00
*** barjavel.freenode.net sets mode: +bbbb *!~derwb@150.242.104.110 *!~yduwtsi@36.72.72.22 chzgi663!*@* *!*xilei@*13:00
*** barjavel.freenode.net sets mode: +bbb xilei_!*@* xilei!*@* ops-bot!*@*13:00
*** barjavel.freenode.net changes topic to "Launchpad: https://launchpad.net/openstack-ansible || Weekly Meetings: https://wiki.openstack.org/wiki/Meetings/openstack-ansible || Review Dashboard: https://goo.gl/tTmdgs"13:00
*** jroll has quit IRC13:00
evrardjpmnaser: well I think it will be wise to wait for long term solutions. Then we will see.13:00
*** jrollen has joined #openstack-ansible13:01
jrosser\o/ bionic aio containers start :)13:02
jrosserall looking a bit python3 only :(13:02
openstackgerritMerged openstack/openstack-ansible-os_aodh master: Add systemd journal logging to the service config  https://review.openstack.org/58707413:05
*** vnogin has quit IRC13:10
mhaydenodyssey4me: glad to see you are carrying on the tradition properly13:12
vollmananyone available to review a config_template change?  https://review.openstack.org/#/c/582532/13:22
*** ChanServ sets mode: +f #openstack-unregistered13:23
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58232413:25
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Reduce testing tech debt  https://review.openstack.org/58266813:25
openstackgerritMerged openstack/openstack-ansible-repo_build master: Remove pip_install meta-dep  https://review.openstack.org/58757713:25
bgmccollumis tempest being removed because of timeouts in the gate, or because its currently failing?13:28
odyssey4mebgmccollum: it's not necessarily being removed, although that is an option being considered13:28
bgmccollum*prevented from running13:29
odyssey4mebut yes, one issue is that the volume service keeps failing in the tests13:29
bgmccollumok, thats what im seeing now...ill hold off rechecks till a decision is made.13:29
* mnaser looks at patch13:29
openstackgerritJonathan Rosser proposed openstack/openstack-ansible master: [TEST] bionic  https://review.openstack.org/58660713:29
odyssey4meand at this point, no-one has figured out why - it doesn't happen all the time, and seems to have been made worse by the spectre/meltdown fix implementations13:30
odyssey4memnaser: yep, failed on some other thing - if you can fix that then awesome :)13:30
mnaserodyssey4me: ha centos passed and all the others didnt in teempest.. thats a first13:31
mnaser:p13:31
mnasersmoke + dashboard tests => Ran: 87 tests in 276.0000 sec.13:31
mnasertempest.api.compute.servers.test_server_actions.ServerActionsTestJSON.test_reboot_server_hard13:32
mnaseris one of the tests for example13:32
mnaserlooks like my test was fine, it was just opensuse being meh13:33
*** vollman has quit IRC13:34
*** vollman has joined #openstack-ansible13:34
odyssey4memnaser: you're looking at the wrong result13:35
odyssey4methe test result we're interested in is the experimental check, which is against the integrated repo13:35
mnaserme looks13:35
mnaseri think that failed twice with the same error13:36
mnaserhttp://logs.openstack.org/17/587617/1/experimental/openstack-ansible-integrated-deploy-aio/6cf585f/logs/ara-report/result/fcb830e8-6444-4401-b897-a55528257eec/13:36
mnaserhttp://logs.openstack.org/17/587617/1/experimental/openstack-ansible-integrated-deploy-aio/8ae22af/logs/ara-report/result/77d2d170-80ff-4916-9bc2-071ce6d4445e/13:37
mnaser[tempest.lib.common.fixed_network] (TestNetworkBasicOps:test_network_basic_ops) Network with name: private not found13:39
odyssey4mecores, got a bunch more patches which need review please: https://goo.gl/k9cCfF13:40
*** ansmith has joined #openstack-ansible13:40
*** vnogin has joined #openstack-ansible13:41
*** vnogin has quit IRC13:45
*** vnogin has joined #openstack-ansible13:48
mnaserodyssey4me: done13:51
mnaseralso, interesting13:51
mnaserit looks like the instance is going to ACTIVE, but port is still in BUILD13:51
*** adcpdk has quit IRC13:52
kaiokmoguys, do we have any work/task able to add a repository into opensuse?13:58
kaiokmothe problem is: monasca needs maven on storm, and opensuse doesn't have maven into its repositories13:59
kaiokmoprobably because of tons of depencies needed by maven13:59
kaiokmodependencies*13:59
kaiokmoI found this repository http://download.opensuse.org/repositories/devel:/tools:/building/openSUSE_Leap_42.3/noarch/ which seems to include maven14:00
openstackgerritJames Denton proposed openstack/openstack-ansible master: Adds haproxy endpoints for networking-ovn support  https://review.openstack.org/58406914:01
*** vnogin has quit IRC14:07
openstackgerritMerged openstack/openstack-ansible-os_molteniron master: Move playbooks/config files into role examples  https://review.openstack.org/58758714:08
openstackgerritMerged openstack/openstack-ansible-ceph_client master: Use generic vars file for ubuntu  https://review.openstack.org/58775814:08
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Use generic vars file for ubuntu  https://review.openstack.org/58776614:11
openstackgerritMerged openstack/openstack-ansible-galera_client master: Use generic vars file for ubuntu  https://review.openstack.org/58776014:11
*** hachi_ has quit IRC14:13
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Remove pip_install role execution  https://review.openstack.org/58783514:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Remove pip_install role execution  https://review.openstack.org/58783514:18
jrosserthis is the next blocker for bionic https://review.openstack.org/#/c/584609/14:24
openstackgerritMerged openstack/openstack-ansible-rabbitmq_server master: Use generic vars file for ubuntu  https://review.openstack.org/58776514:27
openstackgerritMerged openstack/openstack-ansible-repo_build master: Use generic vars file for ubuntu  https://review.openstack.org/58776314:36
*** vnogin has joined #openstack-ansible14:37
logan-https://review.openstack.org/#/c/584610/ also bionic related14:38
*** cshen_ has quit IRC14:41
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Use generic vars file for ubuntu  https://review.openstack.org/58772914:45
openstackgerritMerged openstack/openstack-ansible-os_keystone master: Remove python-keystoneclient package install  https://review.openstack.org/58772814:48
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install master: Revert "defaults: Add virtualenv to default pip packages"  https://review.openstack.org/58779814:49
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-pip_install master: Allow the role to only configure pip, not install it  https://review.openstack.org/58784014:49
odyssey4memnaser evrardjp https://review.openstack.org/587798 and https://review.openstack.org/587801 get us back to using the virtualenv package on centos, and it's been confirmed to work with https://review.openstack.org/587803 and https://review.openstack.org/58780414:52
odyssey4memy next crusade is to eliminate installing pip on the host entirely14:54
openstackgerritMerged openstack/openstack-ansible-os_swift master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58235415:00
openstackgerritMerged openstack/openstack-ansible-galera_client master: Remove bionic workaround  https://review.openstack.org/58461015:00
*** jrollen is now known as jroll15:01
cloudnullmornings15:04
*** coreywright has quit IRC15:05
*** vnogin has quit IRC15:05
cloudnullodyssey4me https://www.youtube.com/watch?v=amFRTRMBk1A15:05
odyssey4mecloudnull: :)15:06
cloudnullkaiokmo did you get it going ?15:07
*** zenirc369 has quit IRC15:08
cloudnullkaiokmo in the lxc roles we can add the repo here https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/vars/suse-42-host.yml#L1715:08
cloudnullor if this is something monasca specific you can add the repo to the monasca role using the same pattern15:09
cloudnullTask here: https://github.com/openstack/openstack-ansible-lxc_hosts/blob/master/tasks/lxc_install_zypper.yml#L16-L2615:09
*** pcaruana has quit IRC15:15
*** gyee has joined #openstack-ansible15:16
bgmccollumandymccr would this work for your needs? -- https://review.openstack.org/#/c/587229/15:17
*** coreywright has joined #openstack-ansible15:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Revert "Revert "Install virtualenv for CentOS via distro packages""  https://review.openstack.org/58780115:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Remove pip_install role execution  https://review.openstack.org/58783515:20
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Remove pip from packages installed  https://review.openstack.org/58784915:20
kaiokmocloudnull: that's exactly what I was looking for. tyvm :)15:22
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Eliminate installing pip on host/containers  https://review.openstack.org/58785315:24
openstackgerritMerged openstack/openstack-ansible-pip_install master: Revert "defaults: Add virtualenv to default pip packages"  https://review.openstack.org/58779815:25
jrosserahha - local bionic aio gets all the way through - 2 out of 123 tempest test fail15:26
bgmccollumjrosser by chance are they volume failures?15:26
*** spatel has joined #openstack-ansible15:26
spatelFinally I am in... phew!! This is tux_15:27
spatelcloudnull: thanks for instruction about how to get in :)15:27
jrosserbgmccollum: basic_scenario image,network,volume and basic_ops network,smoke..... is that a good enough description?15:28
cloudnull:) ++ jamesdenton15:28
jamesdentonwut15:28
spatel++15:28
jamesdentonahh hey!15:28
spotzSilly question, do we list anywhere the advatages of using OSA? And I'm also working on getting us back on some of the o.o pages where they list deployment projects and/or containers15:29
spatelcloudnull: i have opened bug related last night issue https://bugs.launchpad.net/openstack-ansible/+bug/178488015:29
openstackLaunchpad bug 1784880 in openstack-ansible "Pike to queen upgrade neutron issue " [Undecided,New]15:29
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Use generic vars file for ubuntu  https://review.openstack.org/58775515:29
spotzThere is currently a cinderclient bug that affects listing volumes, patch is up for it15:29
kaiokmospotz: advantages of using OSA over what?15:30
spotzinstalling directly on hardware, I don't think we list it out anywhere. I'm being lazy:)15:30
cloudnullspotz we something like that in the deployment guide15:30
odyssey4mespotz: we don't do competitive comparisons - that's for vendor sales pitches, it's very un-community to do that sort of thing15:30
bgmccollumjrosser - "volume <uuid> failed to reach available status (current creating) within the required time (600 s)." is the tempest traceback...15:31
bgmccollum...that im seeing15:31
*** openstackstatus has joined #openstack-ansible15:32
*** ChanServ sets mode: +v openstackstatus15:32
spotzcloudnull odyssey4me - Yeah I'm more looking to say hey put your OpenStack on containers for these advantages for a course. Gonna touch on OSA and Kolla as examples.15:32
bgmccollumspotz -- this? -- https://docs.openstack.org/project-deploy-guide/openstack-ansible/queens/app-aboutosa.html15:32
spotzbgmccollum: Sweet I can use some of those points:)15:32
odyssey4meyeah: https://docs.openstack.org/project-deploy-guide/openstack-ansible/latest/app-aboutosa.html15:33
bgmccollumspotz can you link that cinderclient bug?15:33
*** cshen has joined #openstack-ansible15:33
guilhermespspotz: In my honest opinion, installing things from source is a great advantage, and now, having distro and source installation is pretty awesome15:33
odyssey4mealso https://docs.openstack.org/openstack-ansible/latest/reference/architecture/manifesto.html15:33
spotzAnd I'm trying to get OSA listed under deployments on https://www.openstack.org/containers/ and in the project and on the image they have of the infra15:33
jrosserbgmccollum: http://jrosser.woaf.net/bionic-aio-results.html15:34
*** nattanon has joined #openstack-ansible15:34
spotzbgmccollum: https://review.openstack.org/58760115:35
bgmccollumjrosser so its failing to build an instance -- could be any number of things15:35
odyssey4mecloudnull: mind taking a peek at https://goo.gl/k9cCfF15:36
bgmccollumthx15:36
cloudnullspotz https://docs.openstack.org/openstack-ansible/latest/reference/architecture/manifesto.html maybe this is of some help?15:37
spotzodyssey4me: Oh I like the containerized section from the manifesto:)15:37
nattanonHello guys !! Do someone ever used magnum by using ansible deploy on branch stable/pike ?15:37
*** jamesdenton has quit IRC15:37
jrosserodyssey4me: heres the first bionic gate check that got anywhere useful https://review.openstack.org/#/c/586607/15:37
jrosserit was slooooooow15:37
cloudnull odyssey4me looking15:38
spotzcloudnull: Yep odyssey4me had posted it. Fun part of my job is I get to learn new aspects of OpenStack, bad part of my job is I have to figure out how to explain it to others:)15:38
cloudnull++ cool15:38
pradiprwtHi odyssey4me, one quick  question, can we go for deployment without cinder ?15:38
pradiprwtI am installing 3 nodes >> 1 controller 2 compute15:39
odyssey4mepradiprwt: I have no idea whether openstack is at all functional without cinder.15:39
cloudnull++ it should work just fine15:39
pradiprwtMy requirement is to use only compute and networking15:39
spotzYeah cinder and swift are not required services/projects15:39
cloudnullcinder is an optional component. some of the apis will return an error should you try and use cinder things15:39
cloudnullbut it works great without it15:39
bgmccollumits totally functional without cinder ;) -- you just don't get the cinder functions15:40
guilhermesppradiprwt: simple, you just need volumes to boot instances from volumes or create volumes itself15:40
guilhermespit is not a requirement at all to your needs15:40
pradiprwtgreat :), so I can remove cinder entries from openstack_user_config.yml15:41
guilhermespyeah, as well as at conf.d if you have cinder.yml files15:41
pradiprwtThanks guys :)15:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Replace default pip index check with upper constraints check  https://review.openstack.org/58785915:45
vollmanandymccr cloudnull evardjp odyssey4me - looking for a review on https://review.openstack.org/#/c/582532/ after adding requested tests15:45
odyssey4mejrosser: FYI the reason that https://review.openstack.org/585735 is failing is covered in https://review.openstack.org/58785915:45
-openstackstatus- NOTICE: Due to ongoing spam, all OpenStack-related channels now require authentication with nickserv. If an unauthenticated user joins a channel, they will be forwarded to #openstack-unregistered with a message about the problem and folks to help with any questions (volunteers welcome!).15:46
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Update repo_server role to remove pypi reverse proxy  https://review.openstack.org/58573515:47
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Replace default pip index check with upper constraints check  https://review.openstack.org/58786015:47
jrosserodyssey4me: right i see - when i looked at the log of the failed one it tried to d/l something that wasnt yet there15:48
jrosserso that makes sense15:48
odyssey4meyep, it was trying to use the pypiserver - but that had no packages yet15:48
*** nattanon has quit IRC15:49
odyssey4meandymccr that patch has a merged conflict15:50
openstackgerritMerged openstack/openstack-ansible-openstack_hosts master: Revert "Revert "Install virtualenv for CentOS via distro packages""  https://review.openstack.org/58780115:50
odyssey4me*merge15:50
andymccrvollman: ^15:51
odyssey4meah, I was trying to find his handle :)15:51
openstackgerritMichael Vollman proposed openstack/ansible-config_template master: Compare dict vars to determine changed  https://review.openstack.org/58253215:55
*** FrankZhang has joined #openstack-ansible15:55
*** jamesdenton has joined #openstack-ansible15:59
vollman^ should be fixed odyssey4me16:04
odyssey4methanks vollman - just waiting to see whether evrardjp has a bit of time to take a peek, given he's reviewed it before and asked for tests16:05
andymccryeah would be good if evrardjp has a chance!16:06
jrosserodyssey4me: is this anything to do with your MQ works? http://paste.openstack.org/show/727072/16:07
odyssey4mejrosser: possibly16:07
odyssey4mewhere's that from?16:07
jrosserthats the first obvious problem on my completed bionic AIO16:10
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible master: Use repo_build_pip_default_index for the pypi fallback  https://review.openstack.org/58787016:10
odyssey4mejrosser: hmm, check cinder.conf on the host (where cinder-volume is) and in the cinder container - compare their transport_url settings16:11
odyssey4mevalidate whether a userid/password combo are in the URL16:11
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible stable/queens: Use repo_build_pip_default_index for the pypi fallback  https://review.openstack.org/58787116:13
jrosserthe transport_url is the same for both16:13
evrardjpvollman: reviewing16:14
jrosserrabbit://cinder:<long-password>@172.29.238.2:5671//cinder?ssl=116:15
odyssey4mejrosser: ok, hmm16:15
evrardjpodyssey4me: jrosser recently I had weird stuff on cinder about that too -- saying he can't connect?16:16
evrardjpI checked the credentials were ok16:16
evrardjpit must be something deeper I didn't got the chance to look16:16
jrosserooh ** Connection attempt from disallowed node 'rabbitmqcli84@aio1-rabbit-mq-container-7e2e2eab' **16:16
jrosseri wonder if thats some config that didnt work16:17
jrosserthis is from the rabbit container log "operation basic.publish caused a channel exception not_found: no exchange 'cinder-volume_fanout' in vhost '/cinder'"16:19
spotzjrosser: should that / be there?16:21
jrosserspotz: which one :) there are several16:22
spotz'/cinder'16:22
odyssey4mejrosser: yeah, that's the right vhost16:22
jrosseryeah the / is there on /nova and /neutron and they all look happy16:22
evrardjpvollman: have you tried to template things for remote nodes?16:23
odyssey4mejrosser evrardjp oh I think there may be a conflict between the vhost setup in the integrated repo and the vhost setup in the role16:25
odyssey4mejrosser: https://review.openstack.org/585504 should resolve that, although it'd be nice if we could pinpoint the issue16:26
odyssey4methat way we could shim the role temporarily to help other integrated patches move on16:26
spatelAfter upgrade from pike to queens Horizon is extremely slow! anybody noticed that?16:27
evrardjpspatel: check memcached cache hits maybe?16:31
evrardjpis it only horizon?16:31
spatelyes only horizon so far16:31
evrardjpcli calls are fast?16:31
*** flaviosr has quit IRC16:31
spatelI didn't notice any thing on cli.. mostly i deal with GUI so i can't confirm that 100%16:32
spatellet me check memcached16:32
spatelanything specific i should look in memcached?16:32
spatelevrardjp: ^^16:32
*** flaviosr has joined #openstack-ansible16:33
jrossercheck the number of connections vs. the max connection limit16:33
evrardjpspatel: ss -lntp16:34
evrardjpIIRC16:34
evrardjpyou should connections from everywhere16:34
spatelhttp://paste.openstack.org/show/727073/16:35
evrardjpok that's a good start16:36
spatelI have this daemon running "/usr/bin/memcached -p 11211 -u memcached -m 7992 -c 4096 -l 172.28.1.197 -t 4 -v"16:36
evrardjpspatel: ss -at | grep 1121116:36
evrardjpthen compare the ips with your nodes.16:37
evrardjpsee if something is missing16:37
spatelss -at | grep 11211  (empty output)16:37
evrardjpthat's your problem16:37
spatelhmm!16:37
evrardjpno active connections to memcached16:37
evrardjpcheck your configuration16:37
spatelmemcache config?16:37
evrardjpwait16:37
evrardjpjust a sec16:38
spatelk16:38
evrardjpyou ran this in your memcached container, right?16:38
spatelyes i am inside container16:38
evrardjpok16:38
evrardjpcheck your other containers, make sure the configuration to memcached looks correct.16:38
spatelok let me check16:39
evrardjpif it looks correct, restart the service. see how it goes.16:39
evrardjpor re-run setup-everything. if there is an incorrect configuration, it should be fixed automatically16:39
spateloh! wait we have to do this "ss -atn | grep 11211"16:40
spatel-n16:40
evrardjpmmm16:40
-spatel- [root@ostack-infra-01-memcached-container-167ecaa7 ~]# ss -atn | grep 11211 | wc -l16:40
-spatel- 23516:40
spatelI have 235 connection16:40
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_cinder master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58263216:40
spatelevrardjp: ^^16:41
spatelis that normal ?16:41
evrardjpthat's more normal to me16:41
evrardjpspatel: although -n giving results where no -n gives nothing is worrying16:42
evrardjp-n is just for do no resolve hostnames16:42
-spatel- ## Horizon16:42
-spatel- horizon_wsgi_processes: 416:42
-spatel- horizon_wsgi_threads: 416:42
evrardjpso maybe you have hostname resolution issues16:42
-spatel- horizon_wsgi_threads_max: 1616:42
evrardjpI know someone who would say "it's a dns problem"16:43
evrardjpI don't see why this would be linked spatel16:43
spatelwithout -n  it replace 11211 with memcache16:43
spatel172.28.1.158:memcache16:43
-spatel- [root@ostack-infra-01-memcached-container-167ecaa7 ~]# ss -at | grep memcache | wc -l16:44
-spatel- 23516:44
spatelhere alternative output without -n16:44
spatelit was fast in PIKE before16:45
spatelis this looks good to you, i have this setting in user_variable16:46
-spatel- ## Horizon16:46
-spatel- horizon_wsgi_processes: 416:46
-spatel- horizon_wsgi_threads: 416:46
-spatel- horizon_wsgi_threads_max: 1616:46
spateldo i need to increase them? but wonder currently i am the only one using GUI so it doesn't have lots of connection alsop16:46
openstackgerritJames Denton proposed openstack/openstack-ansible master: Adds haproxy endpoints for networking-ovn support  https://review.openstack.org/58406916:47
*** Darcidride has joined #openstack-ansible16:50
openstackgerritMerged openstack/openstack-ansible-os_zun master: Use generic vars file for ubuntu  https://review.openstack.org/58775916:51
*** jiteka has left #openstack-ansible16:54
openstackgerritMerged openstack/openstack-ansible-os_designate master: Revert "Disable functional tests temporarily"  https://review.openstack.org/58764617:00
openstackgerritMerged openstack/openstack-ansible-os_designate master: Convert role to use a common systemd service role  https://review.openstack.org/58719617:00
cloudnullodyssey4me qq- regarding all of the MQ changes. Do you have any thoughts on adding common tags to all of the new mq tasks now in the roles? I was attempting to reconfigure rabbitmq after rebuilding my local rabbitmq cluster and was sad that there were no tags for the specific tasks, other than "$service_name-config".17:10
cloudnullexample https://github.com/openstack/openstack-ansible-os_glance/blob/master/tasks/mq_setup.yml17:10
cloudnullIDK if thats the final resting place for those things?17:10
cloudnullloaded here https://github.com/openstack/openstack-ansible-os_glance/blob/master/tasks/main.yml#L51-L6817:11
cloudnullin queens we had "common-rabbitmq" as a universal tag to run just those tasks, if we can get something like that in place for the in service roles it'd be a huge help.17:12
odyssey4mecloudnull: yeah, didn't really think about tags - that makes sense17:12
* cloudnull just wearing my operator hat 17:12
odyssey4menot sure if tagging in the included file would work?17:12
cloudnullidk tbh17:13
odyssey4meif so, one merge to the tests repo and it will propogate to the roles17:13
odyssey4meI need to built a test AIO anyway - so let me try it out and see what we can do.17:14
*** cshen has quit IRC17:14
cloudnullthat'd be great if we can make a change like that without needing to make 100k PRs by hand :)17:14
odyssey4mewell, yeah17:15
*** mattinator has joined #openstack-ansible17:15
*** epalper has quit IRC17:20
*** mattinator has quit IRC17:26
*** cshen has joined #openstack-ansible17:28
guilhermespodyssey4me: https://github.com/openstack/openstack-ansible-ceph_client/blob/20c2776760627a343c7ac717b226ac410cf998cb/vars/ubuntu-16.04.yml#L3717:31
guilhermespany special reason to point pike?17:32
guilhermespas well as in master17:32
odyssey4meguilhermesp: that's an oversight - it should be queens for queens and probably the same for master17:32
guilhermespso gonna do a PR for master17:33
guilhermespas well as queens, I assume17:33
odyssey4meguilhermesp: once merged in master, backport to queens17:34
odyssey4meweird - seeing quite a bit of this going round now: http://logs.openstack.org/80/583380/2/check/openstack-ansible-functional-ubuntu-xenial/ae08a35/job-output.txt.gz#_2018-08-01_17_00_08_35030317:38
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-ceph_client master: Fix uca_openstack_release variable  https://review.openstack.org/58792317:39
odyssey4meoh dear, that's not good: http://logs.openstack.org/80/583380/2/check/openstack-ansible-functional-ubuntu-xenial/ae08a35/job-output.txt.gz#_2018-08-01_17_00_04_74214117:40
odyssey4meevrardjp: any idea how we combat the wrong path being used for meta deps?17:40
*** Bhujay has joined #openstack-ansible17:41
odyssey4meevrardjp: lol, you have a bug for it: https://github.com/ansible/ansible/pull/3479017:42
guilhermespodyssey4me silly question: how to backport https://review.openstack.org/#/c/587923/ from master to queens if the file has different name between the releases? Is there a way to cherry pick it?17:44
odyssey4meguilhermesp: sure, using the git cli - do the cherry-pick and the 3-way merge may resolve it automatically17:45
guilhermespcool odyssey4me !17:45
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_keystone master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58447917:46
guilhermespodyssey4me: so is this a case that cant be cherry picked? https://bugs.launchpad.net/openstack-ansible/+bug/1783132/comments/617:50
openstackLaunchpad bug 1783132 in openstack-ansible "designate.conf.j2 does not respect user configured designate database name" [Medium,Fix released] - Assigned to Guilherme Steinmuller Pimentel (guilhermesp)17:50
guilhermespI just remembered that wouldn't possible to do it since the database creation has been changed17:51
odyssey4meguilhermesp: yes, you need a fresh patch to queens17:51
*** electrofelix has quit IRC17:52
guilhermespok, going to do now17:52
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_masakari master: Move MQ vhost/user creation into role  https://review.openstack.org/58338017:54
spatelThis is interesting, i am adding new compute node and got this error http://paste.openstack.org/show/727076/17:55
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_neutron master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58302117:55
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Move MQ vhost/user creation into role  https://review.openstack.org/58338817:57
*** harry_huang_ has quit IRC17:59
*** Darcidride has quit IRC18:00
*** seba has quit IRC18:00
*** Guest43527 has quit IRC18:00
guilhermespso just noticed that the bugfix of https://bugs.launchpad.net/openstack-ansible/+bug/1783132/ is still wip (really forgot to finish). So if you guys see patchs about it, that's why18:01
openstackLaunchpad bug 1783132 in openstack-ansible "designate.conf.j2 does not respect user configured designate database name" [Medium,Fix released] - Assigned to Guilherme Steinmuller Pimentel (guilhermesp)18:01
odyssey4melogan- mnaser if you guys are around, I'd appreciate another set of eyes on https://review.openstack.org/58785918:04
* mnaser click18:04
*** poopcat has joined #openstack-ansible18:04
mnaserodyssey4me: makes sense to me18:05
odyssey4memnaser: not that important to master, but super important to queens18:05
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible stable/queens: Rename designate_galera_database_name  https://review.openstack.org/58793118:05
odyssey4memnaser: it makes this one work https://review.openstack.org/58573518:07
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Revert "Use generic vars file for ubuntu"  https://review.openstack.org/58793218:13
*** Darcidride has joined #openstack-ansible18:13
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_nova master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58445018:17
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Add Rocky UCA for bionic  https://review.openstack.org/58794418:17
*** mattinator has joined #openstack-ansible18:21
*** cshen has quit IRC18:22
openstackgerritAndy Smith proposed openstack/openstack-ansible-os_heat master: Setup oslo.messaging extra packages for optional drivers  https://review.openstack.org/58451318:27
*** cshen has joined #openstack-ansible18:30
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_masakari master: Add missing masakari_venv_download_url default  https://review.openstack.org/58656518:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_masakari master: Use masakari-api group for setup tasks  https://review.openstack.org/58656618:40
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_masakari master: Use masakari_etc_dir consistently  https://review.openstack.org/58657918:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_masakari master: Use masakari_log_dir consistently  https://review.openstack.org/58658018:41
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_masakari master: Use masakari_service_* vars consistently  https://review.openstack.org/58658518:41
*** Bhujay has quit IRC18:44
*** cshen has quit IRC19:00
*** DanyC_ has joined #openstack-ansible19:02
openstackgerritAndy Smith proposed openstack/openstack-ansible master: [WIP] Add qdrouterd role for messaging backend deployment  https://review.openstack.org/57026119:02
spatelCan someone explain me what is wrong here, i am trying to add compute node and getting this error related creating nova group http://paste.openstack.org/show/727080/19:04
spatelif group doesn't existing then it should create one right?19:05
spatelThis compute node was working but i re-install OS and re-adding back in cluster19:05
*** cshen has joined #openstack-ansible19:07
spatelmanually created account works  "group -g 993 nova"19:09
*** cshen has quit IRC19:11
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_designate stable/pike: Use designate_galera_database  https://review.openstack.org/58798019:16
*** jamesdenton has quit IRC19:19
*** cshen has joined #openstack-ansible19:24
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_designate stable/ocata: Use designate_galera_database  https://review.openstack.org/58798619:25
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Move MQ vhost/user creation into role  https://review.openstack.org/58338019:27
odyssey4mejrosser: answered your Q in https://review.openstack.org/587932 - see https://review.openstack.org/587944 for the follow up patch19:28
jrosserodyssey4me: i see, makes sense19:34
odyssey4meyeah, turns out my diffs when checking whether the var files were the same turned out to be useless... for some reason diff gave me nothing, but they were clearly different19:35
jrosserhow do you approach "mechanised patching" <- doing the same tedious thing to lots of repos19:35
openstackgerritMerged openstack/openstack-ansible-os_nova master: Remove python-keystoneclient package install  https://review.openstack.org/58773319:37
spatelcloudnull: this is painful :( i am installing new compute node and it installed nova but didn't install neutron agent etc..19:37
spatelsomething is broken in Queens19:37
spatelcloudnull: ^^19:37
odyssey4mejrosser: well, I used to have an awful bash script which I'd hack every time - now I use an awful playbook which I hack every time - one day I'll get smarter and build something sensible in python19:37
spatelYesterday i have empty /etc/openstack_deploy/env.d  directory does it related to that ?19:38
odyssey4mespatel: it should be empty, unless you have specifically changed the behaviour for some reason19:38
spatelthat is good19:39
spatelnow question is why neutron didn't get install on my compute node ?19:39
spatel"neutron-linuxbridge-agent.service"  this service isn't there19:39
spatelI am running these playbook19:40
-spatel- openstack-ansible setup-hosts.yml --tags openstack_hosts-config19:40
-spatel- openstack-ansible setup-hosts.yml --limit $1 --skip-tags openstack_hosts-config19:40
-spatel- openstack-ansible setup-openstack.yml --skip-tags nova-key-distribute --limit $119:40
-spatel- openstack-ansible setup-openstack.yml --tags nova-key --skip-tags ceph --limit compute_hosts19:40
spatel$1 = compute-0119:40
spatellet me try "openstack-ansible os-neutron-install.yml"19:41
odyssey4mespatel: dunno, have you tried running the os-neutron playbook on its own?19:41
spatelgoing to do it now19:41
guilhermespguys https://review.openstack.org/#/c/587931/ I'd appreciate reviews... so when merged i can cherry-pick to the other branches in order to work with https://review.openstack.org/#/c/585523/1 along ocata/pike/queens19:42
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-openstack_hosts master: Add Rocky UCA for bionic  https://review.openstack.org/58794419:43
guilhermespso the designate bug can be fully closed19:43
odyssey4mejrosser: thanks19:43
jrosserno worries19:43
jrosserfeels like nearly time to get bionic roles voting19:43
jrosserthe only reason not to before was the role tests all cross depended on other roles that were broken on bionic19:44
spatelodyssey4me: that works! running os-neutron playbook19:44
spatelwondering its part of setup-openstack.yml bundle then why didn't work ...19:44
spatelodd19:44
spatelodyssey4me: now my nova-compute.service failed to start19:46
spateland missing /var/log/nova/nova-compute.log  file too19:46
-spatel- [root@ostack-compute-01 ~]# id nova19:47
-spatel- uid=995(nova) gid=993(nova) groups=993(nova)19:47
spatelstrange.. it doesn't created all groups19:47
spatelOn other compute node it has more grps19:48
-spatel- [root@ostack-compute-02 ~]# id nova19:48
-spatel- uid=995(nova) gid=993(nova) groups=993(nova),989(libvirt),1000(cephkeys)19:48
*** gillesMo has quit IRC19:48
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible stable/queens: Rename designate_galera_database_name  https://review.openstack.org/58793119:48
guilhermespodyssey4me: ^ sorry, only saw the other comment now19:49
odyssey4mejrosser: FYI on master, with https://review.openstack.org/585504 and https://review.openstack.org/586226, on Xenial, I have a properly working set of cinder services without intervention19:51
spatelhow do i install ceph_client on compute node?19:52
jrosserthats good, i'll use those on my next spin19:52
jrosserodyssey4me: i don't know if you looked at this but theres the gist of what i had to do to get bionic going19:53
jrosseri will start splitting proper patches out of that tomorrow19:53
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible stable/queens: Rename designate_galera_database_name  https://review.openstack.org/58793119:53
jrosserodyssey4me: https://review.openstack.org/#/c/586607/19:53
odyssey4mejrosser: nice! added a comment about the one thing that's not needed and can be pulled out19:57
spatelodyssey4me: i am running os-nova-install.yml on compute node and seeing this strange error http://paste.openstack.org/show/727086/19:57
spatelany idea why i am seeing that error19:57
odyssey4mesorry spatel I'm heading out for the night and am not in a position to help right now, just trying to close out the day19:58
spatelodyssey4me: no worry.. have fun19:58
spatelcloudnull: or anyone else can look here ? http://paste.openstack.org/show/727086/19:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Clean up test override vars  https://review.openstack.org/58704619:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Execute service setup against a delegated host using Ansible built-in modules  https://review.openstack.org/58232419:58
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Reduce testing tech debt  https://review.openstack.org/58266819:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Correct group names for services  https://review.openstack.org/58773919:59
spatells: cannot access /openstack/venvs/nova-17.0.8/lib/python2.7/libguestfsmod.so: No such file or directory19:59
openstackgerritJesse Pretorius (odyssey4me) proposed openstack/openstack-ansible-os_octavia master: Clarify the octavia-neutron event stream config options  https://review.openstack.org/58714019:59
jrosserodyssey4me: cheers for looking at that, have a good evening19:59
odyssey4mealright, os_octavia should be good to go by morning again20:01
*** spatel has quit IRC20:01
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Add missing masakari_venv_download_url default  https://review.openstack.org/58656520:06
cloudnullspatel I believe the issue is libguestfsmod.so is not installed on those compute hosts.20:11
*** cshen has quit IRC20:11
*** cshen has joined #openstack-ansible20:12
odyssey4methat's one of the c libs that's symlinked into the venv20:12
odyssey4mesounds to me like the installation did't complete as it should have - maybe something to do with the use of the tags20:13
odyssey4meanyway, I'm out for the night - cheers folks20:13
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Use masakari-api group for setup tasks  https://review.openstack.org/58656620:18
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Use masakari_etc_dir consistently  https://review.openstack.org/58657920:18
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Use masakari_log_dir consistently  https://review.openstack.org/58658020:18
openstackgerritMerged openstack/openstack-ansible-os_masakari master: Use masakari_service_* vars consistently  https://review.openstack.org/58658520:18
openstackgerritDavid Wilde proposed openstack/openstack-ansible-ops master: Deploy ELK in MNAIO  https://review.openstack.org/58661220:19
*** cshen has quit IRC20:25
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_designate stable/ocata: Use designate_galera_database  https://review.openstack.org/58798620:27
openstackgerritGuilherme  Steinmuller Pimentel proposed openstack/openstack-ansible-os_designate stable/pike: Use designate_galera_database  https://review.openstack.org/58798020:28
*** Darcidride has quit IRC20:28
*** ansmith has quit IRC20:39
*** spatel has joined #openstack-ansible21:04
*** spatel has quit IRC21:09
savvashey guys, any thoughts on how I can get past this? Ceph-osd task install with OA crashes on http://paste.openstack.org/show/727091/. Other nodes work just fine and I've already tried to remove and recreate my loop device. This is the second attempt, setup-infra crashed first time but I didn't write down the error.21:15
cloudnullsavvas is that an AIO?21:23
*** jamesdenton has joined #openstack-ansible21:24
cloudnullseems like loop0 is non-functional ?21:24
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Move MQ vhost/user creation into role  https://review.openstack.org/58338821:26
savvascloudnull: no, a 3 node setup, 1 osd each21:29
*** vnogin has joined #openstack-ansible21:31
cloudnullis the lo device mountable on it's own  ?21:31
savvasye and I tried removing it and recreating it21:32
savvasdidn't do the trick either21:32
cloudnullcan you run the command: 'blkid -t PTTYPE=gpt /dev/loop0'21:32
cloudnullwhich is what its failing on21:32
savvasfirst issue was it being mounted, after I removed the mount on /var/lib/machines.raw it started failing on this (in my opinion the playbook should probably recognize in a way that the loop0 device is used after setup-infrastructure has run at some point)21:33
cloudnullwhat about `parted /dev/loop0`21:33
savvasI parted, used sgdisk, dd zeroed it21:33
savvasall worked fine21:33
savvasceph-disk zapped it21:33
savvassorry the ceph-disk part and such I did on the actual osd disk21:34
savvasI didn't part the loop device come to think of it, I just issued a pxe format on it though, wasn't expecting an answer anymore at this hour21:34
cloudnullcan you paste the result of that blkid command?21:34
cloudnullalso can you cat the mount unit "/etc/systemd/system/var-lib-machines.mount" ?21:35
savvasI'll owe you that one, if it fails again, I'll need to run the other playbooks first again21:36
cloudnullit should be using the loop option, which will just select an available loop device21:36
savvashttp://paste.openstack.org/show/727093/21:36
savvasthis is from another node which worked just fine21:36
savvasI can't give you from the problem node unfortunately, like I said, just reloaded it just to not get stuck on it21:37
savvasshould've perhaps not been so hasty on doing that :(21:37
spotzis it just me or is a master AIO installing faster?21:37
cloudnullspotz yes. we correct a fairly terrible performance problem just recently21:38
spotzcloudnull: Sweet21:39
cloudnullsavvas no worries. if its still happening (or happens again) let us know.21:39
openstackgerritMerged openstack/openstack-ansible stable/queens: Add retries to collect ID's for nova services  https://review.openstack.org/58756321:39
spotzcloudnull: and then the ssh rules lock you out!:)21:40
cloudnullhahaa21:40
cloudnullsuch is life :)21:40
savvascloudnull: I will, just about to run setup-hosts.yml on it again21:40
cloudnull++21:41
savvasit has been a while since I last ran the installer21:41
savvasbut it seems a lot less buggy than what it was during ocata/pike21:41
savvasmay have been isolated incidents on my end but I am running the same user vars and config on queens now, no issue apart from this so far21:42
cloudnullnice!21:42
cloudnullits good to hear we're making strides in the right direction :)21:43
savvaswell I love the concept21:43
savvastrying to get to a point where we can use it in production21:43
*** spatel has joined #openstack-ansible21:46
*** spatel has quit IRC21:47
*** ansmith has joined #openstack-ansible21:49
*** spatel has joined #openstack-ansible21:55
*** cshen has joined #openstack-ansible22:11
*** cshen has quit IRC22:15
cloudnullspotz I just stumbled across this https://blog.rackspace.com/rackspace-private-cloud-stronger-openstack-ansible - maybe some good tidbits you can steal from andymccr22:20
spotzcloudnull: nice I'll take a look at it:)22:21
*** priteau has quit IRC22:25
spatelcloudnull: who install this directory content on compute node ? /openstack/venvs/22:31
spatelits somehow not getting installed :(22:31
spatelhttps://bugs.launchpad.net/openstack-ansible/+bug/178494922:32
openstackLaunchpad bug 1784949 in openstack-ansible "Queen issue adding compute nodes " [Undecided,New]22:32
*** ullbeking has quit IRC22:38
*** ullbeking has joined #openstack-ansible22:39
cloudnullspatel that directory is created within the OSA playbooks.22:43
cloudnullI bleieve openstack-hosts?22:44
cloudnullin your case I believe that is a bind mount?22:44
spatelI am following this URL to add host https://docs.openstack.org/openstack-ansible/newton/newton/developer-docs/ops-add-computehost.html22:44
spatellet me try again and see if i am lucky this time22:45
spatelcloudnull: this is compute node totally different host22:45
cloudnulloh ok.22:45
spatellast night whatever we did that was infra* nodes22:45
cloudnullgot it .22:45
cloudnull`openstack-ansible setup-hosts.yml --limit NEW_HOST_NAME` should cover the base host setup22:46
spatelI did run that 100 time :)22:46
spateli can try again22:46
spatelrunning it again22:46
spatellook like my Queens cluster is haunted :(  last 3 days day/night trying to make it happy but somehow not working out22:47
spatelI was very happy with pike i had Zero issue in pike but since pike to queen upgrade.. i am little bit not happy!22:48
spatelcloudnull: i just finished "openstack-ansible setup-hosts.yml --limit ostack-compute-0" and nothing happened22:48
spatel /openstack is still empty22:49
cloudnullso long as the directory is there that should be ok22:49
* cloudnull double checking 22:49
spatelshould i copy whole folder from other box ?22:50
cloudnullthe nova role ensures the directory is present https://github.com/openstack/openstack-ansible-os_nova/blob/master/tasks/nova_pre_install.yml#L6322:51
spatelit has /openstack/log dir only22:51
spatelmissing venvs22:52
*** savvas has quit IRC22:53
spatelOn other compute node i can see these dir and they are very big  http://paste.openstack.org/show/727102/22:54
spatelthat node was pike before and upgraded to queens22:54
spatelnow i am adding new compute node and there everything is broken22:54
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Correct group names for services  https://review.openstack.org/58773922:55
cloudnullspatel so what playbook is failing ?22:55
spatelos-nova-install22:55
spatelThis is the error i am getting http://paste.openstack.org/show/727086/22:55
cloudnullwhen you run # openstack-ansible setup-openstack.yml --skip-tags nova-key-distribute --limit NEW_HOST_NAME ?22:55
spatelos-nova-install.yml trying to create symlink /openstack/venvs/nova-17.0.8/lib/python2.7/guestfs.py22:56
spatelI have missing /openstack/venvs/nova-17.0.8  folder22:56
spatelI have only /openstack/venvs/neutron-17.0.8/ available on that PATH22:58
spatelnova-17.0.8 is missing22:58
cloudnullare you able to look back through the playbook history22:58
cloudnulldid the task "Create nova venv dir" run ?22:59
cloudnullhttps://github.com/openstack/openstack-ansible-os_nova/blob/9f53e04687d5cab829e5dcf9c2049fddd5f44ed7/tasks/nova_install_source.yml#L75-L8322:59
spatellet me post full output23:00
cloudnulladditionally can you look to see if the nova venv is found here /var/cache/ ?23:00
cloudnullif so can you delete it and rerun that playbook ?23:00
spatelcloudnull: here you go http://paste.openstack.org/show/727103/23:00
cloudnullyea line 357b23:01
cloudnullthe task was skipped, which would only happen if the venv was already cached on your system23:01
spatelin /var/cache i have this http://paste.openstack.org/show/727104/23:01
cloudnullSeems like an an over zealous conditional IMHO23:01
cloudnull23:01
cloudnullyup, delete /var/cache/nova-17.0.8-x86_64.tgz23:02
cloudnulland retry23:02
cloudnulli suspect it failed once before ?23:02
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Clean up test override vars  https://review.openstack.org/58704623:02
spatelok23:02
spateldeleting /var/cache/nova-17.0.8-x86_64.tgz23:02
spatelyou said  "line 357b" what is that error about?23:03
cloudnullif i had to guess it would have failed between https://github.com/openstack/openstack-ansible-os_nova/blob/9f53e04687d5cab829e5dcf9c2049fddd5f44ed7/tasks/nova_install_source.yml#L43-L8323:03
cloudnullline 357 shows that the task to create that venv dir was skipped23:04
*** vollman has quit IRC23:04
openstackgerritMerged openstack/openstack-ansible-os_octavia master: Clarify the octavia-neutron event stream config options  https://review.openstack.org/58714023:04
spatelDamn!! it23:04
spateli can see folder now23:04
spatelcloudnull: so it created folder, that is good now it stuck here http://paste.openstack.org/show/727105/23:07
cloudnullthat's some issue with https://download.ceph.com/rpm-luminous/el7/x86_64/python-rgw-12.2.7-0.el7.x86_64.rpm23:07
cloudnullmaybe the mirror is out of synv23:08
cloudnull**sync23:08
spateli did wget https://download.ceph.com/rpm-luminous/el7/x86_64/python-rgw-12.2.7-0.el7.x86_64.rpm  and it works on server23:09
spatellet me do yum clean and try23:09
spatelcloudnull: yum clean did magic look like23:13
kaiokmojrosser: http://logs.openstack.org/32/586932/2/check/openstack-ansible-functional-ubuntu-bionic/c50a613/job-output.txt.gz#_2018-08-01_21_21_08_26449923:15
kaiokmoI'm facing this issue when running tests locally too23:15
spatelcloudnull: I really really appreciate your help with that!!! you just rocks23:15
spatelcloudnull: i wanted to understand what was the relation to /var/cache with /openstack/venvs23:16
cloudnullthe cache path holds the tarballs and it looks like the tasks check if the tarball exists before unarchiving / running the venv setup.23:17
cloudnullkaiokmo i'd probably just switch the mirrors being used on your systems to use archive.ubuntu.com23:18
spateldon't you think its a bug? it should un-tar if its missing23:19
cloudnullyou could try running update again, however I'd suspect the mirror your ssystem is using is syncing23:19
cloudnullspatel i think it's an over zealous conditional23:19
spatelhmmm23:19
cloudnullhttps://github.com/openstack/openstack-ansible-os_nova/blob/9f53e04687d5cab829e5dcf9c2049fddd5f44ed7/tasks/nova_install_source.yml#L8123:20
cloudnullwhich is bug of sorts23:20
cloudnullif we remove that condition it would have done the right thing23:20
*** dabukalam has quit IRC23:20
spatelthat is the right thing..23:21
*** poopcat has quit IRC23:21
spatelOSA official document is great but these kind of small issue and bug hard to find for people like me or fresh :)23:21
*** poopcat has joined #openstack-ansible23:21
spatelIt would be great to have very deep diving document about all component function but anyway that is not easy task too23:22
cloudnull++ totally agree. some of those issues are tough to nail down23:22
*** vnogin has quit IRC23:22
spatelI am glad you are alway around ;) otherwise this is going to give me heart attack :)23:23
cloudnullhaha23:23
spatelI have 200 compute node sitting in datacenter soon ready to go so i am hopping won't get any issue :)23:23
spatelwe are building massive datacenter to run on openstack and this is just prototype...23:24
*** tosky has quit IRC23:24
cloudnullcool!23:25
spatelcloudnull: going to make some dinner.. will see you around in night... today i am not going to trouble you.. believe me ;)23:26
spatelsee ya!!!23:26
cloudnullhaha23:26
cloudnulltake care23:26
cloudnullenjoy dinner.23:26
*** spatel has quit IRC23:26
*** dabukalam has joined #openstack-ansible23:42
kaiokmocloudnull: figured it out. it was an issue with the version of my local openstack_hosts role23:50
kaiokmoI brought https://review.openstack.org/#/c/587944/ temporary to my repo, and it solved the problem23:50
*** poopcat has quit IRC23:52
*** poopcat has joined #openstack-ansible23:53

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!