Saturday, 2018-07-21

admin0i am doing your way now . specifying the ips maually00:03
*** poul has joined #openstack-ansible00:05
*** poul has quit IRC00:09
admin0will continue this tomorrow .. 2AM for me tux_00:12
tux_good luck :)00:13
admin0thanks00:13
tux_good nite00:13
*** poul has joined #openstack-ansible00:22
*** lkoranda has quit IRC00:26
*** lkoranda has joined #openstack-ansible00:28
*** parasitid has quit IRC00:40
*** poul has quit IRC00:40
tux_cloudnull: why its eating lots of space?00:41
tux_908M/openstack/ostack-infra-01_glance_container-42281832/00:41
tux_what is /openstack  dir for on infra node?00:42
tux_Can someone explain me why /openstack dir filling up ? what are these stuff there?00:49
tux_http://paste.openstack.org/show/726383/00:49
tux_Is it safe to delete all of them?00:49
*** poul has joined #openstack-ansible00:49
*** poul has quit IRC00:54
*** parasitid has joined #openstack-ansible00:55
tux_cloudnull: something weird going on01:00
tux_my /openstack dir getting filling up so fast on production01:00
tux_in my LAB its almost empty01:00
tux_http://paste.openstack.org/show/726384/01:01
*** dave-mcc_ has quit IRC01:02
*** poul has joined #openstack-ansible01:07
*** poul has quit IRC01:11
tux_I have opened BUG here because this is very odd issue01:14
tux_https://bugs.launchpad.net/openstack-ansible/+bug/178285601:14
openstackLaunchpad bug 1782856 in openstack-ansible "/openstack directory getting full " [Undecided,New]01:14
tux_LXC is busted in my network look like... This is not good :(01:16
tux_cloudnull: Look like i am screwed :(  something is busted in OSA01:22
tux_cloudnull: you can please review my BUG and tell me what is wrong here?01:23
*** chyka has joined #openstack-ansible01:24
*** chyka has quit IRC01:29
*** cshen has joined #openstack-ansible01:43
*** cshen has quit IRC01:48
*** poul has joined #openstack-ansible01:59
*** strobelight has joined #openstack-ansible02:10
*** poul has quit IRC02:17
*** epalper has joined #openstack-ansible02:25
*** poul has joined #openstack-ansible02:30
*** poul has quit IRC02:35
*** poul has joined #openstack-ansible02:48
*** poul has quit IRC02:53
*** epalper has quit IRC03:06
tux_any idea here ? http://paste.openstack.org/show/726385/03:19
*** mattinator has quit IRC03:30
*** poul has joined #openstack-ansible03:32
tux_i found this BUG https://github.com/ceph/ceph-ansible/commit/d3b427e16990f9ebcde7575aae367fd7dfe36a8d#diff-34d2eea5f7de9a9e89c1e66b15b4cd0a03:35
*** poul has quit IRC03:50
*** poul has joined #openstack-ansible03:59
*** chyka has joined #openstack-ansible04:03
*** poul has quit IRC04:04
*** chyka has quit IRC04:08
*** mike___brennan has quit IRC04:16
*** poul has joined #openstack-ansible04:16
*** poul has quit IRC04:21
*** poul has joined #openstack-ansible04:25
*** goldenfri has quit IRC04:26
*** poul has quit IRC04:29
*** coreywright has quit IRC04:31
*** poul has joined #openstack-ansible04:42
*** coreywright has joined #openstack-ansible04:44
*** poul has quit IRC04:47
*** indistylo has joined #openstack-ansible04:54
*** poul has joined #openstack-ansible04:59
*** poul has quit IRC05:03
*** poul has joined #openstack-ansible05:08
*** epalper has joined #openstack-ansible05:09
*** epalper has quit IRC05:16
*** tux_ has quit IRC05:18
*** strobelight has quit IRC05:20
*** poul has quit IRC05:26
*** indistylo has quit IRC05:29
*** Bhujay has joined #openstack-ansible05:30
*** tux_ has joined #openstack-ansible05:34
*** Bhujay has quit IRC05:34
*** Bhujay has joined #openstack-ansible05:35
*** Bhujay has quit IRC05:35
*** Bhujay has joined #openstack-ansible05:35
*** tux_ has quit IRC05:44
*** poul has joined #openstack-ansible06:10
*** chyka has joined #openstack-ansible06:12
*** poul has quit IRC06:14
*** chyka has quit IRC06:17
*** indistylo has joined #openstack-ansible06:22
*** poul has joined #openstack-ansible06:27
*** poul has quit IRC06:31
*** cshen has joined #openstack-ansible06:38
*** viks_ has quit IRC06:42
*** cshen has quit IRC06:42
*** poul has joined #openstack-ansible06:44
*** epalper has joined #openstack-ansible06:47
*** poul has quit IRC06:50
*** poul has joined #openstack-ansible06:54
*** poul has quit IRC06:58
*** Bhujay has quit IRC06:59
*** Bhujay has joined #openstack-ansible06:59
*** arbrandes1 has joined #openstack-ansible07:01
*** arbrandes has quit IRC07:04
*** epalper has quit IRC07:07
*** poul has joined #openstack-ansible07:11
*** indistylo has quit IRC07:12
*** poul has quit IRC07:15
*** poul has joined #openstack-ansible07:28
*** poul has quit IRC07:32
*** tux_ has joined #openstack-ansible07:33
*** armaan has joined #openstack-ansible07:38
*** cshen has joined #openstack-ansible07:49
*** cshen has quit IRC07:54
*** DanyC has joined #openstack-ansible08:03
*** poul has joined #openstack-ansible08:20
*** poul has quit IRC08:24
*** cshen has joined #openstack-ansible08:28
*** DanyC has quit IRC08:34
*** DanyC has joined #openstack-ansible08:34
*** poul has joined #openstack-ansible08:37
*** DanyC has quit IRC08:39
*** Bhujay has quit IRC08:41
*** poul has quit IRC08:41
jrosserodyssey4me: the queens repo patches are getting further but http://paste.openstack.org/08:46
jrosserthe aio config has no proxy awareness so i'm trying something along these lines in user_variables for the aio http://paste.openstack.org/show/726392/08:47
openstackgerritMerged openstack/openstack-ansible-os_horizon master: New horizon_enable_router variable  https://review.openstack.org/58437508:51
*** cshen has quit IRC08:51
*** poul has joined #openstack-ansible08:54
*** poul has quit IRC08:59
*** poul has joined #openstack-ansible09:03
*** poul has quit IRC09:07
*** poul has joined #openstack-ansible09:20
*** poul has quit IRC09:24
*** cshen has joined #openstack-ansible09:26
*** gkadam has joined #openstack-ansible09:28
*** poul has joined #openstack-ansible09:29
*** armaan has quit IRC09:30
*** cshen has quit IRC09:30
*** armaan has joined #openstack-ansible09:31
*** poul has quit IRC09:33
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Add osprofiler to api-paste pipeline  https://review.openstack.org/58340009:36
*** Bhujay has joined #openstack-ansible09:38
openstackgerritMerged openstack/openstack-ansible-os_neutron master: Add packages required for osprofiler  https://review.openstack.org/57351109:49
*** hachi has joined #openstack-ansible09:51
*** DanyC has joined #openstack-ansible09:55
*** cshen has joined #openstack-ansible09:57
*** DanyC has quit IRC09:59
*** cshen has quit IRC10:02
*** jwitko has quit IRC10:16
*** armaan has quit IRC10:22
*** armaan has joined #openstack-ansible10:22
*** cshen has joined #openstack-ansible10:25
*** armaan has quit IRC10:27
*** armaan has joined #openstack-ansible10:27
*** poul has joined #openstack-ansible10:29
*** armaan has quit IRC10:29
*** armaan has joined #openstack-ansible10:29
*** poul has quit IRC10:34
*** DanyC has joined #openstack-ansible10:43
*** poul has joined #openstack-ansible10:46
*** DanyC has quit IRC10:47
*** poul has quit IRC10:51
*** poul has joined #openstack-ansible11:03
*** poul has quit IRC11:08
*** cshen has quit IRC11:09
*** hachi has quit IRC11:16
*** poul has joined #openstack-ansible11:20
*** poul has quit IRC11:24
*** cshen has joined #openstack-ansible11:36
*** poul has joined #openstack-ansible11:37
*** cshen has quit IRC11:41
*** poul has quit IRC11:43
*** cshen has joined #openstack-ansible11:59
*** cshen has quit IRC12:03
*** parasitid has quit IRC12:04
*** armaan has quit IRC12:10
*** armaan has joined #openstack-ansible12:11
*** DanyC has joined #openstack-ansible12:14
*** armaan has quit IRC12:15
*** DanyC has quit IRC12:17
*** DanyC has joined #openstack-ansible12:17
*** DanyC has quit IRC12:17
*** DanyC has joined #openstack-ansible12:18
*** parasitid has joined #openstack-ansible12:21
*** DanyC has quit IRC12:23
openstackgerritweizj proposed openstack/openstack-ansible-os_cloudkitty master: Completed required variables for README.rst  https://review.openstack.org/58398112:26
openstackgerritjacky06 proposed openstack/openstack-ansible-os_tacker master: Update the project home to https  https://review.openstack.org/58458412:36
openstackgerritjacky06 proposed openstack/openstack-ansible-os_congress master: Update the project home to https  https://review.openstack.org/58458512:39
*** cshen has joined #openstack-ansible12:46
*** armaan has joined #openstack-ansible12:50
openstackgerritjacky06 proposed openstack/openstack-ansible-os_nova master: Make the project home link in next line  https://review.openstack.org/58458612:51
openstackgerritjacky06 proposed openstack/openstack-ansible-os_octavia master: Make the project home link in next line  https://review.openstack.org/58458712:52
openstackgerritjacky06 proposed openstack/openstack-ansible-os_nova master: Make the project home link in next line  https://review.openstack.org/58458612:54
openstackgerritjacky06 proposed openstack/openstack-ansible-os_aodh master: Add repository into README.rst  https://review.openstack.org/58458813:04
*** poul has joined #openstack-ansible13:04
*** poul has quit IRC13:09
*** poul has joined #openstack-ansible13:21
openstackgerritMerged openstack/openstack-ansible-os_horizon master: Add support for the default_dns_nameservers variable  https://review.openstack.org/57422713:24
*** poul has quit IRC13:26
*** cshen has quit IRC13:29
*** tux_ has joined #openstack-ansible13:32
*** cshen has joined #openstack-ansible13:34
*** poul has joined #openstack-ansible13:38
*** poul has quit IRC13:39
*** poul has joined #openstack-ansible13:39
*** taseer1 has joined #openstack-ansible13:47
*** Taseer has quit IRC13:47
*** taseer2 has joined #openstack-ansible13:48
*** taseer1 has quit IRC13:52
*** cshen has quit IRC13:54
*** cshen has joined #openstack-ansible13:56
*** tux_ has quit IRC13:56
*** armaan has quit IRC13:57
*** tux_ has joined #openstack-ansible13:57
*** armaan has joined #openstack-ansible13:58
*** cshen has quit IRC14:01
*** armaan has quit IRC14:02
*** tux_ has quit IRC14:02
*** vakuznet has quit IRC14:07
*** v1a4 has joined #openstack-ansible14:16
*** poul has quit IRC14:22
*** tux_ has joined #openstack-ansible14:22
*** poul has joined #openstack-ansible14:23
*** pcaruana has quit IRC14:29
*** pcaruana has joined #openstack-ansible14:30
*** poul has quit IRC14:36
admin0stuck @ ceph-mon : collect admin and bootstrap keys14:39
*** indistylo has joined #openstack-ansible14:42
*** mxevgenis has joined #openstack-ansible14:43
mxevgenishello everyone! I managed to deploy the OpenStack Queens using the Ansible deplyment guide. As the backend for nova, cinder and glance i use CEPH. After i successfully executed the playbooks i succesfully created an image but i cannot create an instance or a volume. The nova-compute services is going down as soon as i try to create an instance. Do you have any idea what is wrong? I believe the problem is related to the com14:43
*** mattinator has joined #openstack-ansible14:46
guilhermespmxevgenis you need to check the logs from your nova-compute. What can you see there?14:48
*** taseer3 has joined #openstack-ansible14:52
*** taseer2 has quit IRC14:52
*** taseer4 has joined #openstack-ansible14:53
mxevgenisfrom what i am seeing, when i try to create an instance, a storage device is going to be created, but it occurs an error related to sql alchemy14:55
*** mattinator has quit IRC14:56
mxevgenisI deleted the instance and i tried to create a new one, but it is in Spawning state continuously14:57
*** taseer3 has quit IRC14:57
*** mattinator has joined #openstack-ansible14:58
*** poul has joined #openstack-ansible14:58
*** tux_ has quit IRC15:04
*** mattinator has quit IRC15:06
*** mattinator has joined #openstack-ansible15:10
*** gkadam has quit IRC15:11
*** lbragstad has quit IRC15:13
*** oanson has quit IRC15:30
admin0mxevgenis, did allplaybooks ran OK ?15:31
*** oanson has joined #openstack-ansible15:33
mxevgenisyes i had no problem15:36
mxevgenisafter running th playbooks i logged in an i faced that issue. i have no problem on creating users,project or networks. r 1 attempts. And its status is error. 2018-07-20 01:11:42.545 128814 ERROR nova.compute.manager [instance: 72ce0156-88ee-4533-9a0d-0e81c85a535c] Traceback (most recent call last): 2018-07-20 01:11:42.545 128814 ERROR nova.compute.manager [instance: 72ce0156-88ee-4533-9a0d-0e81c85a535c]   File "/openstack/15:38
admin0paste in pastebin15:38
mxevgenisok15:38
mxevgenisthis is the link : https://pastebin.com/r407Krsj15:41
*** strobelight has joined #openstack-ansible15:42
*** strobelight_ has joined #openstack-ansible15:46
*** strobelight is now known as Guest3257515:46
*** strobelight_ is now known as strobelight15:47
admin0mxevgenis, from your mon, is ceph df, ceph osd tree, ceph health etc all commands are fine ?15:47
*** Guest32575 has quit IRC15:50
mxevgenisthe link shows the result of those commands: https://pastebin.com/mebA3w8i15:51
mxevgenismy ceph mon runs on the ceph mon container15:51
mxevgenishowever, the logs of the cinder service are full of errors regarding the sqlalchemy15:54
*** EvilienM is now known as EmilienM15:54
mxevgenisadmin0: do you believe that the cause of these failures is the configuration of CEPH?15:55
*** cshen has joined #openstack-ansible15:57
*** cshen has quit IRC16:02
admin0your setup did not run successsfully16:06
admin0disk issue ?16:06
mxevgenisi think that my disks are ok. However, when i try to run the ceph -s command form my compute i get thois error : 2018-07-21 19:11:37.988174 7f446aced700 -1 auth: unable to find a keyring on /etc/ceph/ceph.client.admin.keyring,/etc/ceph/ceph.keyring,/etc/ceph/keyring,/etc/ceph/keyring.bin,: (2) No such file or directory 2018-07-21 19:11:37.992531 7f446aced700 -1 monclient: authenticate NOTE: no keyring found; disabled cephx16:12
mxevgenisso i think that my compute node cannot communicate properly with the ceph mon16:12
mxevgenisadmin0: do you think that this is the source of the problem. I have created another openstack in different infrastructure with ocata and cinder backend and i had no problem.16:13
*** epalper has joined #openstack-ansible16:14
*** cshen has joined #openstack-ansible16:27
*** coreywright has quit IRC16:28
*** v1a4 has quit IRC16:30
*** klippo has quit IRC16:33
*** klippo has joined #openstack-ansible16:33
*** epalper has quit IRC16:45
*** coreywright has joined #openstack-ansible16:46
*** cshen has quit IRC16:54
*** tux_ has joined #openstack-ansible16:56
tux_admin0: make sure you have br-storage network on OSA deployment node because it use that interface to deploy keys16:57
tux_from where you are running all ansible playbook16:58
*** cshen has joined #openstack-ansible17:08
mxevgenistux_: i am running these playbooks from a deployment server17:13
*** strobelight has quit IRC17:14
*** strobelight has joined #openstack-ansible17:14
*** cshen has quit IRC17:16
mxevgenistux_: my deployment uses 1 controller and 1 compute. the storage interface of the controller is in bridge mode and with no ip, while the storage node has an ip. My deployment is based on this:https://docs.openstack.org/openstack-ansible/queens/user/ceph/full-deploy.html17:18
tux_mxevgenis: you have to dig into logs etc.. its hard to say anything without error17:21
admin0tux_, its there17:22
admin0br-storage17:22
admin0mxevgenis, yesterday i did a osa+ceph and it worked fine ( except some networking mix-match ) but functionality wise it was fine17:22
admin0tux_, i moved my br-mgmt to the 40gb now on a different vlan tag :)17:23
mxevgenisadmin0: did you follow the same guide?17:23
admin0mxevgenis, yes17:24
admin0tux_, in the config on the ceph-osd_hosts, do you give mgmt ip or storage ip .. ?17:25
tux_br-mgmt17:25
admin0ok17:25
tux_i put br-mgmt every single node so all code deployment use br-mgmt interface even in OSD node also17:26
mxevgenisthe error i get on the compute node is displayed here: https://pastebin.com/tUFCjUTq17:30
tux_mxevgenis: does your cinder-volume running and talking ceph? look like all short or issue going on from that logs17:37
mxevgenistux_: that is why i am stacked. No the cinder-colume is down. Do you think it would be more reasonable to destroy whatever i have deployed and start over?17:39
tux_did your of your playbook ran successful ?17:40
tux_i meant did you get any failed playbook during deployment?17:40
tux_most complicated part in OSA is network, your network is correct then everything should work expected so please make sure your network is right17:41
mxevgenistux_: i didnot had any failed playbooks, that is why i am confused with this problem. Regarding the networking i have configured the interfaces properly and the vlans also on my switch. if you want i could share the /etc/network/interfaces of my controller and my compute node.17:45
tux_totally i trust you17:46
admin0i put every br into every node :D17:48
admin0so that i can play around them later17:48
tux_I am stuck in ceph-ansible at lvm scenario17:50
tux_are you using lvm scenario for bluestore ?17:50
tux_admin0: ^^17:50
admin0no .. total disks17:57
admin0full disks17:57
*** laztoum has joined #openstack-ansible17:58
*** laztoum has quit IRC17:58
*** mattinator has quit IRC18:02
*** Bhujay has quit IRC18:03
*** tux_ has quit IRC18:06
*** tux_ has joined #openstack-ansible18:15
*** mxevgenis has quit IRC18:16
tux_but if you are using bluestore then its recommended method is to use lvm18:16
tux_admin0: ^18:16
*** poul has quit IRC18:16
*** poul has joined #openstack-ansible18:22
*** mattinator has joined #openstack-ansible18:23
*** MasterofJOKers has quit IRC18:23
*** MasterofJOKers has joined #openstack-ansible18:26
*** poul has quit IRC18:27
admin0tux_, .. if i have to reodo ceph .. do i need to destory the osds ?18:28
admin0for some reasons, i am always stuck at ceph-mon : collect admin and bootstrap keys .. would old configs on osd be of an issue18:28
tux_i think it will create issue related auth key etc.. i am not 100% sure but i would prefer clean installation18:30
tux_did you try -vvv with debug mode and see why its getting stuck?18:31
admin0how do I clean an osd ..18:32
admin0remove the disk partitions ?18:32
tux_yes just like fresh disk18:32
*** cshen has joined #openstack-ansible18:32
tux_also do yum remove ceph-* also, so it get re-install fresh18:32
*** poul has joined #openstack-ansible18:39
*** poul has quit IRC18:44
admin0did all .. retrying18:45
tux_I just deploy without lvm and my ceph is up and attached to openstack18:47
tux_later i will work on lvm and move OSD to lvm18:47
*** cshen has quit IRC18:49
admin0why that extra layer of complexity  ?18:49
tux_https://www.mail-archive.com/ceph-users@lists.ceph.com/msg46768.html18:51
tux_Ceph think this is the best way to go, i am also learning why18:52
*** strobelight has quit IRC18:57
*** cshen has joined #openstack-ansible19:08
*** indistylo has quit IRC19:26
admin0tux_,  to add new osd disks, how do you do ? just run ceph-install playbook ?19:31
admin0or is there more19:31
admin0when a change is made to the osds19:31
*** poul has joined #openstack-ansible19:31
tux_yup, just ceph-install.yml  or you can specific --limit osd1  or whatever19:32
*** tosky has joined #openstack-ansible19:34
*** poul has quit IRC19:35
openstackgerritMerged openstack/openstack-ansible-os_tempest master: Remove the unnecessary space  https://review.openstack.org/58277119:48
*** poul has joined #openstack-ansible19:48
*** poul has quit IRC19:52
*** poul has joined #openstack-ansible19:57
*** poul has quit IRC20:01
*** tux_ has quit IRC20:25
openstackgerritMohammed Naser proposed openstack/openstack-ansible-os_cinder master: Add target_helper to backend_defaults  https://review.openstack.org/58460420:37
*** poul has joined #openstack-ansible20:41
*** poul has quit IRC20:46
openstackgerritMerged openstack/openstack-ansible master: Add support for using distribution packages for OpenStack services  https://review.openstack.org/57977021:13
*** poul has joined #openstack-ansible21:33
*** poul has quit IRC21:37
*** dave-mccowan has joined #openstack-ansible21:38
*** jbadiapa_ has joined #openstack-ansible21:38
*** jbadiapa has quit IRC21:41
*** poul has joined #openstack-ansible21:42
*** poul has quit IRC21:47
*** poul has joined #openstack-ansible21:59
*** v1a4 has joined #openstack-ansible22:01
*** v1a4 has quit IRC22:02
*** poul has quit IRC22:03
*** poul has joined #openstack-ansible22:16
*** cshen has quit IRC22:18
*** cshen has joined #openstack-ansible22:19
*** poul has quit IRC22:20
*** poul has joined #openstack-ansible22:33
*** poul has quit IRC22:38
openstackgerritLogan V proposed openstack/openstack-ansible-galera_server master: Remove deprecated python-software-properties  https://review.openstack.org/58460922:49
openstackgerritLogan V proposed openstack/openstack-ansible-galera_client master: Remove bionic workaround  https://review.openstack.org/58461022:52
openstackgerritLogan V proposed openstack/openstack-ansible-galera_client master: Remove bionic workaround  https://review.openstack.org/58461022:53
openstackgerritLogan V proposed openstack/openstack-ansible-galera_client master: Bump MariaDB minor version release  https://review.openstack.org/58461122:56
openstackgerritLogan V proposed openstack/openstack-ansible-galera_server master: Bump MariaDB minor version release  https://review.openstack.org/58461222:57
*** kstev has joined #openstack-ansible23:07
*** poul has joined #openstack-ansible23:17
*** poul has quit IRC23:21
*** parasitid has quit IRC23:30
*** poul has joined #openstack-ansible23:34
*** poul has quit IRC23:38
*** Adri2000 has quit IRC23:38
*** kstev has quit IRC23:43
*** Adri2000 has joined #openstack-ansible23:44
*** parasitid has joined #openstack-ansible23:45
*** cshen has quit IRC23:49
*** poul has joined #openstack-ansible23:51
*** tosky has quit IRC23:54
*** poul has quit IRC23:56

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!