*** achanda has quit IRC | 00:01 | |
*** diogogmt has quit IRC | 00:03 | |
*** gfidente has quit IRC | 00:05 | |
*** SourabhP has quit IRC | 00:14 | |
*** dwalsh has joined #kolla | 00:36 | |
*** slagle has joined #kolla | 00:47 | |
*** dims_ has joined #kolla | 00:48 | |
*** weiyu has joined #kolla | 00:59 | |
*** banix has joined #kolla | 01:06 | |
*** zhiwei has joined #kolla | 01:06 | |
*** walters has joined #kolla | 01:07 | |
*** dwalsh has quit IRC | 01:15 | |
*** erkules_ has joined #kolla | 01:21 | |
*** erkules has quit IRC | 01:24 | |
openstackgerrit | XiaBing Yao proposed openstack/kolla: Update git clone address in doc/dev-quickstart.rst https://review.openstack.org/223366 | 01:33 |
---|---|---|
*** vilobhmm_11 has quit IRC | 01:48 | |
*** dims_ has quit IRC | 02:11 | |
*** loth has quit IRC | 02:17 | |
*** banix has quit IRC | 02:21 | |
*** rhallisey has quit IRC | 02:22 | |
*** unicell has quit IRC | 02:26 | |
*** achanda has joined #kolla | 02:27 | |
*** diogogmt has joined #kolla | 02:37 | |
*** klint has joined #kolla | 02:40 | |
*** jasonsb has joined #kolla | 02:43 | |
*** jasonsb has quit IRC | 02:46 | |
*** banix has joined #kolla | 02:47 | |
*** weiyu has quit IRC | 02:57 | |
*** weiyu has joined #kolla | 02:59 | |
*** vilobhmm_11 has joined #kolla | 02:59 | |
*** tfukushima has joined #kolla | 02:59 | |
SamYaple | pbourke: around yea | 03:05 |
*** diogogmt has quit IRC | 03:10 | |
*** diogogmt has joined #kolla | 03:11 | |
*** dims_ has joined #kolla | 03:12 | |
*** jasl8r1 has quit IRC | 03:18 | |
*** dims_ has quit IRC | 03:19 | |
*** jasl8r has joined #kolla | 03:22 | |
*** jerryz has quit IRC | 03:26 | |
*** daneyon_ has joined #kolla | 03:27 | |
*** apmelton has quit IRC | 03:28 | |
*** daneyon has quit IRC | 03:28 | |
*** apmelton has joined #kolla | 03:31 | |
*** banix has quit IRC | 03:32 | |
*** weiyu has quit IRC | 03:42 | |
*** apmelton has quit IRC | 03:42 | |
*** kjelly has joined #kolla | 03:44 | |
*** apmelton has joined #kolla | 03:45 | |
*** weiyu has joined #kolla | 03:52 | |
*** achanda has quit IRC | 03:52 | |
*** dayou has joined #kolla | 03:59 | |
*** jasl8r has quit IRC | 04:03 | |
*** achanda has joined #kolla | 04:05 | |
*** achanda has quit IRC | 04:11 | |
*** dims_ has joined #kolla | 04:16 | |
*** achanda has joined #kolla | 04:21 | |
*** dims_ has quit IRC | 04:22 | |
*** achanda has quit IRC | 04:27 | |
*** weiyu has quit IRC | 04:35 | |
*** unicell has joined #kolla | 04:41 | |
*** SourabhP has joined #kolla | 04:47 | |
*** SourabhP_ has joined #kolla | 04:51 | |
*** SourabhP has quit IRC | 04:54 | |
*** SourabhP_ is now known as SourabhP | 04:54 | |
*** diga has joined #kolla | 04:55 | |
*** SourabhP has quit IRC | 05:03 | |
*** SourabhP_ has joined #kolla | 05:03 | |
*** coolsvap has joined #kolla | 05:15 | |
openstackgerrit | Martin André proposed openstack/kolla: Make kolla-ansible work in pip installed kolla https://review.openstack.org/223407 | 05:48 |
*** vilobhmm_11 has quit IRC | 05:57 | |
openstackgerrit | Martin André proposed openstack/kolla: Prepare for vagrant-based AIO dev environment https://review.openstack.org/223410 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Allow configuring number of nodes in Vagrantfile https://review.openstack.org/223411 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Libvirt provider for Vagrant https://review.openstack.org/223412 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Use NFS sharing, it's a lot faster https://review.openstack.org/223413 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Reuse kolla working dir from host in operator https://review.openstack.org/223414 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Increase size of operator to allow building images https://review.openstack.org/223415 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Preconfigure Kolla to work out of the box https://review.openstack.org/223416 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Default vagrant deployment to AIO https://review.openstack.org/223417 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Add vagrant-generated files to gitignore https://review.openstack.org/223418 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Set namespace to point to local registry https://review.openstack.org/223419 | 06:02 |
openstackgerrit | Martin André proposed openstack/kolla: Update documentation for Vagrant environment https://review.openstack.org/223420 | 06:02 |
*** weiyu has joined #kolla | 06:04 | |
*** vilobhmm_11 has joined #kolla | 06:04 | |
sdake | mandre been busy :) | 06:10 |
mandre | yeah, it was a bit of a pain to setup a dev environment on a new machine, now 2 commands and boom... a working environment | 06:12 |
sdake | is that work finished then after it makes it through review? | 06:12 |
mandre | yup, the final commit implements the blueprint | 06:13 |
sdake | mandre please set blueprint to in review https://blueprints.launchpad.net/kolla/+spec/vagrant-improvements | 06:14 |
sdake | or needs review whichever it is | 06:14 |
sdake | just watched taken 3 | 06:15 |
sdake | liam niesen makes a pretty good fighter for an old cat :) | 06:15 |
*** zhiwei has quit IRC | 06:20 | |
mandre | that's what I heard, haven't seen any of the taken movies | 06:22 |
*** shardy has joined #kolla | 06:22 | |
*** coolsvap_ has joined #kolla | 06:24 | |
sdake | mandre forgive me but i have been making a heavy attempt to remove pronouns from our documentation | 06:27 |
sdake | you add a whole slew of them which is going in the wrong direction :) | 06:27 |
mandre | sdake discovered i suck at writing documentation | 06:28 |
sdake | nah it was good effort ;) | 06:28 |
mandre | please add your comments to the code review ;) | 06:29 |
sdake | writing docs is ass hard as writing good code | 06:29 |
sdake | i did | 06:29 |
*** vilobhmm_11 has quit IRC | 06:32 | |
sdake | mandre is 40gb really enough (did you test aio on libvirt?) | 06:32 |
mandre | it's more than enough, my centos-source images take about 1.6GB, and I still have 27GB available on my AIO VM | 06:35 |
sdake | mandre also i left a note my 3 control node setup takes 8gb per control node on bare metal | 06:39 |
sdake | i left a comment and approved the patch, but you may want to investigate it at some future point | 06:39 |
openstackgerrit | Merged openstack/kolla: Prepare for vagrant-based AIO dev environment https://review.openstack.org/223410 | 06:49 |
openstackgerrit | Merged openstack/kolla: Allow configuring number of nodes in Vagrantfile https://review.openstack.org/223411 | 06:49 |
openstackgerrit | Merged openstack/kolla: Libvirt provider for Vagrant https://review.openstack.org/223412 | 06:49 |
*** coolsvap_ has quit IRC | 06:49 | |
openstackgerrit | Merged openstack/kolla: Use NFS sharing, it's a lot faster https://review.openstack.org/223413 | 06:49 |
openstackgerrit | Merged openstack/kolla: Reuse kolla working dir from host in operator https://review.openstack.org/223414 | 06:49 |
*** unicell1 has joined #kolla | 07:01 | |
*** unicell has quit IRC | 07:03 | |
*** alisonh has quit IRC | 07:04 | |
*** achanda has joined #kolla | 07:06 | |
*** inc0 has joined #kolla | 07:12 | |
inc0 | good morning | 07:14 |
SamYaple | morning inc0 | 07:15 |
SamYaple | congrats on the married thing | 07:15 |
inc0 | thanks:) | 07:15 |
*** weiyu has quit IRC | 07:16 | |
inc0 | SamYaple, we need to talk how to do optional bindmounting | 07:18 |
inc0 | after we removed inheritance from start tasks, this will be horrible thing to do... | 07:18 |
SamYaple | nah its a simple variable change, not a problem | 07:19 |
SamYaple | we need to figure out how to log each service to a single file | 07:19 |
SamYaple | thats the part we have no code for | 07:19 |
inc0 | we do | 07:19 |
SamYaple | im just waiting for that to do the optional bindmounting everywhere | 07:19 |
*** weiyu has joined #kolla | 07:19 | |
SamYaple | oh i didnt see any | 07:19 |
SamYaple | do yo uhave a link? | 07:19 |
inc0 | https://review.openstack.org/#/c/215062/14/ansible/roles/common/templates/rsyslog.conf.j2 | 07:20 |
inc0 | we can do all sort of filtering magic based on sender tag | 07:20 |
inc0 | this seems to work | 07:20 |
*** alisonh has joined #kolla | 07:20 | |
SamYaple | right but i dont see any service where you have implemented this is my point | 07:21 |
SamYaple | we need that code up for review and testing | 07:21 |
inc0 | kolla ansible | 07:21 |
inc0 | is implemented | 07:21 |
inc0 | this has logs and it's there | 07:21 |
inc0 | I can do keystone quickly if you want | 07:22 |
SamYaple | i mean like nova-api and neutron-server kind of thing | 07:22 |
SamYaple | kolla_ansible has no logs | 07:22 |
*** achanda has quit IRC | 07:22 | |
inc0 | actually it does:) | 07:22 |
inc0 | try to run it | 07:22 |
inc0 | it will produce logs to rsyslog | 07:23 |
SamYaple | we dont want al lthe system logs though... | 07:23 |
SamYaple | we want the services to log to syslog | 07:24 |
*** weiyu has quit IRC | 07:24 | |
SamYaple | i mean kolla_ansible just sleeps, it shouldn't be logging anything | 07:24 |
inc0 | when it's creating endpoints and such (and logging is up by then) it logs | 07:25 |
*** achanda has joined #kolla | 07:25 | |
inc0 | so you get some logs during deployment and that's it | 07:25 |
SamYaple | what does it log when its creating endpoints? my modules do no logging | 07:25 |
SamYaple | ansible modules dont log like that | 07:25 |
SamYaple | im confused i guess | 07:26 |
SamYaple | do you have a sample of what its 'logging'? | 07:26 |
*** 7JTAAOHLN has joined #kolla | 07:26 | |
inc0 | not with me right now, but I can get it later today if you want | 07:26 |
inc0 | or simply try to do quick aio with this one | 07:26 |
inc0 | and look at log | 07:26 |
SamYaple | yea thats fine. im not worried. we can dig through it later | 07:27 |
SamYaple | im more concerned about the changes needed to the openstack services and having a sample of those setup | 07:27 |
inc0 | well, it will require a bit of conf change | 07:28 |
inc0 | but I'll play with it later today | 07:28 |
SamYaple | yep, thats what i want to see so we can test that and make sure that logs the way we want | 07:29 |
inc0 | fair enough | 07:29 |
*** 7JTAAOHLN has quit IRC | 07:30 | |
openstackgerrit | Merged openstack/kolla: Increase size of operator to allow building images https://review.openstack.org/223415 | 07:32 |
*** itsuugo has joined #kolla | 07:32 | |
*** itsuugo has quit IRC | 07:33 | |
*** SourabhP has joined #kolla | 07:33 | |
*** itsuugo has joined #kolla | 07:34 | |
*** weiyu has joined #kolla | 07:35 | |
*** SourabhP_ has quit IRC | 07:36 | |
*** SourabhP has quit IRC | 07:39 | |
*** achanda has quit IRC | 07:41 | |
*** inc0 has quit IRC | 07:43 | |
*** jmccarthy has quit IRC | 07:43 | |
*** kjelly has quit IRC | 07:44 | |
*** jmccarthy has joined #kolla | 07:44 | |
openstackgerrit | Martin André proposed openstack/kolla: Update documentation for Vagrant environment https://review.openstack.org/223420 | 07:48 |
openstackgerrit | Martin André proposed openstack/kolla: Set namespace to point to local registry https://review.openstack.org/223419 | 07:48 |
openstackgerrit | Martin André proposed openstack/kolla: Add vagrant-generated files to gitignore https://review.openstack.org/223418 | 07:48 |
openstackgerrit | Martin André proposed openstack/kolla: Default vagrant deployment to AIO https://review.openstack.org/223417 | 07:48 |
openstackgerrit | Martin André proposed openstack/kolla: Preconfigure Kolla to work out of the box https://review.openstack.org/223416 | 07:48 |
*** Haomeng has joined #kolla | 07:53 | |
*** Haomeng|2 has quit IRC | 07:56 | |
*** kjelly has joined #kolla | 07:57 | |
*** gfidente has joined #kolla | 08:00 | |
*** sdake has quit IRC | 08:07 | |
*** itsuugo has quit IRC | 08:11 | |
pbourke | SamYaple: morning | 08:13 |
pbourke | SamYaple: two quick questions... 1) we need ansible 2.0 for some openstack modules right? if I wanted to pin to a tag do you know would v2.0.0-0.2.alpha2 be enough? 2) do you have a link to the bug in docker registry where it pushes all layers (ignores caching so it takes forever) | 08:15 |
*** itsuugo has joined #kolla | 08:19 | |
*** dims_ has joined #kolla | 08:20 | |
SamYaple | pbourke: yea we can pin to that alpha tag. not a big deal. its working now after all and the shade stuff wont be done in time anyway :/ | 08:24 |
pbourke | SamYaple: yeah we can leave it as is for now, just checking | 08:27 |
pbourke | thanks | 08:27 |
SamYaple | i would like to pin it before rc1 to be honest | 08:27 |
SamYaple | but we can wait until then | 08:27 |
SamYaple | pbourke: https://github.com/docker/docker/pull/15493 | 08:28 |
SamYaple | looks like its fixed in docker 1.8.2 :) | 08:29 |
SamYaple | oh :( | 08:29 |
SamYaple | nvm just 1.9.0 | 08:29 |
SamYaple | pbourke: either way the issue is fixed in master right now it would seem | 08:31 |
*** athomas has joined #kolla | 08:32 | |
pbourke | SamYaple: awesome thanks again! | 08:33 |
*** chandankumar has joined #kolla | 08:46 | |
*** dims_ has quit IRC | 08:53 | |
*** itsuugo has quit IRC | 09:09 | |
*** pbourke has quit IRC | 09:09 | |
*** pbourke has joined #kolla | 09:10 | |
*** dayou has quit IRC | 09:16 | |
*** itsuugo has joined #kolla | 09:23 | |
*** diga has quit IRC | 09:26 | |
*** bradjones|away has quit IRC | 09:47 | |
*** bradjones has joined #kolla | 09:49 | |
*** bradjones has quit IRC | 09:49 | |
*** bradjones has joined #kolla | 09:49 | |
*** dims_ has joined #kolla | 09:52 | |
*** dims_ has quit IRC | 09:57 | |
*** diga has joined #kolla | 10:34 | |
*** diga has quit IRC | 10:40 | |
*** dims_ has joined #kolla | 10:44 | |
*** tfukushima has quit IRC | 10:53 | |
*** dayou has joined #kolla | 10:56 | |
*** itsuugo has quit IRC | 10:56 | |
*** itsuugo has joined #kolla | 11:02 | |
*** weiyu has quit IRC | 11:03 | |
*** sdake has joined #kolla | 11:25 | |
mduggan1 | rhallisey: Sorry if this is going over the same ground as yesterday but I was a little confused by your reply to vbel's question. So I'll try again :-) | 11:27 |
mduggan1 | Are the issues that are blocking LVM, iSCSI & NFS functioning of the dockerised cinder services, at present, issues within the docker containers themselves or are they problems with ansible being able to configure and deploy the cinder containers ? | 11:27 |
mduggan1 | A secondary question is which cinder service are broken ? | 11:27 |
*** itsuugo has quit IRC | 11:27 | |
sdake | cinder is busted | 11:27 |
*** sdake_ has joined #kolla | 11:30 | |
pbourke | ... | 11:31 |
*** sdake has quit IRC | 11:31 | |
*** itsuugo has joined #kolla | 11:36 | |
*** shardy_ has joined #kolla | 11:36 | |
SamYaple | has cinder ever worked? | 11:36 |
*** rhallisey has joined #kolla | 11:36 | |
vbel | we have kolla cinder docs in openstack.org | 11:36 |
vbel | cinder-api works :) | 11:37 |
*** shardy has quit IRC | 11:37 | |
*** athomas_ has joined #kolla | 11:39 | |
*** shardy_ has quit IRC | 11:41 | |
*** shardy has joined #kolla | 11:42 | |
*** athomas has quit IRC | 11:42 | |
*** itsuugo has quit IRC | 11:48 | |
*** dayou has quit IRC | 11:52 | |
*** akwasnie has joined #kolla | 11:53 | |
*** coolsvap_ has joined #kolla | 11:56 | |
rhallisey | vbel, I think the issue is doing the volume attach | 11:57 |
vbel | rhallisey: when using lvm? or in general? | 11:58 |
rhallisey | vbel, in general, doing a nova volume attach | 11:58 |
vbel | rhallisey: I see, thanks | 11:58 |
SamYaple | vbel: well not in general in general, it works fine for ceph | 11:59 |
*** chandankumar has quit IRC | 11:59 | |
rhallisey | ok haven't used ceph yet | 12:03 |
*** dwalsh has joined #kolla | 12:06 | |
*** Haomeng|2 has joined #kolla | 12:07 | |
rhallisey | SamYaple, got a minute? | 12:08 |
SamYaple | rhallisey: dont worry the code isnt up yet | 12:08 |
SamYaple | rhallisey: sure | 12:08 |
SamYaple | well its mostly up | 12:09 |
rhallisey | so there's a problem with putting the json config stuff in /opt/kolla/<service> | 12:09 |
SamYaple | yea we just need to have a generic moutpoint location | 12:09 |
rhallisey | if I go back to that again I need a way to identify where I'm looking for the json config | 12:09 |
SamYaple | ive been pushing that for a while | 12:09 |
SamYaple | in the container '/opt/kolla/configs/config.json' or something | 12:09 |
rhallisey | by that you mean everything, config and json config in one location? | 12:10 |
SamYaple | well that, yes but no thats not what i meant | 12:10 |
SamYaple | mountpoint would lookl ike this: | 12:10 |
*** Haomeng has quit IRC | 12:10 | |
SamYaple | /etc/kolla/mariadb/:/opt/kolla/configs/ | 12:10 |
rhallisey | ok that's fine | 12:10 |
SamYaple | /etc/kolla/rabbitmq/:/opt/kolla/configs/ | 12:10 |
SamYaple | like that | 12:10 |
rhallisey | I just can't have /opt/koll/<service? | 12:10 |
rhallisey | ok that works | 12:10 |
SamYaple | yea i totally get that | 12:10 |
rhallisey | ok I understand the comment | 12:11 |
SamYaple | thats what i was trying to say back when you were exporting the service name | 12:11 |
SamYaple | sorry i comment right when i wake up and i am not always coherent | 12:11 |
SamYaple | thats my fault | 12:11 |
rhallisey | SamYaple, no worries man | 12:11 |
rhallisey | also with the ubuntu issue for mariadb.. what would that dir be? | 12:12 |
SamYaple | i dont know, its probably in config-external.sh though | 12:12 |
*** athomas_ has quit IRC | 12:13 | |
openstackgerrit | Merged openstack/kolla: Make kolla-ansible work in pip installed kolla https://review.openstack.org/223407 | 12:17 |
openstackgerrit | Merged openstack/kolla: Preconfigure Kolla to work out of the box https://review.openstack.org/223416 | 12:17 |
openstackgerrit | Merged openstack/kolla: Default vagrant deployment to AIO https://review.openstack.org/223417 | 12:17 |
openstackgerrit | Merged openstack/kolla: Add vagrant-generated files to gitignore https://review.openstack.org/223418 | 12:18 |
*** jasl8r has joined #kolla | 12:20 | |
*** diogogmt has quit IRC | 12:21 | |
*** itsuugo has joined #kolla | 12:22 | |
*** diogogmt has joined #kolla | 12:22 | |
*** athomas has joined #kolla | 12:24 | |
*** athomas has quit IRC | 12:25 | |
*** sdake_ has quit IRC | 12:30 | |
*** shardy_ has joined #kolla | 12:38 | |
*** shardy has quit IRC | 12:39 | |
*** weiyu has joined #kolla | 12:39 | |
*** itsuugo has quit IRC | 12:42 | |
vbel | nova-novncproxy does not work | 12:42 |
vbel | ADD nova-novncproxy-archive /usr/share/nova-novncproxy-source | 12:42 |
vbel | RUN cd /usr/share && ln -s nova-novncproxy-source/* novnc | 12:42 |
vbel | with the last statement we have link that does not find source | 12:42 |
vbel | because of cd ... | 12:43 |
*** shardy_ has quit IRC | 12:43 | |
*** itsuugo has joined #kolla | 12:43 | |
*** shardy has joined #kolla | 12:44 | |
vbel | 1 sec, why .. | 12:44 |
*** banix has joined #kolla | 12:45 | |
vbel | ignore me for the moment :) looks like my image is outdated | 12:51 |
*** dwalsh has quit IRC | 12:55 | |
*** klint has quit IRC | 12:58 | |
*** jruano has joined #kolla | 12:59 | |
*** chandankumar has joined #kolla | 13:00 | |
*** chandankumar has quit IRC | 13:03 | |
*** itsuugo has quit IRC | 13:13 | |
*** weiyu has quit IRC | 13:15 | |
*** banix has quit IRC | 13:16 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file https://review.openstack.org/216874 | 13:18 |
*** coolsvap_ has quit IRC | 13:19 | |
*** dims_ has quit IRC | 13:21 | |
*** dims_ has joined #kolla | 13:22 | |
*** itsuugo has joined #kolla | 13:23 | |
*** chandankumar has joined #kolla | 13:23 | |
*** walters has quit IRC | 13:23 | |
*** dwalsh has joined #kolla | 13:28 | |
*** jruano_ has joined #kolla | 13:34 | |
*** jruano has quit IRC | 13:38 | |
*** itsuugo has quit IRC | 13:47 | |
*** itsuugo has joined #kolla | 13:49 | |
*** Haomeng has joined #kolla | 13:54 | |
*** jtriley has joined #kolla | 13:54 | |
*** Haomeng|2 has quit IRC | 13:57 | |
*** jasonamyers has joined #kolla | 13:57 | |
*** jruano_ has quit IRC | 14:04 | |
*** itsuugo has quit IRC | 14:09 | |
*** jtriley has quit IRC | 14:09 | |
*** diogogmt has quit IRC | 14:17 | |
*** itsuugo has joined #kolla | 14:21 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file https://review.openstack.org/216874 | 14:25 |
*** banix has joined #kolla | 14:28 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Galera https://review.openstack.org/217880 | 14:29 |
rhallisey | SamYaple, I'm having trouble testing because of https://bugs.launchpad.net/kolla/+bug/1491782 | 14:30 |
openstack | Launchpad bug 1491782 in kolla "Fail to create haproxy mysql user" [Critical,Triaged] | 14:30 |
rhallisey | can't get past keystone | 14:30 |
*** achanda has joined #kolla | 14:30 | |
rhallisey | any idea's to work around this? disabling haproxy is not it | 14:30 |
*** achanda has quit IRC | 14:31 | |
jpeeler | rhallisey: i believe i one time added a when: not enabled_haproxy | bool, or something like that in register.yml | 14:32 |
jpeeler | obviously, that only helps if you disable haproxy | 14:33 |
rhallisey | jpeeler, does it get around that bug? | 14:33 |
rhallisey | how are you testing ironic? Are you seeing the same issue? | 14:33 |
rhallisey | this occurs 100% of the time in AIO master | 14:34 |
jpeeler | well, i'm not using haproxy because i honestly don't know how to configure it | 14:34 |
rhallisey | are you able to run AIO? | 14:35 |
jpeeler | yes, as of last week | 14:36 |
jpeeler | not looking at it right now though | 14:36 |
*** chandankumar has quit IRC | 14:39 | |
*** itsuugo has quit IRC | 14:41 | |
*** diogogmt has joined #kolla | 14:52 | |
*** walters has joined #kolla | 14:52 | |
*** achanda has joined #kolla | 14:58 | |
*** itsuugo has joined #kolla | 14:59 | |
*** vbel has quit IRC | 15:02 | |
*** vbel has joined #kolla | 15:03 | |
*** dayou has joined #kolla | 15:04 | |
*** achanda has quit IRC | 15:06 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Rabbitmq https://review.openstack.org/218496 | 15:19 |
*** dayou has quit IRC | 15:21 | |
*** itsuugo has quit IRC | 15:24 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Keystone https://review.openstack.org/218497 | 15:27 |
*** akwasnie has quit IRC | 15:29 | |
*** slagle has quit IRC | 15:30 | |
*** coolsvap has quit IRC | 15:31 | |
*** itsuugo has joined #kolla | 15:38 | |
*** unicell1 has quit IRC | 15:51 | |
*** jtriley has joined #kolla | 15:55 | |
*** vilobhmm_11 has joined #kolla | 15:59 | |
*** juggler has joined #kolla | 15:59 | |
*** slagle has joined #kolla | 16:04 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Glance https://review.openstack.org/218501 | 16:10 |
*** mduggan1 has quit IRC | 16:10 | |
*** mduggan has joined #kolla | 16:11 | |
*** itsuugo has quit IRC | 16:12 | |
*** chandankumar has joined #kolla | 16:17 | |
*** juggler has quit IRC | 16:25 | |
*** itsuugo has joined #kolla | 16:25 | |
*** SourabhP has joined #kolla | 16:26 | |
*** sdake has joined #kolla | 16:28 | |
*** juggler has joined #kolla | 16:28 | |
*** SourabhP_ has joined #kolla | 16:28 | |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Nova https://review.openstack.org/218505 | 16:30 |
*** daneyon_ has left #kolla | 16:31 | |
*** sdake_ has joined #kolla | 16:31 | |
*** SourabhP has quit IRC | 16:32 | |
*** SourabhP_ is now known as SourabhP | 16:32 | |
*** juggler_ has joined #kolla | 16:32 | |
sdake_ | samyaple around? | 16:33 |
*** juggler has quit IRC | 16:34 | |
*** sdake has quit IRC | 16:35 | |
*** juggler_ has quit IRC | 16:39 | |
sdake_ | morning folks | 16:40 |
*** unicell has joined #kolla | 16:40 | |
rhallisey | hye | 16:41 |
rhallisey | hey | 16:41 |
rhallisey | sdake_, I think config stuff is going well | 16:43 |
*** jtriley has quit IRC | 16:45 | |
*** vilobhmm_11 has quit IRC | 16:47 | |
*** itsuugo has quit IRC | 16:51 | |
*** chandankumar has quit IRC | 17:03 | |
*** itsuugo has joined #kolla | 17:06 | |
*** vilobhmm_11 has joined #kolla | 17:16 | |
*** jasonamyers has quit IRC | 17:19 | |
*** jerryz has joined #kolla | 17:20 | |
*** achanda has joined #kolla | 17:28 | |
*** sdake_ is now known as sdake | 17:33 | |
sdake | rhallisey sorry was afk | 17:33 |
sdake | that is good news, havey ou managedt o convert all of the containers that use ansible? | 17:33 |
sdake | rhallisey i changed the blueprint from needs review because the work isn't finished yet for needs review | 17:34 |
rhallisey | sdake, I have a few left, but there's a bigger issue... that haproxy is totally blocking me from testing | 17:34 |
sdake | needs review = the patches are in the queue | 17:34 |
sdake | arey ou able to reproduce that problem you have? | 17:34 |
rhallisey | ya just run AIO from master | 17:35 |
sdake | if so, I would be happy to work up a patch for you | 17:35 |
rhallisey | breaks every time | 17:35 |
sdake | rhallisey when I run on aio from master it works likea champ every time | 17:35 |
rhallisey | waa | 17:35 |
sdake | so i can't reproduce it | 17:35 |
rhallisey | on baremetal? | 17:35 |
sdake | but i can speculate as to what the problem is | 17:35 |
sdake | on bare metal | 17:35 |
rhallisey | https://bugs.launchpad.net/kolla/+bug/1491782 | 17:35 |
openstack | Launchpad bug 1491782 in kolla "Fail to create haproxy mysql user" [Critical,Triaged] | 17:35 |
sdake | 1 or 3 node controllers | 17:35 |
rhallisey | it's that bud | 17:35 |
rhallisey | bug | 17:35 |
sdake | ya - i'll submit a patch against it in 30 mins - could you test it? | 17:35 |
rhallisey | ya sure | 17:36 |
sdake | today? | 17:36 |
rhallisey | do you know what it is? | 17:36 |
rhallisey | ya for sure | 17:36 |
rhallisey | it's driving me crazy.. | 17:36 |
sdake | i htink haproxy+mariadb are not setup by the time they are accessed | 17:36 |
sdake | the proper thing to do is use wait_for prior to setting up the haproxy user | 17:36 |
sdake | let me double check the bug | 17:37 |
rhallisey | I've tried adding some waits.. maybe I did it incorrectly | 17:37 |
sdake | note that code is not using haproxy, it is accessessing the db directly | 17:37 |
sdake | wherei tsays creating haproxy user in the mariadb section, it connects directly to the database ip not the haproxy ip | 17:37 |
sdake | i did have a question, is your vm time set properly | 17:38 |
sdake | as in do you use ntp or set the time manually correctly? | 17:38 |
sdake | and is your vm single processor? | 17:39 |
rhallisey | I'm on baremetal | 17:39 |
sdake | oh interesting | 17:39 |
sdake | let me hack together a patch and test in my local environment | 17:40 |
rhallisey | ok thanks. That would help a lot | 17:40 |
*** loth has joined #kolla | 17:40 | |
*** sdake_ has joined #kolla | 17:41 | |
*** SourabhP has quit IRC | 17:42 | |
*** sdake has quit IRC | 17:44 | |
*** itsuugo has quit IRC | 17:47 | |
sdake_ | rhallisey you said it only happens on aio? | 17:53 |
sdake_ | have you tried multinode playbook? | 17:53 |
sdake_ | or inventory file i mean | 17:53 |
rhallisey | sdake_, haven't used it no | 17:53 |
sdake_ | ok, would you try it please? | 17:54 |
sdake_ | you have to modify the multinode inventory file to suit your machine name | 17:54 |
sdake_ | and your machine name must be in /etc/hosts | 17:54 |
sdake_ | this may be an issue only with AIO ansible_connection=local | 17:54 |
sdake_ | kolla-ansible deploy -i ansible/inventory/multinode after modifying the multinode file | 17:55 |
rhallisey | k | 17:55 |
sdake_ | do you have a firewall enabled on the machine? | 17:55 |
rhallisey | ya | 17:55 |
rhallisey | is this all in the multi node docs? | 17:56 |
sdake_ | after the deploy please test telnet localhost 3306 | 17:56 |
sdake_ | i am pretty sure my wait for solution wont work for you | 17:57 |
sdake_ | i think what is happening is ansible tries to connect to localhost3306 | 17:57 |
sdake_ | mariadb doesn't bind to the localhost, but the specific host ip | 17:57 |
sdake_ | rhallisey i'd like you to test now so i can get on with my day:) | 17:58 |
sdake_ | someone else reported this bug | 17:58 |
sdake_ | and i need you to help me debug it | 17:58 |
sdake_ | since i can't reproduce in my environment | 17:58 |
sdake_ | but I run sans firewall | 17:58 |
rhallisey | Trying ::1... | 17:58 |
rhallisey | telnet: connect to address ::1: Connection refused | 17:58 |
rhallisey | Trying 127.0.0.1... | 17:58 |
rhallisey | telnet: connect to address 127.0.0.1: Connection refused | 17:58 |
sdake_ | havey ou deployed already rhallisey ? | 17:59 |
sdake_ | it will definatelybe refused if you haven't deployed | 17:59 |
rhallisey | when am I doing the telnet after AIO or after multinode | 17:59 |
rhallisey | I'm confiused where we are here in testing | 18:00 |
rhallisey | which am I going with | 18:00 |
sdake_ | eithe one | 18:00 |
sdake_ | do aio | 18:00 |
rhallisey | k | 18:00 |
sdake_ | does aio EVER work? | 18:00 |
rhallisey | no, it use to | 18:01 |
rhallisey | this error would show up occasionally, now it shows everytimes | 18:01 |
rhallisey | everytime* | 18:01 |
sdake_ | same hardware? | 18:01 |
rhallisey | ya | 18:01 |
sdake_ | do this before deplloying | 18:02 |
sdake_ | inside kolla-ansible tool in the tools directory | 18:02 |
rhallisey | once I rebased last thusday I think | 18:02 |
sdake_ | where ansible is run | 18:02 |
*** jmccarthy has quit IRC | 18:02 | |
sdake_ | make sure to run ansible iwth -vvv flags | 18:02 |
sdake_ | you have to hack the script | 18:02 |
rhallisey | k | 18:03 |
sdake_ | i want to see what the login_host is set to | 18:03 |
rhallisey | wait what.. | 18:04 |
rhallisey | it worked | 18:04 |
rhallisey | hold on.. | 18:05 |
sdake_ | ok telnet localhost 3306 | 18:05 |
rhallisey | same error as above | 18:05 |
sdake_ | ok did you run with -vvv? | 18:05 |
rhallisey | ya | 18:06 |
rhallisey | it got past the haproxy user creation though | 18:06 |
sdake_ | ok so I can close the bug then or will you try again pls :) | 18:06 |
sdake_ | run ./cleanup-containers -fv | 18:06 |
rhallisey | ya I'll try again I'm just confused how this is happening :/ | 18:07 |
sdake_ | me too | 18:07 |
sdake_ | that is why we get paid the big bucks bro | 18:07 |
sdake_ | because we can fix all this sshit :) | 18:07 |
*** SourabhP has joined #kolla | 18:07 | |
sdake_ | let me ask did you have a deploy already active this time when you redeployed? | 18:07 |
rhallisey | no | 18:08 |
rhallisey | the difference is | 18:08 |
rhallisey | I was running the ansible command by hand | 18:08 |
sdake_ | what command did you type? | 18:09 |
rhallisey | sudo ansible-playbook -i inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml site.yml | 18:09 |
sdake_ | looks right | 18:09 |
sdake_ | pretty sure that is what the shell script does | 18:09 |
sdake_ | except the shell script doesn't run as sudo | 18:09 |
rhallisey | it is, 2x checking though | 18:09 |
sdake_ | did you run the shell script kolla-ansible with sudo? | 18:09 |
rhallisey | ya I did notice that | 18:09 |
rhallisey | did not run w/ sudo | 18:10 |
rhallisey | for shell script | 18:10 |
sdake_ | well duh :) | 18:10 |
sdake_ | you have to run as root user | 18:10 |
sdake_ | lets see if that is the issue | 18:10 |
sdake_ | cleanup-containers -fv | 18:10 |
sdake_ | and then lets try without the sudo | 18:10 |
rhallisey | no it seems like the opposite | 18:10 |
rhallisey | running with root wans't working | 18:10 |
sdake_ | oh running without root worked? | 18:11 |
rhallisey | ya | 18:11 |
rhallisey | hold on a sec. I want to run the old command again. This is confusing | 18:11 |
sdake_ | sorry i go fast when i debug | 18:11 |
sdake_ | i usually debug 4 or 5 things at a time and bisect | 18:11 |
rhallisey | no problem I'm sitting waiting for this stuff to run mostly | 18:12 |
rhallisey | ok running the old command again... | 18:12 |
rhallisey | which is: sudo ansible-playbook -i inventory/all-in-one -e @/etc/kolla/globals.yml -e @/etc/kolla/passwords.yml site.yml | 18:12 |
rhallisey | uh that's now working too.. what! O.o | 18:14 |
* rhallisey looks a recent merged patches | 18:15 | |
rhallisey | sdake_, Idk seems to work then. Oh well | 18:17 |
rhallisey | wfm | 18:17 |
rhallisey | still don't know what caused that.. | 18:17 |
sdake_ | are you running cleanup-containers -fv inbetween? | 18:17 |
rhallisey | ya | 18:17 |
rhallisey | sorry no | 18:17 |
rhallisey | I do | 18:17 |
rhallisey | docker ps -aq | docker rm -f | 18:17 |
rhallisey | docker ps -aq | xargs docker rm -f | 18:17 |
sdake_ | thats the same thing i think | 18:17 |
rhallisey | ya | 18:18 |
rhallisey | probably | 18:18 |
sdake_ | try again 2 more times pls | 18:18 |
rhallisey | worked on try 1.. | 18:21 |
rhallisey | I don't know what to say.. I still feel like whatever this was is still hanging around | 18:21 |
rhallisey | not sure though, seems to be working now | 18:22 |
*** shardy is now known as shardy_afk | 18:22 | |
rhallisey | seems to work, sdake_ close it | 18:23 |
rhallisey | sdake_, might have been the wait added in haproxy-ansible that fixed this | 18:24 |
rhallisey | weird though, added that and it still didn't work for me | 18:24 |
rhallisey | oh well | 18:24 |
sdake_ | did you try with both sudo and without sudo? | 18:45 |
*** sdake_ is now known as sdake | 18:45 | |
sdake | i am not keen to close it because several people have reported it | 18:45 |
sdake | could you add that master currently works for you and it did not previously? | 18:45 |
sdake | rhallisey ^^ | 18:45 |
rhallisey | sdake, ya I added some comments | 18:48 |
*** diogogmt has quit IRC | 18:51 | |
rhallisey | both sudo and non sudo worked | 18:51 |
*** diogogmt has joined #kolla | 18:52 | |
*** shardy_afk is now known as shardy | 19:18 | |
*** devlaps has joined #kolla | 19:51 | |
*** achanda has quit IRC | 20:01 | |
*** daneyon has joined #kolla | 20:17 | |
*** shardy has quit IRC | 20:29 | |
*** achanda has joined #kolla | 20:35 | |
*** achanda has quit IRC | 20:35 | |
*** achanda has joined #kolla | 20:35 | |
*** daneyon_ has joined #kolla | 20:36 | |
*** daneyon has quit IRC | 20:39 | |
*** rhallisey has quit IRC | 20:41 | |
*** dwalsh has quit IRC | 21:40 | |
*** gfidente has quit IRC | 21:55 | |
*** banix has quit IRC | 22:48 | |
*** jtriley has joined #kolla | 22:50 | |
*** sdake has quit IRC | 22:56 | |
*** openstackgerrit has quit IRC | 23:16 | |
*** openstackgerrit has joined #kolla | 23:16 | |
*** jtriley has quit IRC | 23:16 | |
jerryz | sdake: i built the image successfully but failed to push them to local private registry. http://paste.openstack.org/show/463696/ | 23:18 |
*** banix has joined #kolla | 23:21 | |
*** jtriley has joined #kolla | 23:51 | |
*** achanda_ has joined #kolla | 23:55 | |
*** banix has quit IRC | 23:56 | |
*** achanda_ has quit IRC | 23:57 | |
*** achanda has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!