*** sdake_ has joined #kolla | 00:02 | |
*** sdake has quit IRC | 00:03 | |
*** dwalsh has joined #kolla | 00:04 | |
*** sdake has joined #kolla | 00:05 | |
sdake | asalkeld ping | 00:05 |
---|---|---|
sdake | asalkeld kolla-mesos needs a tag ;) | 00:05 |
*** sdake_ has quit IRC | 00:07 | |
*** jtriley has joined #kolla | 00:15 | |
*** dwalsh has quit IRC | 00:16 | |
*** jtriley has quit IRC | 00:22 | |
*** salv-orlando has joined #kolla | 00:30 | |
*** salv-orlando has quit IRC | 00:40 | |
asalkeld | sdake: yeah thought i'd forgotten something | 00:43 |
*** vhosakot has joined #kolla | 00:44 | |
asalkeld | sdake: https://github.com/openstack/kolla-mesos/releases/tag/2.0.0.0b3 | 00:47 |
*** Jeffrey4l has joined #kolla | 00:52 | |
*** sbezverk has quit IRC | 00:52 | |
*** sbezverk has joined #kolla | 00:53 | |
Jeffrey4l | ruhe, yup. I made a mistake. should use self.useFixutre(self.conf) | 00:53 |
*** jtriley has joined #kolla | 00:54 | |
sdake | asalkeld tia | 00:58 |
*** alisonh has quit IRC | 00:58 | |
sdake | asalkeld gate job coming for this tox job https://review.openstack.org/#/c/290154/ | 00:59 |
sdake | as part of obtaining the security vulnerability managed tag | 00:59 |
asalkeld | sdake: why? | 00:59 |
asalkeld | why not just fix the issues | 00:59 |
asalkeld | and add to pep8 | 00:59 |
sdake | we will add them to pep8 once the gate passes reasonably | 01:00 |
asalkeld | *yet another tox target* | 01:00 |
asalkeld | wrong way around? | 01:00 |
sdake | the non-voting gate is temporary | 01:00 |
asalkeld | seems like a waste of time IMO - the temp gate | 01:00 |
sdake | mesos needs gates | 01:00 |
asalkeld | we really need functional / deployment gate | 01:01 |
*** phuongnh has joined #kolla | 01:03 | |
*** inc0 has quit IRC | 01:04 | |
sdake | yes we do | 01:04 |
sdake | we are leading the charge there with kolla proper | 01:04 |
*** vhosakot has quit IRC | 01:16 | |
*** vhosakot has joined #kolla | 01:17 | |
*** alisonh has joined #kolla | 01:18 | |
*** sdake has quit IRC | 01:20 | |
*** jasonsb has joined #kolla | 01:21 | |
*** iceyao has joined #kolla | 01:29 | |
*** tfukushima has joined #kolla | 01:30 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Copy the logs out of the container https://review.openstack.org/288541 | 01:35 |
*** iceyao_ has joined #kolla | 01:35 | |
*** iceyao has quit IRC | 01:39 | |
*** vhosakot has quit IRC | 01:41 | |
*** vhosakot has joined #kolla | 01:42 | |
ccesario | vhosakot, ping ? | 01:48 |
ccesario | http://sprunge.us/cKSS?py | 01:49 |
*** salv-orlando has joined #kolla | 01:57 | |
vhosakot | ccesario: I see keystone passed but neutron-dhcp-agent failed.. please do "mount --make-shared /run" share the mount | 01:59 |
*** salv-orlando has quit IRC | 02:04 | |
*** allen_gao has quit IRC | 02:08 | |
ccesario | vhosakot, is it pre requirement ? is it documented ? | 02:09 |
vhosakot | yes | 02:09 |
vhosakot | http://docs.openstack.org/developer/kolla/quickstart.html | 02:09 |
ccesario | O_o | 02:11 |
*** Allen_Gao has joined #kolla | 02:13 | |
*** Allen_Gao has quit IRC | 02:21 | |
*** Allen_Gao has joined #kolla | 02:22 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Handle multi Ethernets case in the gate https://review.openstack.org/290238 | 02:23 |
*** Allen_Gao has quit IRC | 02:23 | |
*** allen_gao has joined #kolla | 02:24 | |
*** jtriley has quit IRC | 02:25 | |
*** allen_gao is now known as ALLEN_GAO | 02:25 | |
*** ALLEN_GAO is now known as Allen_gao | 02:25 | |
*** Allen_gao is now known as Allen_Gao | 02:25 | |
*** Allen_Gao has left #kolla | 02:26 | |
*** stvnoyes has quit IRC | 02:28 | |
*** tfukushima has quit IRC | 02:28 | |
*** stvnoyes has joined #kolla | 02:29 | |
*** sdake has joined #kolla | 02:33 | |
sdake | note deploy on ubuntu is defintaely broken SamYaple | 02:36 |
*** tfukushima has joined #kolla | 02:37 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Revert "Move hostname registration to common" https://review.openstack.org/290243 | 02:38 |
*** macsz has quit IRC | 02:42 | |
sdake | Jeffrey4l ping | 02:44 |
*** jtriley has joined #kolla | 02:47 | |
Jeffrey4l | sdake, pong | 02:50 |
sdake | jeffrey can you search the queue for my ptches and +2 or +a any that are outstanding | 02:50 |
sdake | (the tox ones specifically and the wrning about liberty) | 02:50 |
Jeffrey4l | sdake, np. I am clearing my review queue now. | 02:50 |
sdake | thanks | 02:51 |
*** Allen_Gao has joined #kolla | 02:54 | |
*** Allen_Gao has quit IRC | 02:55 | |
*** Allen_Gao has joined #kolla | 02:56 | |
*** britthouser has quit IRC | 03:00 | |
Jeffrey4l | sdake, should we add a bandit.yml config file like others? nova code: https://github.com/openstack/nova/blob/master/tox.ini#L106 | 03:05 |
*** Marga__ has joined #kolla | 03:06 | |
Jeffrey4l | or add it later? | 03:07 |
*** britthouser has joined #kolla | 03:07 | |
*** Allen_Gao has quit IRC | 03:07 | |
*** allen_gao has joined #kolla | 03:08 | |
*** vhosakot has quit IRC | 03:09 | |
*** Marga_ has quit IRC | 03:10 | |
*** allen_gao has quit IRC | 03:12 | |
*** allen_gao has joined #kolla | 03:12 | |
*** sbezverk has quit IRC | 03:18 | |
sdake | Jeffrey4l add later i th ink | 03:18 |
sdake | Jeffrey4l i just wnt to get the gate running | 03:18 |
sdake | (and failing) | 03:18 |
*** Marga__ has quit IRC | 03:20 | |
*** Marga_ has joined #kolla | 03:20 | |
*** sbezverk has joined #kolla | 03:20 | |
SamYaple | sdake: im aware of the ubunt ugate failure. its a rax irratation. | 03:21 |
Jeffrey4l | SamYaple, yea. I am working on it https://review.openstack.org/290238 | 03:21 |
*** vhosakot has joined #kolla | 03:21 | |
Jeffrey4l | rax-iad has two ethernets, and should detect the right one to used as kolla network interface. | 03:22 |
*** rhallisey has quit IRC | 03:23 | |
SamYaple | Jeffrey4l: no the issue is rax is using a public the vm doesnt know about. im solving it a different way in another patch | 03:24 |
SamYaple | hopefully a way that works for all users of kolla, not jsut our gate | 03:24 |
SamYaple | https://review.openstack.org/#/c/289955/ | 03:24 |
*** dims has quit IRC | 03:25 | |
Jeffrey4l | do not think yours is good. The root cause is the OS configuration. not our ansible playbook. In the end-users env, if getent failed, we should fail and show that there are something wrong in you DNS system. | 03:28 |
openstackgerrit | Merged openstack/kolla-mesos: Add bandit tox target for bandit gate https://review.openstack.org/290154 | 03:28 |
Jeffrey4l | So I think fix the /etc/hosts or use the proper network address is better. | 03:29 |
Jeffrey4l | SamYaple, ^ | 03:29 |
SamYaple | Jeffrey4l: i think the underlying issue is storage/tunnel/api interface types were neer fully flushed out | 03:29 |
SamYaple | what are your thoughts about removing explict reference to them entirely and not having them? | 03:29 |
SamYaple | they dont fully work as it is | 03:30 |
SamYaple | ceph works with storage, but thats it. other "storage" interfaces are broken | 03:30 |
* Jeffrey4l is checking that code. never saw that part :P | 03:30 | |
SamYaple | Jeffrey4l: im more worried about kolla usage in general | 03:30 |
SamYaple | this is the only piece of code that _REQUIRES_ dns at this point | 03:31 |
SamYaple | and it should require it is my thoughts | 03:31 |
SamYaple | shoudlnt* | 03:31 |
SamYaple | lots of operators are fine with ip-only setups | 03:31 |
SamYaple | im not one of them, but i hate to make that a requirement | 03:31 |
*** salv-orlando has joined #kolla | 03:32 | |
*** coolsvap has joined #kolla | 03:35 | |
*** salv-orlando has quit IRC | 03:35 | |
*** sdake has quit IRC | 03:37 | |
SamYaple | Jeffrey4l: I think im going to remove all this storage_hostname stuff entirely. it needs to be thought out and I can gaurantee it will trip up someone somewhere | 03:40 |
SamYaple | thoguhts? | 03:40 |
vhosakot | SamYaple: yep, "getent hosname ..." is failing in all patct sets in gate | 03:41 |
SamYaple | vhosakot: just the RAX ones | 03:41 |
Jeffrey4l | SamYaple, great. I do think the storage_hostname should not be required. | 03:41 |
SamYaple | Jeffrey4l: its needed once we fully implement this setup, not until then | 03:41 |
vhosakot | SamYaple: oh ok.. http://logs.openstack.org/51/290151/1/check/gate-kolla-dsvm-deploy-ubuntu-source/d8f6858/console.html#_2016-03-08_21_57_50_686 | 03:42 |
*** allen_gao has quit IRC | 03:42 | |
vhosakot | SamYaple: so, is RAX a particular type of Ubuntu in gate ? | 03:43 |
*** jtriley has quit IRC | 03:43 | |
*** jtriley has joined #kolla | 03:43 | |
*** sdake has joined #kolla | 03:43 | |
*** jtriley has quit IRC | 03:44 | |
sdake | SamYaple i'd like to keep the storage/tunnel/api interfaces | 03:45 |
sdake | but make them work | 03:45 |
sdake | ya dns as a requirement is no bueno | 03:45 |
sdake | but /etc/hosts is a fine resolution method and getent will query that if resolver is setup properly | 03:46 |
Jeffrey4l | SamYaple, only found the storage_hostname is need by ceph-mon. so 1) why move it to the common? 2) it is just a name, no need really map to the interface/address. the `publick network` / `cluster network` is the key part. | 03:46 |
SamYaple | sdake: theres just no time to "make them work" | 03:46 |
SamYaple | Jeffrey4l: glance, nova, cinder, and ceph use storage_hostname | 03:46 |
SamYaple | its not "just a name" though, since that name must be resolvable Jeffrey4l | 03:48 |
sdake | that would fall under the category of bugfix backports | 03:49 |
sdake | if the features are broken and we can't get them woring in time, i'd prefer backport the bug fixes then remove them and backport the feature later | 03:49 |
SamYaple | not when the infrastructure to support that stuff hasnt been written and it would deinetely affect configs | 03:49 |
SamYaple | thats a feature that we never wrote | 03:49 |
SamYaple | its a backported _feature_ make no mistake | 03:50 |
sdake | well we knwo internal and external work ;) | 03:50 |
SamYaple | i added storage_hostname to try to squeeze this feature in, but i dont have time | 03:50 |
vhosakot | sdake: getent by default checks in /etc/nsswitch.conf http://man7.org/linux/man-pages/man1/getent.1.html | 03:50 |
SamYaple | vhosakot: you are correct | 03:50 |
SamYaple | but in the end it typically resolves to /etc/hosts first | 03:50 |
sdake | vhosakot yse I know how the resolver works | 03:50 |
sdake | I was a systems programmer for 10+ years | 03:50 |
sdake | kernel develoepr for 5 yerars prior to that | 03:51 |
vhosakot | wow :) | 03:51 |
sdake | and peon for 3 years before that | 03:51 |
SamYaple | :| | 03:51 |
sdake | hey I have a great idea | 03:51 |
sdake | lets rewrite the playbooks in json ! | 03:51 |
vhosakot | wow... | 03:51 |
vhosakot | I am deuggning the same issue since yesterday.. getent failure | 03:52 |
sdake | vhosakot try adding your hostname to /etc/hosts | 03:52 |
sdake | I think its a recent change | 03:52 |
SamYaple | its a week or so old | 03:52 |
SamYaple | its not super recent | 03:52 |
*** allen_gao has joined #kolla | 03:53 | |
SamYaple | its popping up now more because they jsut started adding rax vms back into the pool | 03:53 |
vhosakot | sdake: SamYaple: cool, I added hostname and IP in /etc/hosts | 03:53 |
sdake | i've really noticed it the last couple of days | 03:53 |
SamYaple | notice my last comment | 03:53 |
sdake | oh we crossed paths in our communication | 03:53 |
Jeffrey4l | SamYaple, we have `mon host` and `mon addr` in ceph.conf. So I really do not thing the hostname resovle is require( event thought i have no env to test this now) | 03:54 |
SamYaple | Jeffrey4l: it is. i know ceph | 03:54 |
vhosakot | Does it make sense to cat /etc/nsswitch.conf and /etc/hosts in gate before doing getent to get storage_hostanme | 03:54 |
SamYaple | its only required because of how we setup the config Jeffrey4l | 03:54 |
SamYaple | im changing that now, patch incoming | 03:54 |
Jeffrey4l | cool. wait for that. | 03:55 |
SamYaple | vhosakot: i makes sense to remove the incomplete partially implemented feature | 03:55 |
sdake | well i'm glad someone has a sollution for it | 03:55 |
sdake | because my solution is to revert the change since its obviously busted :) | 03:55 |
vhosakot | BTW, I'm done with rabbit reconfig | 03:55 |
sdake | does it work multinode? | 03:55 |
SamYaple | sdake: that just hides the change | 03:56 |
SamYaple | and its not _busted_ it just requires different host configuration | 03:56 |
vhosakot | Jeffrey4l: are you working on horizon reconfig.. I have added merge_config for rabbitmq... I think it is needed for horizon's local_settings as well, right ? | 03:56 |
SamYaple | host configuration we shouldn't be forcing, hence revert not being the best answer | 03:56 |
vhosakot | sdake: no resources for multinode... I'm on AIO | 03:56 |
vhosakot | sdake: do you need me on multinode ? | 03:56 |
sdake | rabbitmq and mariadb have special magic for multinode reconfig | 03:57 |
sdake | or i think they need special magic | 03:57 |
sdake | i am not certain | 03:57 |
sdake | rabbitmq may be fine | 03:57 |
vhosakot | ah ok | 03:57 |
sdake | i'm not really sure - but these two servics are not horional scale services so they cant work straight up with a shutdown 30% serial | 03:57 |
vhosakot | sdake: yep, I see mariadb has a check.yml that waits until mariadb is up thru VIP for other services | 03:59 |
sdake | its not just that | 03:59 |
SamYaple | hey Jeffrey4l | 04:00 |
Jeffrey4l | SamYaple, yep | 04:00 |
SamYaple | you know your bump liberty cloud-archive to mitaka patch? I think we may be ready for that | 04:00 |
Jeffrey4l | need go to launch. brb. | 04:00 |
SamYaple | i *think* the repo is all signed | 04:00 |
Jeffrey4l | SamYaple, great. I will try to continue that works. Thanks for you info. | 04:01 |
vhosakot | Jeffrey4l: are you working on horizon reconfig ? | 04:02 |
openstackgerrit | MD NADEEM proposed openstack/kolla: Reconfigure for haproxy https://review.openstack.org/288248 | 04:11 |
openstackgerrit | Merged openstack/kolla: Copy the logs out of the container https://review.openstack.org/288541 | 04:17 |
*** inc0 has joined #kolla | 04:21 | |
*** Marga_ has quit IRC | 04:23 | |
*** Marga_ has joined #kolla | 04:35 | |
sdake | SamYaple please read https://review.openstack.org/#/c/290151/1 for my thinking of how to deal with this issue | 04:37 |
sdake | these docs are short term and temporary in nature an will be reverted hopefully b the end of this month | 04:37 |
sdake | i dont even want this stuff in reno at all | 04:37 |
sdake | reno is only for new features - reno-iizing mitaka nad liberty will be a special challenge | 04:38 |
openstackgerrit | Merged openstack/kolla: Add tox job for the bandit python security linter https://review.openstack.org/290014 | 04:38 |
sdake | the problem is reno tags the version of the change with the date of the commit | 04:38 |
sdake | so we can't just willy nilly add liberty reno filess | 04:39 |
sdake | and expect things to come out magically | 04:39 |
sdake | i've got a conversation with doug to have about that once we get reno rolling in master | 04:39 |
SamYaple | im saying dont name what you have Relase notes | 04:40 |
*** Marga_ has quit IRC | 04:40 | |
SamYaple | im not suggesting doing reno stuff in mitaka or liberty | 04:40 |
sdake | what woud you prefer i call it | 04:40 |
SamYaple | What we need is a liberty deploy guide. that that seems like a good a header as any | 04:40 |
*** inc0 has quit IRC | 04:40 | |
sdake | stupid title but whatever | 04:41 |
SamYaple | whats a stupid title? | 04:42 |
*** allen_gao has quit IRC | 04:42 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Add documentation about critical data loss https://review.openstack.org/290151 | 04:46 |
openstackgerrit | Steven Dake proposed openstack/kolla: Add documentation about critical data loss https://review.openstack.org/290151 | 04:48 |
sdake | say why is --no-cache deprecated in build.py? | 04:49 |
SamYaple | sdake: i didnt say call it liberty deploy guide... i meant we need one that that would be a good header for it | 04:49 |
SamYaple | if thats not actually a liberty deploy guide then we shouldn't call it such | 04:49 |
sdake | well jesus fucking christ | 04:49 |
sdake | maek up your mind | 04:49 |
SamYaple | lurn2reading comprehension dude | 04:49 |
sdake | that is the deploy guide | 04:50 |
sdake | DO NOt depLOY | 04:50 |
SamYaple | good night guys im out | 04:50 |
*** phuongnh has quit IRC | 04:51 | |
*** allen_gao has joined #kolla | 04:51 | |
*** Marga_ has joined #kolla | 04:53 | |
*** Marga_ has quit IRC | 04:54 | |
*** Marga_ has joined #kolla | 04:54 | |
*** Marga_ has quit IRC | 04:54 | |
*** Marga_ has joined #kolla | 04:54 | |
*** Marga_ has quit IRC | 04:55 | |
*** Marga_ has joined #kolla | 04:55 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Add documentation about critical data loss https://review.openstack.org/290151 | 05:03 |
openstackgerrit | Steven Dake proposed openstack/kolla: Add documentation about critical data loss https://review.openstack.org/290151 | 05:05 |
openstackgerrit | Steven Dake proposed openstack/kolla: Add documentation about critical data loss https://review.openstack.org/290151 | 05:05 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Remove storage_hostname https://review.openstack.org/289955 | 05:05 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Add ceph wait before bootstrap https://review.openstack.org/290273 | 05:05 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Remove storage_hostname https://review.openstack.org/289955 | 05:07 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Add ceph wait before bootstrap https://review.openstack.org/290273 | 05:07 |
*** salv-orlando has joined #kolla | 05:07 | |
*** salv-orlando has quit IRC | 05:13 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Rename validate-docker-execute with .sh extension https://review.openstack.org/290274 | 05:14 |
Jeffrey4l | vhosakot, the horizon reconfig has been merged https://review.openstack.org/#/c/289126/ | 05:16 |
vhosakot | Jeffrey4l: cool, so, you did not add merge_config for horizon's local_setting from /etc/kolla/config directory ? | 05:19 |
*** pbourke has quit IRC | 05:19 | |
*** pbourke has joined #kolla | 05:20 | |
Jeffrey4l | vhosakot, no. I have no idea how to handle the no-ini format file now. Do you have any idea for this? | 05:20 |
Jeffrey4l | where is you code about the merge_config for rabbitmq, sorry i did not found that. | 05:21 |
Jeffrey4l | vhosakot, ^ | 05:21 |
vhosakot | Jeffrey4l: there is no merge_config for rabbitmq.. I'm planning to add it... | 05:21 |
vhosakot | Jeffrey4l: where is the main merge_config code ? | 05:22 |
Jeffrey4l | vhosakot, cool. we need consider for many kind of configuration file format when doing this. | 05:22 |
Jeffrey4l | for example python, ini, yaml, toml etc. | 05:22 |
vhosakot | well, rabbitmy is ini based similar to neutron and nova | 05:23 |
Jeffrey4l | vhosakot, https://github.com/openstack/kolla/blob/d563e009395ee571fb523cb2610fdc41536ea5f6/ansible/library/merge_configs.py | 05:23 |
Jeffrey4l | do not think so. | 05:23 |
Jeffrey4l | rabbitmq config like a json format. But seems not the same. | 05:24 |
vhosakot | Jeffrey4l: I see there is no code in merge_configs.py... there is just example | 05:24 |
Jeffrey4l | vhosakot, https://github.com/openstack/kolla/tree/d563e009395ee571fb523cb2610fdc41536ea5f6/ansible/roles/rabbitmq/templates | 05:24 |
Jeffrey4l | see this for the rabbitmq config files. | 05:24 |
Jeffrey4l | no ini files vhosakot | 05:24 |
*** sdake_ has joined #kolla | 05:24 | |
Jeffrey4l | vhosakot, https://github.com/openstack/kolla/blob/d563e009395ee571fb523cb2610fdc41536ea5f6/ansible/action_plugins/merge_configs.py it is here. | 05:25 |
vhosakot | Jeffrey4l: they are *.conf... ok | 05:25 |
Jeffrey4l | vhosakot, the content of the file is the key point. not the extension. | 05:25 |
Jeffrey4l | merge_configs is a action plugin for ansible ( i have not familiar this, do not know why has two merge_configs.py file) | 05:26 |
vhosakot | Jeffrey4l: right... I see json format in rabbitmq's *.conf files... | 05:26 |
vhosakot | Jeffrey4l: right.. why is https://github.com/openstack/kolla/blob/master/ansible/library/merge_configs.py ? :) | 05:27 |
Jeffrey4l | vhosakot, I have said " i have not familiar this, do not know why has two merge_configs.py file" | 05:27 |
Jeffrey4l | but it is the stand of the ansible 1.X | 05:27 |
*** sdake has quit IRC | 05:27 | |
vhosakot | cool :) | 05:27 |
Jeffrey4l | standard* | 05:27 |
openstackgerrit | Steven Dake proposed openstack/kolla: Add note about vagrant and heat instability https://review.openstack.org/290276 | 05:28 |
vhosakot | Jeffrey4l: cool, so, https://github.com/openstack/kolla/blob/master/ansible/action_plugins/merge_configs.py is the right filr, right ? | 05:28 |
vhosakot | file* | 05:28 |
Jeffrey4l | so if we want to handle this. One method is extend the merge_configs can handle json,python,toml format file. | 05:29 |
Jeffrey4l | vhosakot, these two file should both exist. one for doc, one for code. maybe SamYaple can explain this. SamYaple why there two merge_configs.py files? | 05:29 |
vhosakot | Jeffrey4l: cool... | 05:30 |
vhosakot | Jeffrey4l: so, we need extend https://github.com/openstack/kolla/blob/master/ansible/action_plugins/merge_configs.py and not the other one with no Python code then | 05:30 |
Jeffrey4l | sorry, not a expert of ansible :p | 05:30 |
vhosakot | Jeffrey4l: cool, I will try to add some debugs.. thanks for the info! :) | 05:30 |
Jeffrey4l | vhosakot, that's the only solution i have now.( but not perfect and ugly :(.) | 05:31 |
vhosakot | Jeffrey4l: cool | 05:32 |
*** daneyon_ has quit IRC | 05:41 | |
openstackgerrit | Steven Dake proposed openstack/kolla: mariadb-devel is deprecated https://review.openstack.org/290279 | 05:44 |
openstackgerrit | Steven Dake proposed openstack/kolla: Do not create user home directory in toolbox https://review.openstack.org/290280 | 05:49 |
*** tfukushima has quit IRC | 05:53 | |
*** tfukushima has joined #kolla | 05:53 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Explain how to use kolla-ansible pull https://review.openstack.org/284991 | 05:55 |
openstackgerrit | Steven Dake proposed openstack/kolla: Explain how to use kolla-ansible pull https://review.openstack.org/284991 | 05:57 |
openstackgerrit | Steven Dake proposed openstack/kolla: RST syntax error in quickstart.rst https://review.openstack.org/290283 | 05:58 |
Jeffrey4l | SamYaple, about the ubuntu mitaka repo, do you mean still use the mitaka-staging repo? ( no cloud-archive repo now). and, how could you get the info that " the repo is all signed". thanks. | 05:58 |
sdake_ | Jeffrey4l can you review https://review.openstack.org/#/c/290151/ plz | 05:59 |
Jeffrey4l | sdake_, np | 06:01 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Add missing ubuntu binary container for Manila https://review.openstack.org/290286 | 06:07 |
openstackgerrit | Merged openstack/kolla: Add documentation about critical data loss https://review.openstack.org/290151 | 06:11 |
asalkeld | nihilifer: you about? | 06:12 |
asalkeld | what do you think of putting the content of config/ into services/ ? | 06:13 |
sdake_ | nihilifer ping | 06:13 |
asalkeld | so something like services/nova/templates/* | 06:13 |
asalkeld | current layout is a bit spread out (also it would make the new "snapshot" code easier if it were in one place | 06:14 |
*** allen_gao has quit IRC | 06:19 | |
sdake_ | asalkeld do you knwo how to use curl to paste a file to paste.openstack.org? | 06:21 |
asalkeld | i use the python script from paste.openstack.org | 06:22 |
asalkeld | http://paste.openstack.org/help/integration/ | 06:22 |
asalkeld | http://git.openstack.org/cgit/openstack-infra/lodgeit/plain/scripts/lodgeit.py | 06:23 |
asalkeld | sdake_: ^ | 06:23 |
vhosakot | Jeffrey4l: instead of parsing non-ini file, can't we just copy and paste new config file from /etc/kolla/config/rabbit using Ansible's "copy:" module ? | 06:25 |
Jeffrey4l | vhosakot, no a good idea. in that way, the end-user should write the whole config, and then change it. | 06:27 |
vhosakot | Jeffrey4l: yes, isn;t that a solution ? should reconfig allow parts of config to be changed ? | 06:28 |
vhosakot | sdake_: how to curl to pastebin --> http://sprunge.us and https://github.com/rupa/sprunge | 06:29 |
*** allen_gao has joined #kolla | 06:30 | |
vhosakot | Jeffrey4l: yes, isn;t that a solution ? should reconfig allow parts of config to be changed ? | 06:30 |
*** salv-orlando has joined #kolla | 06:31 | |
openstackgerrit | Angus Salkeld proposed openstack/kolla-mesos: Move all of config into services https://review.openstack.org/290297 | 06:32 |
asalkeld | nihilifer: ^ | 06:32 |
Jeffrey4l | vhosakot, personally, I thought that. but do not like it. But you can push a PS and see what others say. | 06:35 |
*** salv-orlando has quit IRC | 06:36 | |
vhosakot | Jeffrey4l: I see that rabbotmq config files are not like key-value pairs.. so the user cannot edit _just_ one line to reconfig.. I think the user must edit entire config | 06:36 |
vhosakot | Jeffrey4l: here is the config files of rabbitmq... how can the user change just one line... I think the entire file must be placed in /etc/kolla/config/ and chancged http://paste.openstack.org/show/489777/ | 06:38 |
Jeffrey4l | vhosakot yea. that's the key problem. No other solution except for replace. | 06:42 |
Jeffrey4l | right now. | 06:42 |
Jeffrey4l | but replace has other issue. | 06:42 |
vhosakot | Jeffrey4l: what issue ? | 06:42 |
vhosakot | Jeffrey4l: replace entire file and restart | 06:43 |
Jeffrey4l | how about our template file change? expecially when upgrade. how could you merge the user version and ours. | 06:43 |
vhosakot | Jeffrey4l: the template file is already copied in config.yml | 06:45 |
vhosakot | Jeffrey4l: https://github.com/openstack/kolla/blob/e80a6d907569a9c5c3e1c22922f9eb778eb7313f/ansible/roles/rabbitmq/tasks/config.yml#L18 | 06:46 |
Jeffrey4l | vhosakot, sorry a little busy. I have no better idea for this besides simple replace( But i do not like it, personally). If you want to change it, please push a PS and let's talk with others based no the code. :D | 06:50 |
vhosakot | Jeffrey4l: cool, thanks! | 06:50 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: [WIP] Use ubuntu Mitaka staging repo https://review.openstack.org/279910 | 06:51 |
*** mlima has quit IRC | 06:55 | |
nihilifer | asalkeld: oh, so that's all in one branch? | 06:55 |
* nihilifer is scared | 06:55 | |
*** dave-mccowan has quit IRC | 07:02 | |
nihilifer | ah, ok, it's "conflicts with", not "related changes"... | 07:03 |
asalkeld | nihilifer: yeah it conflicts with *everything* :-O | 07:17 |
asalkeld | lets get other stuff in first | 07:17 |
openstackgerrit | Steven Dake proposed openstack/kolla: Upgrade Heat https://review.openstack.org/290309 | 07:21 |
openstackgerrit | Steven Dake proposed openstack/kolla: Upgrade Heat https://review.openstack.org/290309 | 07:27 |
openstackgerrit | Steven Dake proposed openstack/kolla: Upgrade Heat https://review.openstack.org/290309 | 07:28 |
sdake_ | nihilifer asalkeld heat is busted | 07:28 |
sdake_ | need it working | 07:28 |
sdake_ | need some expertise there - heat stack-lsit works, stack create fails with authorization failure | 07:28 |
sdake_ | master without my patch is broken | 07:28 |
sdake_ | master with my patch is same result | 07:29 |
*** allen_gao has quit IRC | 07:29 | |
sdake_ | but atleast it moves from 2.0.0 to 2.0.1 now ;) | 07:29 |
sdake_ | asalkeld pleae hae a review of the heat upgrade patch as well | 07:29 |
coolsvap | sdake_: following three bugs do not seem to be critical for rc-1 as they are marked. I have added comments please have a look. 1) https://bugs.launchpad.net/kolla/+bug/1553198 | 07:32 |
openstack | Launchpad bug 1553198 in kolla "Ubuntu Binary Container Implementation missing CEPH" [Critical,Confirmed] | 07:32 |
coolsvap | 2) https://bugs.launchpad.net/kolla/+bug/1553200 | 07:32 |
coolsvap | 3) https://bugs.launchpad.net/kolla/+bug/1553201 | 07:32 |
openstack | Launchpad bug 1553200 in kolla "Ubuntu Binary Container implementation missing Heka" [Low,Confirmed] - Assigned to Éric Lemoine (elemoine) | 07:32 |
openstack | Launchpad bug 1553201 in kolla "Ubuntu Binary Container Implementation missing elasticsearch" [Critical,Confirmed] | 07:32 |
nihilifer | sdake_: that failure occurs only on upgrading heat from liberty to mitaka? | 07:34 |
*** cloudnull has quit IRC | 07:38 | |
*** allen_gao has joined #kolla | 07:38 | |
*** stvnoyes has quit IRC | 07:40 | |
*** coolsvap has quit IRC | 07:43 | |
*** chandankumar has joined #kolla | 07:50 | |
*** stvnoyes has joined #kolla | 07:57 | |
sdake_ | nihilifer no the fialure occurs in master | 07:58 |
*** gfidente has joined #kolla | 07:58 | |
*** jmccarthy has quit IRC | 07:58 | |
sdake_ | stack-create in master is broken | 07:58 |
sdake_ | stack event-show says "Unauthorized" | 07:59 |
asalkeld | sdake_: +2'd | 07:59 |
sdake_ | nihilifer asalkeld https://bugs.launchpad.net/kolla/+bug/1553565 | 07:59 |
openstack | Launchpad bug 1553565 in kolla "heat is DOA in mitaka-3" [Critical,Confirmed] | 07:59 |
*** jmccarthy has joined #kolla | 08:00 | |
sdake_ | asalkeld cool but does it look correct? :) | 08:00 |
sdake_ | i ran test cases which show its accuracy and attached the log | 08:00 |
*** sdake_ is now known as sdake | 08:01 | |
sdake | heat definatelly worked in liberty | 08:02 |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Add empty string to KOLLA_BOOTSTRAP env variable. https://review.openstack.org/290030 | 08:06 |
sdake | elemoine coolsvap people didn't update the work items, so I had to create bugs fast and furiious on saturday to close out the release | 08:08 |
sdake | elemoine if you find more like it already done, mark them invalid but keep them critical | 08:08 |
*** fgimenez has joined #kolla | 08:08 | |
*** fgimenez has joined #kolla | 08:08 | |
sdake | critical = feature that was missed | 08:08 |
sdake | I just want to have an accounting of all existing features/bugs in kolla | 08:09 |
elemoine_ | sdake: I don't fully understand | 08:11 |
elemoine_ | for example why is https://bugs.launchpad.net/kolla/+bug/1553200 critical | 08:11 |
openstack | Launchpad bug 1553200 in kolla "Ubuntu Binary Container implementation missing Heka" [Critical,Invalid] - Assigned to Éric Lemoine (elemoine) | 08:11 |
sdake | anything that is a missing feature is critical | 08:12 |
sdake | it was triaged as critical, but marked invalid | 08:12 |
elemoine_ | the heka container has always supported Ubuntu | 08:12 |
sdake | a bug cn be critical to the release as in "fix now" but invalid because its already fixedd | 08:12 |
elemoine_ | so there is no missing feature | 08:12 |
sdake | does that make sense? | 08:12 |
*** macsz has joined #kolla | 08:13 | |
elemoine_ | sort of :) I understand that the topic of the bug is critial for the release, but the bug is invalid | 08:13 |
sdake | right | 08:14 |
sdake | when it was triaged, it was marked critical | 08:14 |
sdake | triage = critical, invalid no state change | 08:14 |
sdake | triage = critical, on confirmation = can chane state | 08:14 |
sdake | but i'd like all feature bugs left as is | 08:14 |
sdake | but the person that figured out the code was already implemented shouldbe set in assigned to | 08:15 |
elemoine_ | note that I am not the one who changed it to "Low" :) | 08:15 |
elemoine_ | but yes I understand now | 08:15 |
*** mikelk has joined #kolla | 08:18 | |
*** vhosakot has quit IRC | 08:18 | |
*** macsz has quit IRC | 08:21 | |
*** macsz has joined #kolla | 08:21 | |
*** macsz1 has joined #kolla | 08:28 | |
*** macsz has quit IRC | 08:28 | |
*** macsz1 has quit IRC | 08:29 | |
*** macsz has joined #kolla | 08:32 | |
*** Serlex has joined #kolla | 08:35 | |
*** alisonh has left #kolla | 08:36 | |
*** athomas has joined #kolla | 08:36 | |
sdake | elemoine ping re https://review.openstack.org/#/c/290309/3/ansible/roles/heat/tasks/bootstrap_service.yml | 08:37 |
sdake | line 22 | 08:37 |
sdake | is tht correct for heka usage? | 08:37 |
elemoine_ | sdake: looking… | 08:38 |
sdake | sort of copied glance and merged | 08:38 |
sdake | tested upgrade, seemss to work | 08:38 |
elemoine_ | yeah, bootstrap_service.yml looks good to me | 08:39 |
elemoine_ | it is important that the kolla_logs volume is mounted into the bootstrap container as well | 08:39 |
elemoine_ | and it is, so that's good | 08:39 |
elemoine_ | sdake: a note about KOLLA_BOOTSTRAP | 08:40 |
elemoine_ | I guess you've seen https://review.openstack.org/#/c/290030/ ? | 08:40 |
*** coolsvap has joined #kolla | 08:43 | |
sdake | elemoine_ haven't een it because it wasn't targetedt o rc1 | 08:45 |
*** kproskurin has joined #kolla | 08:45 | |
sdake | when doing triage, please target bugs to rc1 | 08:45 |
*** kproskurin has quit IRC | 08:45 | |
elemoine_ | sdake: I am pretty sure it will work with older versions of docker-py | 08:46 |
*** akwasnie has joined #kolla | 08:46 | |
elemoine_ | but I'll let Rodolfo respond on that | 08:46 |
sdake | akwasnie can you have a look at https://review.openstack.org/#/c/290309/ | 08:47 |
sdake | elemoine_ i sline 22 correct though? | 08:47 |
*** shardy has joined #kolla | 08:47 | |
*** openstackgerrit has quit IRC | 08:47 | |
sdake | i'd like to merge it today | 08:47 |
elemoine_ | I did not see that you were referring to line 22 specifically | 08:47 |
elemoine_ | looking… | 08:48 |
sdake | and handle the godl plating int hat bug related to it being doa | 08:48 |
*** openstackgerrit has joined #kolla | 08:48 | |
*** kproskurin has joined #kolla | 08:48 | |
sdake | api works, engine doens't work | 08:48 |
sdake | authentication is busted in masster atm for heat | 08:48 |
sdake | and i'm pretty sure magnum is broke too | 08:48 |
elemoine_ | sdake: what's /var/lib/heat? it certainly is unrelated to logging… | 08:48 |
sdake | dunno glance has it | 08:49 |
sdake | but i think it is unnecessary | 08:49 |
sdake | i'll remove | 08:49 |
elemoine_ | yes | 08:49 |
elemoine_ | if you added it thinking that it was useful for heka/logging then it's a mistake | 08:49 |
*** kproskurin has quit IRC | 08:50 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Upgrade Heat https://review.openstack.org/290309 | 08:50 |
openstackgerrit | Eric Lemoine proposed openstack/kolla: Add cron image and playbook https://review.openstack.org/288432 | 08:50 |
sdake | i copied glance | 08:50 |
*** akwasnie has quit IRC | 08:50 | |
sdake | glance ueses /var/lib/glance for persistent image storage | 08:50 |
sdake | asalkeld can you ack again plz | 08:50 |
sdake | demo in t-6 hours of reconfigure and upgrade | 08:51 |
sdake | wtb docs on how to use elastic search | 08:51 |
sdake | and kibana | 08:51 |
*** akwasnie has joined #kolla | 08:51 | |
asalkeld | done | 08:51 |
sdake | akwasnie elemoine_ teach me how to use kibana and elastic search and i'll throw it in m ydemo | 08:52 |
sdake | and also test it for you | 08:52 |
elemoine_ | sdake: you need to have enable_central_logging set to "yes" in your config | 08:54 |
sdake | is that it? | 08:54 |
elemoine_ | you need to build the elasticsearch and kibana images | 08:54 |
elemoine_ | start the elasticsearch and kibana containers, obviously | 08:54 |
elemoine_ | then you can point your browser to kibana | 08:55 |
sdake | kibana runs where? | 08:55 |
elemoine_ | whatever :) it's available through the public vip | 08:55 |
sdake | which port | 08:56 |
sdake | by public doy ou mean external vip? | 08:56 |
elemoine_ | 5601 | 08:56 |
elemoine_ | external vip yes | 08:56 |
sdake | that should probably only be on the internal vip | 08:56 |
elemoine_ | look at the haproxy config if you want to be sure | 08:56 |
*** akwasnie has quit IRC | 08:56 | |
elemoine_ | sdake: it's a good point | 08:57 |
elemoine_ | it's both right now | 08:57 |
elemoine_ | https://github.com/openstack/kolla/blob/master/ansible/roles/haproxy/templates/haproxy.cfg.j2#L374-L387 | 08:57 |
elemoine_ | kibana is for the operator | 08:58 |
sdake | elemoine_ can you file a bug | 08:58 |
elemoine_ | should the operator use the internal vip in his browser for accessing kibana? | 08:58 |
sdake | that is a security problem | 08:59 |
sdake | the yshould use the internal fqdn | 08:59 |
elemoine_ | ok, I'll open a bug and fix it | 08:59 |
elemoine_ | sdake: I think you have the information you need for accessing kibana | 09:00 |
elemoine_ | sdake: then you will need to configure your index pattern in the kibana UI | 09:00 |
elemoine_ | log-* will be your pattern | 09:01 |
elemoine_ | then you should see the logs in the Kibana UI | 09:01 |
*** macsz has quit IRC | 09:01 | |
*** kproskurin has joined #kolla | 09:03 | |
*** mbound has joined #kolla | 09:04 | |
elemoine_ | sdake: https://bugs.launchpad.net/kolla/+bug/1554977 | 09:04 |
openstack | Launchpad bug 1554977 in kolla "Kibana currently available on the external VIP" [High,New] - Assigned to Éric Lemoine (elemoine) | 09:04 |
sdake | Kibana also needs tls implementation | 09:05 |
sdake | is there a kibana password? | 09:05 |
sdake | deploying now | 09:06 |
sdake | should have it available shortly | 09:06 |
elemoine_ | sdake: true about tls | 09:06 |
elemoine_ | sdake: same for elasticsearch | 09:06 |
elemoine_ | required for mitaka? | 09:06 |
elemoine_ | sdake: no kibana password | 09:06 |
elemoine_ | sdake: I really want to add a "Diagnostics" documentation page for users | 09:07 |
elemoine_ | but I haven't had time to work on that | 09:07 |
sdake | elemoine_ i'll get it kicked off | 09:09 |
sdake | teach me all you know | 09:09 |
elemoine_ | do you see logs in the Kibana UI? | 09:09 |
elemoine_ | in the first tab of the UI | 09:09 |
sdake | haven't finished deployigns | 09:09 |
elemoine_ | read what I wrote earlier | 09:10 |
sdake | 5601? | 09:10 |
elemoine_ | yes | 09:10 |
elemoine_ | and also about the index that you need to set in the Kibana UI | 09:10 |
elemoine_ | but IÂ won't be able to teach you how to use the Kibana UIÂ here :) | 09:10 |
elemoine_ | there's a lot to tell/learn about Kibana | 09:11 |
sdake | I created the log-* | 09:11 |
sdake | now what | 09:11 |
elemoine_ | you can go to the first tab in the UI | 09:11 |
elemoine_ | the discover tab IIRC | 09:12 |
elemoine_ | and you should see your logs in a table | 09:12 |
openstackgerrit | Eric Lemoine proposed openstack/kolla: Do not make Kibana available at the external VIP https://review.openstack.org/290339 | 09:14 |
sdake | how can I visualize all the various services log events | 09:14 |
sdake | I wnt a pie chart of all the services log events for example | 09:15 |
elemoine_ | you do not see the logs in the firt tab of the UI? | 09:15 |
sdake | i do see the logs | 09:15 |
elemoine_ | cool | 09:15 |
elemoine_ | now you need to learn how to use the Kibana UI for creating charts and stuff | 09:15 |
sdake | is there a way to load a prebuilt profile into kibana? | 09:16 |
elemoine_ | something I wanted to raise indeed | 09:16 |
elemoine_ | yes, it's possible | 09:16 |
elemoine_ | and we should do it in Kolla | 09:16 |
sdake | clearly | 09:17 |
sdake | that gives us diagnostics! | 09:17 |
elemoine_ | true | 09:17 |
sdake | i want to set up a dashboard | 09:18 |
sdake | somethign basic | 09:18 |
sdake | to demo | 09:18 |
sdake | can you walk methorug hthat | 09:18 |
sdake | i'll write the docs ;) | 09:18 |
elemoine_ | I don't a kibana UI handy right now | 09:18 |
openstackgerrit | Merged openstack/kolla-mesos: Mesos DNS https://review.openstack.org/290165 | 09:18 |
elemoine_ | when's your demo? | 09:18 |
sdake | 6 hours | 09:18 |
sdake | its prettty cool all this stuff is integrated and functional | 09:19 |
sdake | tbh I didn't think it was possible in the timeframe we had :) | 09:19 |
elemoine_ | and it should work in cluster mode | 09:20 |
sdake | wish Ihad multinode sestup | 09:20 |
elemoine_ | meaning you can deploy ES and Kibana on mulitple machines as a cluster | 09:20 |
sdake | to tet out that theory | 09:20 |
elemoine_ | I did some tests on a multinode environment | 09:20 |
elemoine_ | and that seemd to work | 09:20 |
*** salv-orlando has joined #kolla | 09:21 | |
sdake | would be cool to show a time chart of certain events | 09:22 |
sdake | we ought to figure out how to create some profiles | 09:22 |
sdake | and load them | 09:22 |
elemoine_ | we already do that in our Fuel project | 09:22 |
elemoine_ | we already have relevant dashboards | 09:23 |
elemoine_ | they're in Kibana 3 right now, but porting them to Kibana 4 should not be too difficult | 09:23 |
sdake | fuel has kibana integrated? | 09:23 |
elemoine_ | no it's through a Fuel plugin | 09:23 |
sdake | what license are they? | 09:23 |
elemoine_ | https://github.com/openstack/fuel-plugin-elasticsearch-kibana | 09:24 |
sdake | what is lma collector? | 09:24 |
elemoine_ | basically heka :) | 09:24 |
elemoine_ | lma means "logging monitoring alerting" | 09:25 |
elemoine_ | the collector (heka) collects logs, metrics, notifications | 09:25 |
sdake | interesting patrick works at mirantis now | 09:25 |
sdake | LMA = service assurance | 09:25 |
elemoine_ | logs are sent to Elasticsearch | 09:25 |
elemoine_ | metrics are sent to InfluxDB | 09:25 |
*** cloudnull has joined #kolla | 09:26 | |
sdake | what is influxdb | 09:26 |
sdake | cloudnull are you around? | 09:26 |
elemoine_ | it's a time-series database | 09:26 |
elemoine_ | so a database specialized in storing time series | 09:26 |
sdake | what license is influxdb? | 09:27 |
elemoine_ | MIT | 09:27 |
elemoine_ | https://github.com/influxdata/influxdb | 09:27 |
*** salv-orlando has quit IRC | 09:29 | |
elemoine_ | now that Kolla has heka this is the sort of diagnostics use we could use in Kolla | 09:29 |
sdake | so lets focus on this fuel plugin first | 09:31 |
elemoine_ | for Kolla to include all the good diagnostics tools that operators love and use :) | 09:31 |
elemoine_ | sdake: what do you mean? | 09:31 |
sdake | i'd like kibana profiles to load straight in | 09:31 |
elemoine_ | yes | 09:31 |
elemoine_ | that will make sense | 09:31 |
*** Jeffrey4l has quit IRC | 09:31 | |
sdake | i dont want to fork the plugin | 09:32 |
sdake | but i want it to work with kolla | 09:32 |
sdake | is that possible | 09:32 |
sdake | or does it need to be forked and separately developed? | 09:32 |
elemoine_ | separately developed | 09:32 |
elemoine_ | but we can probably share code, through common packages | 09:33 |
elemoine_ | that's what I suggested already for the Lua plugins | 09:33 |
sdake | the problem with sharing is who owns the deliverable | 09:33 |
sdake | as in who tags, who releases, who fixes the bugs, who designs etc | 09:34 |
sdake | the governance repository doesn't have a way for two projects to share one deliverable | 09:34 |
elemoine_ | sdake: kolla has tons of dependencies | 09:34 |
elemoine_ | it's not like this was a new problem | 09:34 |
*** macsz has joined #kolla | 09:35 | |
sdake | yes but the dependenies we use we dont really care to develop ourselves | 09:35 |
elemoine_ | what about haproxy, elasticsearch, memcached, etc. etc. (the list is long) | 09:35 |
sdake | in this case of a kibana plugin we do | 09:35 |
sdake | we odnt care about the implementations of those things | 09:35 |
elemoine_ | I don't know for Kibana dashboards | 09:35 |
sdake | kibana dashboard = low hanging fruit | 09:36 |
elemoine_ | but I think we could share the Lua plugins with a separate package/git repo | 09:36 |
elemoine_ | that git repo would just be a collection of Heka plugins, that anybody can use | 09:36 |
openstackgerrit | Martin André proposed openstack/kolla: Add local directory or file for source build https://review.openstack.org/281615 | 09:36 |
openstackgerrit | Eric Lemoine proposed openstack/kolla: Do not create /dev/log symlink if it already exists https://review.openstack.org/290357 | 09:41 |
sdake | elemoine_ do you have a screen shot of the diagnostics screen of kibana in fuel? | 09:42 |
elemoine_ | sdake: see the end of this page: http://fuel-plugin-elasticsearch-kibana.readthedocs.org/en/latest/user.html | 09:43 |
elemoine_ | remember that it's Kibana 3 (Kolla uses Kibana 4) | 09:43 |
*** Serlex has quit IRC | 09:52 | |
*** akwasnie has joined #kolla | 09:52 | |
akwasnie | elemoine ping | 09:52 |
akwasnie | or maybe elemoine_ :) | 09:54 |
*** Serlex has joined #kolla | 09:55 | |
elemoine_ | hi akwasnie | 09:55 |
akwasnie | hi, great news! you are added to https://www.openstack.org/summit/austin-2016/summit-schedule/events/7765 | 09:56 |
elemoine_ | saw that, thanks for making this happen | 09:56 |
akwasnie | thanks that you want to help with this:) | 09:58 |
*** chandankumar has quit IRC | 10:00 | |
sdake | akwasnie elemoine_ and i wer etalking about a diag plugin for kolla base dupon kibana | 10:04 |
sdake | see whatit looks like http://fuel-plugin-elasticsearch-kibana.readthedocs.org/en/latest/user.html | 10:04 |
*** akwasnie has quit IRC | 10:05 | |
*** akwasnie has joined #kolla | 10:06 | |
elemoine_ | akwasnie: we were talking about adding default Kibana dashboards to Kolla | 10:06 |
elemoine_ | so the operator has something that is helpful out-of-the-box | 10:06 |
openstackgerrit | Artur Zarzycki proposed openstack/kolla-mesos: Switch services to use mesos-dns names https://review.openstack.org/290181 | 10:12 |
ajafo | hi | 10:15 |
sdake | yo ajf | 10:16 |
sdake | ajafo | 10:16 |
sdake | elemoine_ porting this fuel plugin | 10:19 |
sdake | how long would that take? | 10:19 |
sdake | how does it "plug in" | 10:19 |
sdake | do you install it in the container? | 10:19 |
*** coolsvap_ has joined #kolla | 10:22 | |
*** tfukushima has quit IRC | 10:25 | |
*** coolsvap has quit IRC | 10:26 | |
sdake | akwasnie the idea is to figure out how to make this into a component of kolla http://fuel-plugin-elasticsearch-kibana.readthedocs.org/en/latest/user.html | 10:30 |
sdake | unfortunately we can't just use their plugin because its kibna 3 | 10:30 |
sdake | and we are rolling kibana 4 | 10:31 |
*** kproskurin has quit IRC | 10:33 | |
elemoine_ | sdake: it's a Fuel plugin, so you can use it only if you use Fuel | 10:36 |
sdake | oh i thought it as a kibana plugin | 10:37 |
elemoine_ | it's a Fuel plugin that includes Kibana dashboards | 10:37 |
sdake | so i guess we could use the dashboards then as profiles of some sort? | 10:48 |
sdake | i want it all | 10:48 |
sdake | and i want it now ;) | 10:48 |
sdake | you know, queen rocks :) | 10:48 |
elemoine_ | what do you mean by "profiles"? | 10:51 |
sdake | you know, queen rocks :) | 10:51 |
sdake | a profile is a configuration that generates a specific output | 10:51 |
*** salv-orlando has joined #kolla | 10:51 | |
sdake | kibana probably ahs a specific term for it | 10:51 |
*** kproskurin has joined #kolla | 10:51 | |
*** mbound has quit IRC | 10:52 | |
*** salv-orlando has quit IRC | 10:56 | |
*** kproskurin has quit IRC | 10:59 | |
*** mbound has joined #kolla | 10:59 | |
*** kproskurin has joined #kolla | 11:01 | |
elemoine_ | sdake: I don't think this can happen for mitaka unfortunately | 11:06 |
sdake | ya we have a full plate | 11:06 |
sdake | i'm just wondering what the mechanics would be | 11:06 |
*** dims has joined #kolla | 11:07 | |
sdake | create a fresh repo implement fresh code | 11:07 |
sdake | but the code does what, plugs into kibana? | 11:07 |
*** chandankumar has joined #kolla | 11:13 | |
*** rhallisey has joined #kolla | 11:14 | |
openstackgerrit | Prithiv proposed openstack/kolla: Updates Documentation about Installation of curl, OpenStack, Neutron and Nova clients related-bug: 1554780 https://review.openstack.org/290399 | 11:15 |
openstack | bug 1554780 in kolla "Update the documentation about installation of curl, nova, neutron clients" [Low,Confirmed] https://launchpad.net/bugs/1554780 - Assigned to Prithiv (prithiv) | 11:15 |
*** iceyao_ has quit IRC | 11:15 | |
*** prithiv has joined #kolla | 11:17 | |
elemoine_ | sdake: the Fuel plugin does more that Kibana, it also sets up Elasticsearch | 11:17 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Multinode Docker cleanup https://review.openstack.org/289943 | 11:17 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Make neutron-openvswitch-agent dependent on openvswitch-vswitchd https://review.openstack.org/289349 | 11:17 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Use constraints only on multinode deployment https://review.openstack.org/285970 | 11:17 |
akwasnie | sdake, elemoine_: give me a second to read | 11:20 |
openstackgerrit | Merged openstack/kolla-mesos: Support dependencies inside one host https://review.openstack.org/284737 | 11:27 |
sdake | akwasnie i told my wife i didn't know it was woman's day | 11:28 |
openstackgerrit | Merged openstack/kolla-mesos: Dependency between nova-libvirt and nova-compute inside host https://review.openstack.org/284815 | 11:28 |
sdake | she said that is because its man's day the other 364 days of the year | 11:28 |
openstackgerrit | Merged openstack/kolla-mesos: Allow to override resources in globals.yml https://review.openstack.org/284836 | 11:28 |
sdake | akwasnie so basically there is a yml file | 11:28 |
sdake | that gets loaded into elastic search | 11:29 |
akwasnie | so the idea is to have a predefined Kibana dashboard, right? maybe there is a way to use this plugin without fuel, we should look into it or find alternative solution | 11:29 |
sdake | the fuel plugi has this yaml file for kibana 3 | 11:29 |
sdake | it needs to work on kibana 4 | 11:29 |
sdake | i'd like to see it done for mitaka if possible | 11:29 |
openstackgerrit | Prithiv proposed openstack/kolla: Steps to install required additional clients Related-Bug: #1554780 https://review.openstack.org/290399 | 11:29 |
openstack | bug 1554780 in kolla "Update the documentation about installation of curl, nova, neutron clients" [Low,Confirmed] https://launchpad.net/bugs/1554780 - Assigned to Prithiv (prithiv) | 11:29 |
sdake | I dont htink its all that difficult | 11:29 |
sdake | but I relay don't know | 11:30 |
akwasnie | is it yml for kibana configuration? | 11:30 |
sdake | yaml for elastic search | 11:30 |
sdake | you load via curl | 11:30 |
sdake | right now we have logs in elastic search with no predefined dashboard | 11:31 |
sdake | what we need is a predefined dashboard to really finish the job on diags | 11:31 |
akwasnie | oh ok | 11:31 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Multinode Docker cleanup https://review.openstack.org/289943 | 11:31 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Make neutron-openvswitch-agent dependent on openvswitch-vswitchd https://review.openstack.org/289349 | 11:31 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Use constraints only on multinode deployment https://review.openstack.org/285970 | 11:31 |
akwasnie | I will look at this | 11:31 |
sdake | look at the irc logs, there is a git repo containing hte kibana 3 fuel plugin | 11:33 |
sdake | i don't have any idea how any of this stuff works | 11:33 |
sdake | but playiing around with kibana, its not all tha tueful as is because its not tuned for openstack | 11:33 |
akwasnie | yes I am looking at it now | 11:33 |
sdake | i may be able to find you extra help as well | 11:34 |
sdake | if you want to take it on | 11:34 |
sdake | now that upgrades are pretty much done | 11:34 |
sdake | need testing but done | 11:34 |
akwasnie | yes sure thanks, I will let you know | 11:34 |
*** mlima has joined #kolla | 11:34 | |
sdake | pretty much there is 3 weeks to get a working implementation of this yaml file | 11:35 |
sdake | andlearn how to load it into ES | 11:35 |
akwasnie | I will investigate this | 11:36 |
akwasnie | about women's day: I think your wife is rigt:) | 11:36 |
*** prithiv has quit IRC | 11:36 | |
sdake | welll fwiw your proposal for core had nothing to do with womans day | 11:36 |
sdake | man woman cricket i don't care :) | 11:37 |
sdake | whoever does good work makes it in :) | 11:37 |
openstackgerrit | Kuo-tung Kao proposed openstack/kolla: add unit tests for build script https://review.openstack.org/290423 | 11:38 |
*** prithiv has joined #kolla | 11:39 | |
akwasnie | neither do i :) | 11:40 |
*** kjelly_ has joined #kolla | 11:42 | |
*** kproskurin has quit IRC | 11:42 | |
mlima | someone can test it https://review.openstack.org/#/c/289303/ ? | 11:43 |
*** dencaval has joined #kolla | 11:45 | |
openstackgerrit | Merged openstack/kolla: Upgrade Heat https://review.openstack.org/290309 | 11:46 |
openstackgerrit | Prithiv proposed openstack/kolla: Steps to install required additional clients https://review.openstack.org/290399 | 11:49 |
*** kproskurin has joined #kolla | 11:49 | |
kproskurin | sdake: About rabbitmq problem with single quotes and Ubuntu. I just tested it with 3 nodes cluster in Ubuntu 14.04 with 4.2 kernel and it’s works. | 11:54 |
kproskurin | http://fpaste.org/336131/24444145/ | 11:54 |
kproskurin | One small thing…. I tested it with RabbitMQ 3.5.6-1 | 11:55 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Add ceph wait before bootstrap https://review.openstack.org/290273 | 11:55 |
kproskurin | SamYaple: ^^ | 11:57 |
kproskurin | its about https://review.openstack.org/#/c/288415/ | 11:58 |
SamYaple | kproskurin: rabbitmq 3.5.5 is whats in the gate if i recall correctly | 11:58 |
kproskurin | I know | 11:58 |
kproskurin | Sadly I do test in a bit different env | 11:59 |
SamYaple | the real queestion is are you _sure_ itsetup multinode ocrrectly | 11:59 |
SamYaple | what does cluster_status show? | 11:59 |
kproskurin | 1 sec | 11:59 |
kproskurin | http://fpaste.org/336136/24796145/ | 12:00 |
kproskurin | ops, its just status | 12:00 |
kproskurin | 1 sec | 12:00 |
kproskurin | http://fpaste.org/336137/57524827/ | 12:00 |
SamYaple | can you test with our kolla images since thats where it broke for me? | 12:02 |
sdake | kproskurin were ou teh persosn who reported the bug? | 12:03 |
ccesario | good morning! | 12:03 |
kproskurin | SamYaple: I’ll do, but I do test in kolla-mesos and right now multinode is not working in kolla-mesos :-\ We going to fix it soon and Ill tets with upstream images. | 12:06 |
sdake | SamYaple have yu seen this error before? | 12:06 |
kproskurin | sdake: Nope, bug was reported by someone else before my patch | 12:06 |
sdake | http://paste.fedoraproject.org/336139/14575251/ -> http://paste.fedoraproject.org/336139/14575251 | 12:06 |
*** salv-orlando has joined #kolla | 12:06 | |
SamYaple | sdake: read the bug. it was "fixed" then reverted for breaking ubuntu multinode | 12:06 |
sdake | differnet bug here sam | 12:06 |
sdake | i changed topics | 12:07 |
ccesario | sdake, after destroy my test env and recreate it rom "zero" .... that problem about keystone does not happen | 12:07 |
sdake | ccesario thats good news, your docker cache probably needed to be kolla-ansible pull'ed | 12:07 |
openstackgerrit | Sam Yaple proposed openstack/kolla: Remove storage_hostname https://review.openstack.org/289955 | 12:08 |
openstackgerrit | Merged openstack/kolla: mariadb-devel is deprecated https://review.openstack.org/290279 | 12:08 |
sdake | SamYaple check out that paste | 12:09 |
sdake | any suggetion s to hwo to fix that, my vms fail to boot | 12:09 |
sdake | STDAKE-M-J2VL:demo sdake$ nova boot --image cirros --flavor m1.small --nic net-id=cd03675f-f2fd-48c1-a19d-a691f10e0cf9 steak2 | 12:09 |
sdake | this is the command i run | 12:09 |
ccesario | sdake, but I'm facing a new bit problem ... let me try investigate and then I report here | 12:11 |
*** akwasnie has quit IRC | 12:11 | |
*** kproskurin has quit IRC | 12:11 | |
*** kproskurin has joined #kolla | 12:13 | |
*** akwasnie has joined #kolla | 12:17 | |
sdake | here is a cool script I found on the internet which shows disk utilization of the running docker containers: | 12:20 |
sdake | http://paste.fedoraproject.org/336147/52601814/ -> http://paste.fedoraproject.org/336147/52601814 | 12:20 |
*** Marga__ has joined #kolla | 12:24 | |
*** prithiv1 has joined #kolla | 12:25 | |
*** kejlly_ has joined #kolla | 12:26 | |
*** prithiv has quit IRC | 12:27 | |
*** vincent_vdk has quit IRC | 12:27 | |
*** kjelly has quit IRC | 12:27 | |
*** rhallisey has quit IRC | 12:27 | |
*** Marga_ has quit IRC | 12:27 | |
*** zeus has quit IRC | 12:27 | |
*** akwasnie has quit IRC | 12:27 | |
*** vincent_vdk has joined #kolla | 12:27 | |
openstackgerrit | Merged openstack/kolla: Rename validate-docker-execute with .sh extension https://review.openstack.org/290274 | 12:29 |
*** zeus has joined #kolla | 12:30 | |
*** dencaval has quit IRC | 12:30 | |
*** zeus is now known as Guest8646 | 12:30 | |
*** coolsvap_ has quit IRC | 12:32 | |
*** Jeffrey4l has joined #kolla | 12:38 | |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Add empty string to KOLLA_BOOTSTRAP env variable. https://review.openstack.org/290030 | 12:39 |
openstackgerrit | Merged openstack/kolla: Fix the deprecated security_group_api and network_api_class https://review.openstack.org/289823 | 12:39 |
*** rhallisey has joined #kolla | 12:39 | |
*** prithiv1 has quit IRC | 12:41 | |
openstackgerrit | Allen Gao proposed openstack/kolla-mesos: Fix the deprecated security_group_api and network_api_class https://review.openstack.org/290454 | 12:44 |
*** dencaval has joined #kolla | 12:44 | |
*** akwasnie has joined #kolla | 12:48 | |
*** thumpba has joined #kolla | 12:50 | |
sdake | SamYaple have you booted a vm in Kola recently? | 12:52 |
sdake | or anyone else for that matter? | 12:52 |
sdake | running into this: https://ask.openstack.org/en/question/26938/virtualinterfacecreateexception-virtual-interface-creation-failed/ | 12:52 |
sdake | which basically says "neutron and nova are misconfigured" | 12:52 |
openstackgerrit | Eric Lemoine proposed openstack/kolla: Add cron image and playbook https://review.openstack.org/288432 | 12:54 |
mlima | someone can help me reviewing it https://review.openstack.org/#/c/289303 | 13:00 |
* sdake groans | 13:02 | |
mlima | kolla already supports ansible 2.0? | 13:02 |
sdake | no | 13:02 |
*** dims has quit IRC | 13:05 | |
*** dims_ has joined #kolla | 13:05 | |
*** dims_ has quit IRC | 13:10 | |
sbezverk | sdake I did, cirros | 13:10 |
sdake | sbezverk and it went into active state? | 13:11 |
sdake | are you using master or some other version? | 13:11 |
sbezverk | sdake yes and I could ping outside | 13:11 |
sdake | can you tell me your commit id plz | 13:11 |
sdake | centos binary? | 13:11 |
sbezverk | sdake centos source | 13:11 |
sdake | yeah i'm trying centos source right now | 13:12 |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Add empty string to KOLLA_BOOTSTRAP env variable. https://review.openstack.org/290030 | 13:12 |
sdake | sbezverk btw, rhallisey says you don't need iscsid, ou need tgtd | 13:12 |
sdake | which is what I recall as well | 13:13 |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Add empty string to KOLLA_BOOTSTRAP env variable. https://review.openstack.org/290030 | 13:13 |
sdake | I don't know the delta between teh two daemons | 13:13 |
*** dims has joined #kolla | 13:14 | |
*** akwasnie has quit IRC | 13:14 | |
*** prithiv has joined #kolla | 13:15 | |
*** kproskurin has quit IRC | 13:20 | |
*** dave-mccowan has joined #kolla | 13:22 | |
sbezverk | sdake not sure tgtd, I have all-in-one installation with cinder using iscsi lvm volumes and there is no tftg process active, only iscsid.. but I might be wrong.. | 13:23 |
sdake | investigate tgtd | 13:24 |
sdake | see how it relates to iscsid | 13:24 |
sdake | i think they are copetiting projects | 13:24 |
sdake | we gotit to work at oen point with tgtd | 13:24 |
sdake | back in the compose days | 13:24 |
sbezverk | sdake will do that.. | 13:25 |
sdake | i asked rhallisey to send you a copy of his docker files from the old days of tgtd | 13:25 |
sdake | when we hda it working | 13:25 |
sdake | alternately oyu can try checking out milestone-4 from the repository | 13:25 |
sdake | i'm not sure if thta is the exact tag name | 13:26 |
rhallisey | sbezverk, https://github.com/openstack/kolla/blob/master/docker/cinder/cinder-volume/Dockerfile.j2#L9 | 13:27 |
rhallisey | sbezverk, take out scsi-target-utils | 13:27 |
sbezverk | sdake that would be great to see something working other than systemd fueled ;-) | 13:27 |
rhallisey | that will be your scsi container | 13:27 |
sbezverk | rhallisey thank you, I will give it a try.. | 13:30 |
*** jtriley has joined #kolla | 13:35 | |
*** kproskurin has joined #kolla | 13:37 | |
*** v1k0d3n has quit IRC | 13:38 | |
*** v1k0d3n has joined #kolla | 13:39 | |
*** kproskurin has quit IRC | 13:41 | |
*** kzaitsev_ws has quit IRC | 13:41 | |
*** dwalsh has joined #kolla | 13:42 | |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Open Docker TCP socker in Vagrant https://review.openstack.org/290504 | 13:50 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Open Docker TCP socket in Vagrant https://review.openstack.org/290504 | 13:51 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Multinode Docker cleanup https://review.openstack.org/289943 | 13:52 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Open Docker TCP socket in Vagrant https://review.openstack.org/290504 | 13:52 |
*** salv-orlando has quit IRC | 13:55 | |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Add empty string to KOLLA_BOOTSTRAP env variable. https://review.openstack.org/290030 | 13:58 |
*** akwasnie has joined #kolla | 14:04 | |
*** salv-orlando has joined #kolla | 14:07 | |
*** jtriley has quit IRC | 14:10 | |
*** salv-orlando has quit IRC | 14:14 | |
sbezverk | rhallisey you were right, it is working.. I am curious why I see different on my normally installed all in one openstack. I suspect that cinder instead of using tgtd uses iscsid and targetcli tools. | 14:17 |
rhallisey | at first I tried that. tgt was the only one I could get to work | 14:19 |
mlima | someone ran kolla-ansible deploy today? | 14:20 |
mlima | i have this error TASK: [neutron | Starting neutron-dhcp-agent container] msg: APIError(HTTPError(u'500 Server Error: Internal Server Error for url: http+docker://localunixsocket/v1.22/containers/neutron_dhcp_agent/start',),) | 14:20 |
sbezverk | rhallisey this would mean, that cinder interface (iscsi) driver will needs to be modified... | 14:20 |
*** chandankumar has quit IRC | 14:20 | |
mlima | and it docker rm -v -f neutron_dhcp_agent not works for me | 14:21 |
ccesario | sdake, http://paste.openstack.org/show/489849/ ... ceph is needed by deploy!? | 14:27 |
ccesario | mlima, run on target node mount --make-shared /run ... it solves this for me | 14:28 |
mlima | i solved ;P | 14:28 |
*** iceyao has joined #kolla | 14:28 | |
sdake | Jeffrey4l ping re reconfigure and nova-compute | 14:29 |
sdake | ansible detects the file has changed, but skips the restart of the compute service | 14:29 |
Jeffrey4l | could you post the log out? sdake | 14:31 |
Jeffrey4l | add the `-vvv` parameter. | 14:32 |
sdake | Jeffrey4l http://paste.openstack.org/raw/489850/ | 14:32 |
openstackgerrit | Artur Zarzycki proposed openstack/kolla-mesos: Switch services to use mesos-dns names https://review.openstack.org/290181 | 14:36 |
rhallisey | sbezverk, I'm not sure tbh. I think it just needs to be directed to run with tgt | 14:36 |
*** kjelly_ has quit IRC | 14:39 | |
sdake | Jeffrey4l notice the [changed] | 14:40 |
sdake | but [skipped] on nova-compute | 14:40 |
sdake | Jeffrey4l the node is merging the configs properly, /etc/nova/nova-compute.conf has the modified contents | 14:43 |
Jeffrey4l | sdake, yea. I reproduced this in my env. I will debug why it not works. | 14:44 |
sdake | cool thanks - have suggestion for a different thing to show reconfig on? | 14:45 |
*** spisarski has joined #kolla | 14:45 | |
sdake | this is obvious becausei can run ps -ef and see qemu is runing instead of kvm binary | 14:45 |
Jeffrey4l | sdake, nice catch! thanks. | 14:47 |
sdake | does this affect all reconfig or just nova-copute? | 14:47 |
sdake | need to check corp email brb | 14:48 |
Jeffrey4l | sdake, just nova-* containers. these are little complicate than others. | 14:50 |
*** sdake_ has joined #kolla | 14:50 | |
*** chandankumar has joined #kolla | 14:51 | |
*** sdake has quit IRC | 14:53 | |
*** inc0 has joined #kolla | 14:56 | |
*** sdake has joined #kolla | 14:58 | |
*** sdake_ has quit IRC | 15:00 | |
*** prithiv has quit IRC | 15:03 | |
*** prithiv has joined #kolla | 15:04 | |
*** iceyao has quit IRC | 15:05 | |
*** prithiv has quit IRC | 15:05 | |
*** iceyao has joined #kolla | 15:05 | |
*** prithiv has joined #kolla | 15:07 | |
*** prithiv has quit IRC | 15:09 | |
sdake | elemoine ping | 15:12 |
*** vhosakot has joined #kolla | 15:14 | |
*** inc0 has quit IRC | 15:19 | |
*** inc0 has joined #kolla | 15:20 | |
cloudnull | sdake: pong | 15:26 |
cloudnull | hows it? | 15:26 |
*** akwasnie has quit IRC | 15:27 | |
sdake | cloudnull hey morning | 15:27 |
sdake | going well | 15:27 |
sdake | i forgot what i wanted to speak with you about | 15:27 |
sdake | so it probably wasn't important | 15:27 |
sdake | i may have just been greetign you | 15:27 |
cloudnull | ha :) no worries. | 15:27 |
cloudnull | im awake if you remember :) | 15:27 |
cloudnull | *im awake now | 15:27 |
sdake | i think it was just a greeting | 15:28 |
cloudnull | good day to you too :) | 15:28 |
sdake | beeen up all ngiht preppign for a demo | 15:29 |
sdake | fun :( | 15:29 |
cloudnull | i hate live demos | 15:29 |
cloudnull | they always work like "live demos" | 15:29 |
*** iceyao has quit IRC | 15:29 | |
sdake | i'e run this one several times and everything is good to go except one thing Jeffrey4l is woring on fixing in nova reconfigure | 15:30 |
inc0 | ooo Kevin here | 15:30 |
inc0 | hey all:) | 15:30 |
sdake | hey inc0 | 15:30 |
sdake | did you get a speaer pass for our merged session on upgrades | 15:30 |
sdake | my wife said only onoe person per talk gets a speaker pass now | 15:31 |
inc0 | I did | 15:31 |
inc0 | get speaker pass | 15:31 |
*** akwasnie has joined #kolla | 15:31 | |
inc0 | really, that's sux | 15:31 |
inc0 | that sux | 15:31 |
sdake | this kibana integration is going to be bonkers good | 15:31 |
sdake | akwasnie and elemoine and possiby some others are going to work on a json dashboard port from fuel's integratoin of kibana 3 | 15:32 |
*** blahRus has joined #kolla | 15:32 | |
sdake | basically you register json with ES and kibana displays special thigns related to the application in question | 15:32 |
sdake | heka rocks - sseems like good choice | 15:33 |
sdake | i like how each node has logs | 15:33 |
sdake | and then they are centrlaized | 15:33 |
sdake | exactly what I wanted | 15:33 |
sdake | didnt' expect that to land and all work but it appears to :) | 15:34 |
openstackgerrit | Paul Bourke proposed openstack/kolla: Add centos-extras repo to oraclelinux-base https://review.openstack.org/290591 | 15:34 |
sdake | inc0 here is what i ended up with http://docs.openstack.org/developer/kolla/liberty-deployment-warning.html | 15:35 |
sdake | and we can revert tht change once executed | 15:35 |
inc0 | ok | 15:35 |
inc0 | your initial approach kinda scared me:P | 15:35 |
sdake | i didn't want it in master | 15:35 |
sdake | I meant it for stable | 15:35 |
sdake | somehow i put in wrong branch | 15:36 |
sdake | but doc also works | 15:36 |
ccesario | sdake, http://sprunge.us/TZgX?ini any idea!? | 15:36 |
sdake | inc0 heat upgrades are done | 15:36 |
inc0 | when I'll get free moment I'll fix up rabbitmq | 15:37 |
sdake | ccesario put your ip and hosstname in e/tc/hosts | 15:37 |
sdake | on all 3 odes | 15:38 |
sdake | or alternately etup dns | 15:38 |
sdake | part of our code base uses the resolver | 15:38 |
sdake | i think SamYaple is working on a fix to not use the resolver, ubut i'm not certain | 15:38 |
sdake | brb need to login to crop net | 15:40 |
*** sdake_ has joined #kolla | 15:41 | |
*** sdake has quit IRC | 15:41 | |
ccesario | sdake_, hmmmm .... let me do it.... | 15:46 |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Fix the nova reconfig not work issue https://review.openstack.org/290604 | 15:46 |
Jeffrey4l | sdake_, ^ | 15:46 |
openstackgerrit | Merged openstack/kolla: Do not create /dev/log symlink if it already exists https://review.openstack.org/290357 | 15:52 |
sdake_ | Jeffrey4l patch works! | 15:54 |
Jeffrey4l | sdake_, yes. But more test should test.. | 15:55 |
sdake_ | understood | 15:55 |
sbezverk | when deployment of a service fails with this "APIError(HTTPError('500 Server Error" is there a way to get mode detailed info? | 15:56 |
sbezverk | I tried -v it does not give much of extra info | 15:56 |
*** ssurana has joined #kolla | 15:59 | |
sdake_ | docker exec heka cat /var/log/service/service-container.log | 16:00 |
sdake_ | or you can enable elasticsearch and give that a spin | 16:00 |
sdake_ | need 20 mins for breakfast, bbiaf | 16:01 |
ccesario | sdake_, the same error ....even after after add ip and hostname into /etc/hosts ...... http://sprunge.us/FWYd?ini http://sprunge.us/MjWa?sh | 16:02 |
sdake_ | did you add all 3 hosts to all 3 nodes ? | 16:03 |
ccesario | yes... http://sprunge.us/MjWa?sh | 16:03 |
sdake_ | ccesario I'm not sure then, but I know its being worked on by atleast two different people | 16:04 |
sdake_ | you can try my revert patch in the queue i you want to get on with yoru day :) | 16:04 |
sdake_ | that wfm but then there is no ceph implementation | 16:04 |
ccesario | which patch ? :) | 16:05 |
*** prithiv has joined #kolla | 16:09 | |
sbezverk | sdake I do not see /var/log/service/service-container.log in heka container | 16:09 |
*** sdake has joined #kolla | 16:14 | |
ccesario | sdake, which patch ? :) | 16:15 |
*** sdake_ has quit IRC | 16:15 | |
*** sdake_ has joined #kolla | 16:17 | |
sdake_ | dave-mccowan ping do you know where the cert file is stored in the filesystem | 16:17 |
sdake_ | /etc/kolla/haproxy/? | 16:17 |
*** absubram has joined #kolla | 16:17 | |
dave-mccowan | on the build node, you can find it in /etc/kolla/certificates/haproxy-ca.crt and haproxy.pem | 16:18 |
*** inc0 has quit IRC | 16:18 | |
sdake_ | thanks | 16:18 |
*** sdake has quit IRC | 16:19 | |
sdake_ | team meeting in 10 minutes in openstack-meeting-4 | 16:21 |
*** coolsvap has joined #kolla | 16:21 | |
sdake_ | hey coolsvap | 16:21 |
*** sdake_ is now known as sdake | 16:21 | |
coolsvap | sdake: hi | 16:21 |
*** inc0 has joined #kolla | 16:24 | |
ccesario | sdake, which patch did you mean? | 16:25 |
SamYaple | hello. to fix the ubuntu gate failures i need two patches merged. https://review.openstack.org/#/c/290273/ and https://review.openstack.org/#/c/289955/ | 16:25 |
SamYaple | the second patch shows the gate working on the RAX node | 16:25 |
sdake | ccesario https://review.openstack.org/#/c/290243/ | 16:25 |
sdake | SamYaple i wont hae time to review for about 2 hours | 16:26 |
sdake | rather 3 hours | 16:26 |
sdake | back to back meetings | 16:26 |
sdake | after that i'll hve a look | 16:26 |
openstackgerrit | Merged openstack/kolla: Add empty string to KOLLA_BOOTSTRAP env variable. https://review.openstack.org/290030 | 16:29 |
sdake | SamYaple meeting if you can mke it | 16:31 |
sdake | coolsvap meeting if you can make it | 16:31 |
*** mbound has quit IRC | 16:32 | |
*** dims has quit IRC | 16:33 | |
*** Jeffrey4l has quit IRC | 16:34 | |
coolsvap | sdake: yes i joined for the same i am not counting the hours well | 16:34 |
*** Jeffrey4l has joined #kolla | 16:35 | |
openstackgerrit | Mauricio Lima proposed openstack/kolla: Reconfigure mariadb service https://review.openstack.org/289303 | 16:36 |
mlima | Jeffrey4l, i finished reconfigure mariadb :) | 16:39 |
Jeffrey4l | mlima, cool | 16:42 |
openstackgerrit | Rodolfo Alonso Hernandez proposed openstack/kolla: Fixed typo in variable "ironic_public_endpoint" https://review.openstack.org/290642 | 16:43 |
mlima | i had to change the conf file to test, but everything worked Jeffrey4l | 16:43 |
Jeffrey4l | mlima, great. I will test it later. | 16:44 |
*** dims has joined #kolla | 16:44 | |
*** mikelk has quit IRC | 16:45 | |
*** Serlex has quit IRC | 16:49 | |
*** spisarski1 has joined #kolla | 16:54 | |
*** spisarski has quit IRC | 16:54 | |
*** spisarski1 has quit IRC | 17:01 | |
*** spisarski has joined #kolla | 17:01 | |
openstackgerrit | Merged openstack/kolla: Add ceph wait before bootstrap https://review.openstack.org/290273 | 17:11 |
openstackgerrit | Merged openstack/kolla: Remove storage_hostname https://review.openstack.org/289955 | 17:12 |
openstackgerrit | Paul Bourke proposed openstack/kolla: Add centos-extras repo to oraclelinux-base https://review.openstack.org/290591 | 17:15 |
*** fgimenez has quit IRC | 17:16 | |
*** prithiv has quit IRC | 17:21 | |
fthiagogv | SamYaple, can you change the status of this bug https://bugs.launchpad.net/kolla/+bug/1554493 ? Your commit fix it, but was merged without closesbug tag. | 17:27 |
openstack | Launchpad bug 1554493 in kolla "cinder_volume is down after deployment" [Critical,Triaged] - Assigned to Prithiv (prithiv) | 17:27 |
SamYaple | fthiagogv: that doesnt look related to my fix | 17:28 |
SamYaple | mlima: did that patch fix that bug? | 17:28 |
mlima | yes | 17:29 |
mlima | :) | 17:29 |
SamYaple | ok ill update | 17:29 |
*** spisarski has quit IRC | 17:29 | |
openstackgerrit | Merged openstack/kolla: Do not make Kibana available at the external VIP https://review.openstack.org/290339 | 17:29 |
inc0 | afk | 17:29 |
vhosakot | sdake: Jeremey replied saying ubuntu gate should be fixed soon | 17:32 |
sdake | its not infra's fault afaik | 17:32 |
vhosakot | sdake: ah ok | 17:32 |
*** spisarski has joined #kolla | 17:32 | |
*** mbound has joined #kolla | 17:33 | |
*** inc0 has quit IRC | 17:34 | |
pbourke | sdake: oraclelinux-binary build seems to be filling the disk on the gate. do you know what the limits are or how to find out? | 17:34 |
*** prithiv has joined #kolla | 17:34 | |
sdake | pbourke you can run df in the setup_gate script and see the disk space | 17:35 |
sdake | i dont know the limits | 17:35 |
pbourke | sdake: ok thanks - there's no way to log into a gate then? | 17:36 |
sdake | no | 17:36 |
*** prithiv has quit IRC | 17:38 | |
*** mbound has quit IRC | 17:38 | |
*** dwalsh has quit IRC | 17:42 | |
*** ednez has joined #kolla | 17:43 | |
SamYaple | x | 17:43 |
*** athomas has quit IRC | 17:47 | |
*** Marga__ has quit IRC | 17:49 | |
*** mbound has joined #kolla | 17:49 | |
*** mbound has quit IRC | 17:50 | |
*** thumpba has quit IRC | 17:50 | |
*** thumpba has joined #kolla | 17:51 | |
*** inc0 has joined #kolla | 17:52 | |
pbourke | seems the binary version of oraclelinux-base is over twice the size of binary centos-base | 17:54 |
pbourke | even those the top level images are almost identical in size | 17:54 |
pbourke | *even though | 17:54 |
sdake | that is odd | 17:55 |
sdake | yo ucan decompose thtelayers and figure out why | 17:55 |
pbourke | yeah that's prob my next step | 17:55 |
SamYaple | pbourke: lots of deps im sure | 17:58 |
SamYaple | proabably installing anything remotely related | 17:59 |
*** inc0 has quit IRC | 17:59 | |
pbourke | SamYaple: yeah the packages are the same as rht though as far as I know | 17:59 |
*** akwasnie has quit IRC | 17:59 | |
SamYaple | afaik rdo binary is twice the size of source just fyi | 17:59 |
SamYaple | i know ubuntu-binry is about 80% larger | 17:59 |
*** macsz has quit IRC | 18:00 | |
pbourke | yeah id expect that - but in this case its centos binary vs ol binary | 18:00 |
SamYaple | ah | 18:00 |
SamYaple | yea idk | 18:00 |
*** inc0 has joined #kolla | 18:02 | |
sbezverk | sdake have a minute? | 18:03 |
*** shardy has quit IRC | 18:03 | |
*** mdnadeem_home has joined #kolla | 18:04 | |
*** jmccarthy1 has quit IRC | 18:04 | |
*** akwasnie has joined #kolla | 18:04 | |
*** akwasnie has quit IRC | 18:05 | |
*** Jeffrey4l has quit IRC | 18:05 | |
vhosakot | pbourke: you can try adding "df" and "lsblk" intools/setup_gate.sh | 18:06 |
*** Marga_ has joined #kolla | 18:08 | |
*** Marga_ has quit IRC | 18:09 | |
ccesario | sdake, even apply the patch... the deploy terminate in the same point... log: http://sprunge.us/fVIG?ini patch: http://sprunge.us/QGXZ?diff | 18:10 |
sdake | ccesario not sure, in meeting, can I get back with you in a few hours | 18:10 |
*** Marga_ has joined #kolla | 18:11 | |
sdake | i've gotta jet - bbiaf | 18:11 |
*** sdake has quit IRC | 18:11 | |
ccesario | ok :) | 18:11 |
ccesario | pbourke, are you deployed multinode ... rigth ? Using oraclelinux!? | 18:13 |
*** Marga_ has quit IRC | 18:17 | |
sbezverk | SamYaple a file .json.j2 in template folder defines executable which gets launched when the container start right? | 18:17 |
*** ednez has quit IRC | 18:17 | |
SamYaple | sbezverk: yes | 18:21 |
*** jasonsb has quit IRC | 18:22 | |
*** Marga_ has joined #kolla | 18:22 | |
*** jmccarthy1 has joined #kolla | 18:24 | |
*** jmccarthy1 has quit IRC | 18:24 | |
*** jmccarthy1 has joined #kolla | 18:24 | |
sbezverk | SamYaple : I am getting this error and container keeps restarting: ERROR:__main__:Invalid json file found at /var/lib/kolla/config_files/config.json | 18:25 |
*** mdnadeem_home has quit IRC | 18:25 | |
sbezverk | I suspect the issue is in the syntaxt of my iscsi json file | 18:25 |
sbezverk | could you quickly check? | 18:25 |
sbezverk | SamYaple http://paste.openstack.org/show/489889/ | 18:26 |
SamYaple | if thats the final file, thats not valid json | 18:27 |
SamYaple | thats got jinja2 | 18:27 |
sbezverk | SamYample If I do not need any on fly modification, then I can get rid of conditionals and just leave the command statement? | 18:30 |
openstackgerrit | Merged openstack/kolla: Fixed typo in variable "ironic_public_endpoint" https://review.openstack.org/290642 | 18:33 |
*** coolsvap has quit IRC | 18:34 | |
*** chandankumar has quit IRC | 18:35 | |
*** jmccarthy1 has quit IRC | 18:43 | |
*** dims has quit IRC | 18:44 | |
*** dims has joined #kolla | 18:46 | |
*** inc0_ has joined #kolla | 18:47 | |
*** inc0 has quit IRC | 18:47 | |
*** dwalsh has joined #kolla | 18:50 | |
*** Marga_ has quit IRC | 18:53 | |
*** Marga_ has joined #kolla | 18:54 | |
*** jtriley has joined #kolla | 18:56 | |
*** sdake has joined #kolla | 18:57 | |
sdake | wireless dropout ftl | 18:57 |
openstackgerrit | Mauricio Lima proposed openstack/kolla: Fix Manila v2 endpoint https://review.openstack.org/290775 | 18:58 |
*** pbourke has quit IRC | 19:13 | |
*** pbourke has joined #kolla | 19:13 | |
*** ruhe has quit IRC | 19:19 | |
kfox1111 | So, what ever happened with the request for docker container storage? | 19:20 |
kfox1111 | the containers out on hub.docker.com look pretty old? | 19:20 |
*** ruhe has joined #kolla | 19:21 | |
*** inc0___ has joined #kolla | 19:25 | |
SamYaple | kfox1111: it never materalized due to docker registry being broken | 19:25 |
SamYaple | that was fixed in 1.10 and registry 2.3 | 19:25 |
kfox1111 | bummer. :/ | 19:25 |
*** inc0___ has quit IRC | 19:25 | |
kfox1111 | I saw the thread with infra about hosting locally. what ever happened to that? | 19:25 |
SamYaple | i dont have the cycles until newton, but well likely be doing a push-per-day thing | 19:26 |
SamYaple | inside of infra | 19:26 |
SamYaple | dont recall that thread | 19:26 |
kfox1111 | what about for stable? | 19:26 |
SamYaple | for all branches | 19:27 |
kfox1111 | (looking at maybe using kolla for horizon on this cloud) | 19:27 |
*** inc0 has joined #kolla | 19:27 | |
kfox1111 | nice. k. | 19:27 |
SamYaple | but like i said, dont expect that work until ~newton/april-may | 19:27 |
kfox1111 | k. so, for now I'll build it myself and push to a local repo. and then in the future, I can just pull from stable. | 19:28 |
kfox1111 | that sounds good to me. thanks. :) | 19:28 |
*** inc0_ has quit IRC | 19:28 | |
SamYaple | yup thats the plan | 19:28 |
*** sdake_ has joined #kolla | 19:30 | |
*** sdake has quit IRC | 19:32 | |
*** gfidente is now known as gfidente|afk | 19:41 | |
kfox1111 | what redhat package provides python(git) ? | 19:42 |
*** gfidente|afk has quit IRC | 19:43 | |
kfox1111 | can you use a centos7 box to build the images? | 19:45 |
kfox1111 | ah. GitPython. | 19:47 |
kfox1111 | strange it wasn't found with a yum search. | 19:47 |
*** salv-orlando has joined #kolla | 19:51 | |
*** salv-orl_ has joined #kolla | 19:53 | |
openstackgerrit | Vikram Hosakote proposed openstack/kolla: Reconfigure rabbitmq service https://review.openstack.org/290816 | 19:55 |
mlima | Hello guys, i have this error ERROR (ClientException): Unexpected API Error. Please report this at http://bugs.launchpad.net/nova/ and attach the Nova API log if possible. | 19:56 |
mlima | <class 'oslo_messaging.exceptions.MessagingTimeout'> (HTTP 500) (Request-ID: req-ff93e171-adaa-47fe-8ae4-8902e705b580) | 19:56 |
*** salv-orlando has quit IRC | 19:56 | |
*** inc0 has quit IRC | 19:56 | |
mlima | when i try to boot an instance on nova | 19:56 |
*** inc0 has joined #kolla | 19:57 | |
*** inc0 has quit IRC | 20:08 | |
*** inc0 has joined #kolla | 20:19 | |
*** sdake has joined #kolla | 20:21 | |
*** sdake_ has quit IRC | 20:23 | |
*** inc0 has quit IRC | 20:31 | |
*** inc0 has joined #kolla | 20:31 | |
openstackgerrit | Katie McEwen proposed openstack/kolla: Fix a few small typos and formatting. https://review.openstack.org/290835 | 20:33 |
*** vhosakot has quit IRC | 20:43 | |
kfox1111 | I keep getting: Cannot open: http://repo.percona.com/release/7/RPMS/x86_64/percona-release-0.1-3.noarch.rpm. Skipping. | 20:43 |
*** salv-orl_ has quit IRC | 20:43 | |
kfox1111 | while trying to build the horizon container. | 20:43 |
kfox1111 | works from the host though... | 20:44 |
kfox1111 | any ideas? | 20:44 |
*** vhosakot has joined #kolla | 20:45 | |
*** dwalsh has quit IRC | 20:49 | |
SamYaple | kfox1111: are you able to `wget http://repo.percona.com/release/7/RPMS/x86_64/percona-release-0.1-3.noarch.rpm` outside of docker? | 20:50 |
SamYaple | are you using a proxy? | 20:50 |
kfox1111 | yes, and no. | 20:52 |
kfox1111 | hmm... its working on my laptop with the same checkout... | 20:53 |
kfox1111 | so must be a strange network issue on the other host. | 20:53 |
SamYaple | yea i doubt its the code | 20:53 |
SamYaple | it may have been the repo itself having trouble for a bit | 20:54 |
kfox1111 | I'm running them in parallel now. the laptop's working, the build host not... | 20:54 |
kfox1111 | so somethings up with the docker nat I think. | 20:54 |
*** inc0 has quit IRC | 20:56 | |
ccesario | is it needed define a host in storage section in inventory file ? or like this http://www.fraction.jp/log/archives/2015/12/02/multi-node-openstack-kolla (inventory section) is acceptable ? | 20:56 |
*** inc0 has joined #kolla | 21:01 | |
*** dims has quit IRC | 21:05 | |
*** macsz has joined #kolla | 21:09 | |
vhosakot | SamYaple: I'm working on drop root for neutron and I see that all the Dockerfile.j2 files for neutron except for /neutron-linuxbridge-agent already have "USER neutron".. was it purposely done ? If not, I will fix this and add "USER root" for /neutron-linuxbridge-agent's Dockerfile as well? | 21:10 |
*** thumpba has quit IRC | 21:13 | |
*** thumpba has joined #kolla | 21:14 | |
vhosakot | SamYaple: pimg | 21:14 |
openstackgerrit | Merged openstack/kolla: Fix a few small typos and formatting. https://review.openstack.org/290835 | 21:14 |
*** thumpba has quit IRC | 21:18 | |
*** macsz has quit IRC | 21:23 | |
*** macsz has joined #kolla | 21:34 | |
openstackgerrit | Vikram Hosakote proposed openstack/kolla: Drop root user for neutron-linuxbridge-agent https://review.openstack.org/290868 | 21:35 |
*** dims has joined #kolla | 21:37 | |
sdake | hey guys been up too long time for bed | 21:43 |
sdake | night | 21:43 |
sdake | sbezverk sorry i can't make our scheduledmeeting, lets shoot for tomorrow | 21:43 |
sdake | find a spot in calendar | 21:43 |
*** sdake has quit IRC | 21:44 | |
*** jtriley has quit IRC | 21:48 | |
*** macsz has quit IRC | 21:49 | |
*** vhosakot has quit IRC | 21:53 | |
*** dims has quit IRC | 21:56 | |
*** inc0 has quit IRC | 21:58 | |
*** dims has joined #kolla | 21:58 | |
*** absubram has quit IRC | 22:06 | |
*** inc0 has joined #kolla | 22:19 | |
*** dave-mccowan has quit IRC | 22:20 | |
*** dims has quit IRC | 22:29 | |
*** dave-mccowan has joined #kolla | 22:34 | |
*** dims has joined #kolla | 22:44 | |
*** skape has joined #kolla | 22:46 | |
openstackgerrit | Daniel Gonzalez Nothnagel proposed openstack/kolla: Unify vagrant bootstrap.sh scripts https://review.openstack.org/288821 | 22:52 |
*** blahRus has quit IRC | 23:01 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!