*** achanda_ has joined #kolla | 00:02 | |
*** jerryz has quit IRC | 00:04 | |
*** achanda has quit IRC | 00:06 | |
*** achanda_ has quit IRC | 00:08 | |
*** pbourke_ has quit IRC | 00:18 | |
openstackgerrit | sean mooney proposed openstack/kolla: Fix missing openvswitch rpm in neutron-base with centos source build. https://review.openstack.org/224936 | 00:18 |
---|---|---|
*** pbourke_ has joined #kolla | 00:19 | |
*** daneyon_ has quit IRC | 00:19 | |
*** jerryz has joined #kolla | 00:23 | |
*** jruano has quit IRC | 00:23 | |
jerryz | sdake: ping | 00:31 |
jerryz | sdake: i just experienced a server shutdown. some of the docker containers including keystone and horizon keep restarting because there was an stale httpd.pid left. | 00:32 |
jerryz | SamYaple: ^ | 00:35 |
*** dims_ has joined #kolla | 00:38 | |
*** banix has joined #kolla | 00:40 | |
*** jruano has joined #kolla | 00:42 | |
*** juggler_ has joined #kolla | 00:43 | |
*** dims_ has quit IRC | 00:43 | |
*** dims_ has joined #kolla | 00:43 | |
*** juggler_ has quit IRC | 00:45 | |
*** juggler_ has joined #kolla | 00:45 | |
*** juggler_ has quit IRC | 00:48 | |
*** juggler has joined #kolla | 00:49 | |
*** juggler has quit IRC | 00:50 | |
openstackgerrit | Qiu Yu proposed openstack/kolla: Fix ring bulder command examples in swift readme doc https://review.openstack.org/224946 | 01:00 |
openstackgerrit | Merged openstack/kolla: Refactor set_configs.py https://review.openstack.org/224557 | 01:01 |
*** juggler has joined #kolla | 01:02 | |
*** banix has quit IRC | 01:02 | |
*** erkules_ has joined #kolla | 01:05 | |
*** blakec has quit IRC | 01:05 | |
*** erkules has quit IRC | 01:08 | |
*** weiyu has joined #kolla | 01:10 | |
*** huikang has quit IRC | 01:18 | |
*** banix has joined #kolla | 01:18 | |
*** banix has quit IRC | 01:24 | |
*** jerryz has quit IRC | 01:26 | |
*** dims_ has quit IRC | 01:27 | |
*** dims_ has joined #kolla | 01:29 | |
*** alisonh has left #kolla | 01:32 | |
*** dims_ has quit IRC | 01:37 | |
*** unicell has quit IRC | 01:46 | |
sdake | jerryz yes we have an open bug for that | 02:00 |
sdake | jerryz the individual fixing it doesn't seem to be following up on the review comments, so someone else may have to take it over | 02:00 |
*** alisonh has joined #kolla | 02:04 | |
*** sdake_ has joined #kolla | 02:09 | |
*** banix has joined #kolla | 02:13 | |
*** sdake has quit IRC | 02:13 | |
*** jruano has quit IRC | 02:27 | |
*** achanda has joined #kolla | 02:28 | |
*** jruano has joined #kolla | 02:32 | |
*** dayou has joined #kolla | 02:46 | |
*** blakec has joined #kolla | 03:05 | |
*** tfukushima has joined #kolla | 03:17 | |
*** dims_ has joined #kolla | 03:22 | |
*** achanda has quit IRC | 03:27 | |
*** dims_ has quit IRC | 03:28 | |
*** sdake has joined #kolla | 03:29 | |
*** sdake_ has quit IRC | 03:32 | |
SamYaple | sdake: that is not at all what was implemented and i removed his settings from kolla, but didnt disable the ability to do it | 03:34 |
SamYaple | thats a completely differnet issue | 03:34 |
sdake | huh? | 03:34 |
sdake | context? | 03:34 |
SamYaple | 22:02 < sdake> samyaple I believe pbourke had implemented non-root based sudo but you reverted his change this morning | 03:34 |
sdake | oh | 03:34 |
sdake | i have no idea what was done there or why it was reverted | 03:35 |
sdake | it seemed like it introduced a defect of some sort | 03:35 |
SamYaple | well it shouldn't have been there in the first place but it also broke things, yes | 03:35 |
SamYaple | its a setting only typically used in the inventory file or the ansible.cfg | 03:35 |
SamYaple | both files that kolla should not really be involved with | 03:35 |
SamYaple | we just supply a sample inventory file | 03:36 |
sdake | wfm | 03:36 |
SamYaple | one of these days someone will comethrough and review ceph for me | 03:36 |
SamYaple | one of these days.... | 03:36 |
sdake | oh right i didn't get to it today | 03:36 |
sdake | apoloogies for that | 03:36 |
SamYaple | no problem | 03:36 |
SamYaple | its a real pita to review | 03:37 |
SamYaple | did you see my suggestion about using the image_prefix so we dont have to update all teh files again like that? | 03:37 |
*** sdake_ has joined #kolla | 03:38 | |
*** sdake_ has quit IRC | 03:39 | |
*** sdake_ has joined #kolla | 03:40 | |
*** sdake_ has quit IRC | 03:40 | |
*** sdake_ has joined #kolla | 03:40 | |
sdake_ | SamYaple re your review of the install_type and install_metatype | 03:41 |
sdake_ | I did try that prefix approach initially | 03:41 |
sdake_ | there was something about it that didn't work | 03:41 |
sdake_ | but i dont mind trying to sort it out | 03:41 |
sdake_ | is the advantage there just to get rid of one of the variables? | 03:41 |
*** sdake has quit IRC | 03:41 | |
SamYaple | yea we dont have to ever touch all the files like this again | 03:42 |
SamYaple | also it would allow greater control of the image name | 03:42 |
sdake_ | i think the reason may have been i wasn't sure what prefix actually meant ;) | 03:42 |
sdake_ | whereas install_name is clear | 03:42 |
sdake_ | but the images were also not building | 03:43 |
SamYaple | it is not clear to me at all | 03:43 |
SamYaple | install_name makes no sense to be honest | 03:43 |
SamYaple | but thats a different thing | 03:43 |
sdake_ | what does prefix mean then? | 03:43 |
sdake_ | whatever the case, it can'tstay install_type | 03:44 |
sdake_ | so all the docker files need modification | 03:44 |
sdake_ | it takes 30 seconds to type the sed command in so i don't mind changing it | 03:44 |
SamYaple | "22:02 < sdake> samyaple I believe pbourke had implemented non-root based sudo but you reverted his change this morning | 03:44 |
SamYaple | oops sorry | 03:44 |
SamYaple | prefix? it means to put in front of? | 03:44 |
SamYaple | thats way more clear | 03:44 |
sdake_ | so for -t binary-rdo, prefix = what? | 03:45 |
SamYaple | centos-binary-rdo- | 03:45 |
SamYaple | i mean thats what we already for in the builkd.py | 03:45 |
sdake_ | so you want me to get rid of the base distro in the string? | 03:45 |
SamYaple | thats not new functionality | 03:45 |
SamYaple | yea | 03:45 |
sdake_ | in the dockerfiles | 03:45 |
SamYaple | i put an aexample in celiometer | 03:45 |
sdake_ | oh let me check it out | 03:46 |
sdake_ | ok i guess that makes sense | 03:47 |
sdake_ | the reason i didn't use prefix is because it included centos, and i wanted to keep the base_distro in the from line | 03:47 |
sdake_ | but i dont feel strongly about it | 03:47 |
sdake_ | i see what you mean by never having to modify the docker files again | 03:48 |
sdake_ | so that seems worth it | 03:48 |
sdake_ | if i cn just get my linux box into a bootable state again maybe I can actually do the work :) | 03:48 |
sdake_ | (upgraded from win7 to windows 10, replaced bootloader) | 03:48 |
* sdake_ groans | 03:48 | |
*** jruano has quit IRC | 03:48 | |
*** sdake_ is now known as sdake | 03:48 | |
SamYaple | i really just dont want to touch all the files again | 03:50 |
SamYaple | this wilhelp l future proof the namping | 03:50 |
SamYaple | naing* | 03:50 |
sdake | right | 03:52 |
sdake | oh btw, i am going to call it OSP instead of RHOS | 03:52 |
sdake | I guess RHOS is the old naming | 03:52 |
sdake | OSP = "OpenStack Platform" | 03:52 |
sdake | RHOS = "Red Hat OpenStack" | 03:52 |
sdake | another followup SamYaple arey ou suggessting having -t binary-rdo convert to the name centos-rdo-base? | 03:55 |
sdake | and -t binary conver to the name centos-binary-bae? | 03:55 |
sdake | i'm a little confused by your comments on this point | 03:56 |
sdake | in build.py | 03:56 |
*** unicell has joined #kolla | 03:57 | |
sdake | i thought the idea was to have type be either binary or source, and the meta type to be the exact specific type in action | 04:03 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Spelling corrections in cinder guide https://review.openstack.org/224994 | 04:23 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Spell corrections in AIO doc https://review.openstack.org/224995 | 04:23 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Spell corrections in dev quickstart guide https://review.openstack.org/224996 | 04:23 |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Spell corrections in Image building guide https://review.openstack.org/224997 | 04:23 |
*** banix has quit IRC | 04:35 | |
*** chandankumar has joined #kolla | 04:40 | |
*** achanda has joined #kolla | 04:40 | |
*** weiyu has quit IRC | 04:43 | |
*** tfukushima has quit IRC | 05:03 | |
*** weiyu has joined #kolla | 05:19 | |
*** coolsvap|holiday is now known as coolsvap | 05:28 | |
*** openstackgerrit has quit IRC | 05:31 | |
*** tfukushima has joined #kolla | 05:31 | |
*** openstackgerrit has joined #kolla | 05:31 | |
*** weiyu has quit IRC | 05:38 | |
*** sdake has quit IRC | 05:49 | |
*** weiyu_ has joined #kolla | 06:14 | |
*** dayou has quit IRC | 06:17 | |
*** dayou has joined #kolla | 06:21 | |
*** achanda has quit IRC | 06:56 | |
*** gfidente has joined #kolla | 07:02 | |
*** gfidente has joined #kolla | 07:02 | |
*** jmccarthy has quit IRC | 07:19 | |
*** jmccarthy has joined #kolla | 07:20 | |
*** akwasnie has joined #kolla | 07:28 | |
*** tfukushima has quit IRC | 07:41 | |
*** tfukushima has joined #kolla | 07:42 | |
*** erkules_ is now known as erkules | 07:51 | |
*** erkules has joined #kolla | 07:51 | |
*** athomas has joined #kolla | 07:56 | |
*** chandankumar has quit IRC | 07:57 | |
*** shardy_ has joined #kolla | 08:14 | |
*** shardy has quit IRC | 08:15 | |
*** shardy_ has quit IRC | 08:19 | |
*** shardy has joined #kolla | 08:20 | |
*** dims_ has joined #kolla | 08:30 | |
*** dims_ has quit IRC | 08:34 | |
*** diga has joined #kolla | 08:42 | |
*** blakec has quit IRC | 08:43 | |
*** blakec has joined #kolla | 08:54 | |
*** tfukushima has quit IRC | 09:04 | |
*** tfukushima has joined #kolla | 09:05 | |
*** dayou has quit IRC | 09:19 | |
*** diga has quit IRC | 09:21 | |
*** blakec has quit IRC | 09:24 | |
*** dims_ has joined #kolla | 09:32 | |
*** weiyu_ has quit IRC | 09:32 | |
*** weiyu_ has joined #kolla | 09:34 | |
*** tfukushima has quit IRC | 09:35 | |
*** dims_ has quit IRC | 09:36 | |
openstackgerrit | Swapnil Kulkarni (coolsvap) proposed openstack/kolla: Spell corrections in Image building guide https://review.openstack.org/224997 | 09:40 |
*** dims_ has joined #kolla | 09:50 | |
*** [Leeloo is now known as [Leeloo] | 10:02 | |
*** athomas has quit IRC | 10:03 | |
*** athomas has joined #kolla | 10:08 | |
*** weiyu_ has quit IRC | 10:40 | |
*** dayou has joined #kolla | 10:51 | |
*** dayou has quit IRC | 10:58 | |
*** mfalatic has quit IRC | 11:00 | |
*** mfalatic has joined #kolla | 11:06 | |
*** rhallisey has joined #kolla | 11:11 | |
*** shardy_ has joined #kolla | 11:55 | |
*** shardy has quit IRC | 11:56 | |
jmccarthy | Anyone else run into any permission errors like this: | 11:56 |
jmccarthy | TASK: [haproxy | Allowing non-local IP binding] | 11:56 |
jmccarthy | ... | 11:56 |
jmccarthy | OSError: [Errno 13] Permission denied: '/etc/.ansible_m_sysctl_QTaom0.conf' | 11:56 |
jmccarthy | I have ansible_ssh_user: "kolla" with sudo rights on the nodes in question | 11:56 |
*** dayou has joined #kolla | 11:58 | |
*** shardy_ has quit IRC | 12:00 | |
*** shardy has joined #kolla | 12:01 | |
*** weiyu has joined #kolla | 12:04 | |
*** weiyu has quit IRC | 12:21 | |
[Leeloo] | Hello, I try to use Kolla under Debian 8 (Ubuntu / source), but got this error --> https://paste.fedoraproject.org/268861/25791271/ :( | 12:26 |
*** dwalsh has joined #kolla | 12:27 | |
*** banix has joined #kolla | 12:28 | |
akwasnie | Leeloo: got the same problem, anyone knows what can be the issue? | 12:52 |
SamYaple | [Leeloo] akwasnie: what do the logs from the bootstrap container say? | 12:58 |
akwasnie | Hi SamYaple ERROR: openstack The plugin token_endpoint could not be found | 12:59 |
openstackgerrit | Merged openstack/kolla: Implement configuration file for kolla-build https://review.openstack.org/224442 | 13:02 |
openstackgerrit | Merged openstack/kolla: Set namespace to point to local registry https://review.openstack.org/223419 | 13:03 |
SamYaple | akwasnie: wierd. my guess is upstream keystone changed auth things. i heard murmuring about this. can you file a bug? | 13:03 |
akwasnie | sure, will do | 13:03 |
SamYaple | jmccarthy: ansible_ssh_user shouldn't be set in the group_vars or the globals for one, its an inventory or ansible.cfg setting only (it breaks some things in ansible) | 13:08 |
SamYaple | jmccarthy: additionally the playbooks are not gauranteed to work without root so I wouldn't expect them too | 13:08 |
SamYaple | the push to fix all the root and privelege dropping will be done in the Mitaka 1 cycle | 13:09 |
SamYaple | for liberty the official stance is root is required | 13:09 |
*** banix has quit IRC | 13:21 | |
*** banix has joined #kolla | 13:22 | |
openstackgerrit | Vladislav Belogrudov proposed openstack/kolla: Fix broken centos-source- build: add rdo repository https://review.openstack.org/223963 | 13:23 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Glance https://review.openstack.org/218501 | 13:33 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Keystone https://review.openstack.org/218497 | 13:33 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Heat https://review.openstack.org/224891 | 13:33 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Rabbitmq https://review.openstack.org/218496 | 13:33 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Cinder https://review.openstack.org/224872 | 13:33 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Neutron (thin) https://review.openstack.org/224829 | 13:33 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Nova https://review.openstack.org/218505 | 13:33 |
rhallisey | ahh my ears | 13:33 |
*** jtriley has joined #kolla | 13:36 | |
*** openstackgerrit has quit IRC | 13:46 | |
*** openstackgerrit has joined #kolla | 13:46 | |
jmccarthy | SamYaple: Do you mean literally ansible_ssh_user=root for hosts in the inventory file ? (for example vs granting the kolla user sudo rights on the hosts in question) | 13:50 |
*** dims_ has quit IRC | 14:20 | |
*** dims_ has joined #kolla | 14:21 | |
*** sdake has joined #kolla | 14:27 | |
*** banix has quit IRC | 14:29 | |
*** banix has joined #kolla | 14:42 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Add a customize deployment document https://review.openstack.org/224847 | 14:44 |
sdake | morning | 14:44 |
rhallisey | morning | 14:44 |
*** dims_ is now known as dimsum__ | 15:03 | |
*** shardy is now known as shardy_afk | 15:03 | |
*** tfukushima has joined #kolla | 15:13 | |
*** tfukushima has quit IRC | 15:18 | |
*** tfukushima has joined #kolla | 15:21 | |
*** tfukushima has quit IRC | 15:23 | |
openstackgerrit | Hui Kang proposed openstack/kolla: Fix tags declaration in site.yml https://review.openstack.org/225196 | 15:25 |
*** blakec has joined #kolla | 15:34 | |
openstackgerrit | Hui Kang proposed openstack/kolla: Fix tags declaration in site.yml https://review.openstack.org/225202 | 15:35 |
*** blakec has quit IRC | 15:46 | |
*** tfukushima has joined #kolla | 15:47 | |
*** akwasnie has quit IRC | 15:49 | |
*** blakec has joined #kolla | 15:49 | |
*** banix has quit IRC | 15:52 | |
*** tfukushima has quit IRC | 15:55 | |
*** unicell has quit IRC | 16:09 | |
*** blakec has quit IRC | 16:09 | |
*** mduggan has quit IRC | 16:13 | |
*** mduggan has joined #kolla | 16:14 | |
*** mfalatic has quit IRC | 16:17 | |
*** tfukushima has joined #kolla | 16:19 | |
*** tfukushima has quit IRC | 16:20 | |
*** mfalatic has joined #kolla | 16:20 | |
*** shardy_afk is now known as shardy | 16:24 | |
*** mfalatic_ has joined #kolla | 16:26 | |
*** mfalatic has quit IRC | 16:30 | |
*** jmccarthy has quit IRC | 16:32 | |
*** mfalatic_ is now known as mfalatic | 16:37 | |
*** athomas has quit IRC | 16:45 | |
*** unicell has joined #kolla | 16:45 | |
*** blahRus has joined #kolla | 16:56 | |
*** achanda has joined #kolla | 17:01 | |
*** absubram has joined #kolla | 17:09 | |
openstackgerrit | Merged openstack/kolla: Fix ring bulder command examples in swift readme doc https://review.openstack.org/224946 | 17:18 |
*** jerryz has joined #kolla | 17:23 | |
*** achanda has quit IRC | 17:30 | |
sdake | pbourke_ around this fine morning? | 17:38 |
*** loth has joined #kolla | 17:40 | |
sdake | note today is deadline for moving all blueprints that are not in good progress to mitaka | 17:41 |
sdake | I am giong to do that work at noon PST, so please get your blueprint information updated if you think your blueprints will make the 25th | 17:42 |
*** gfidente has quit IRC | 17:44 | |
*** blahRus has quit IRC | 17:49 | |
*** dwalsh has quit IRC | 17:49 | |
*** blahRus has joined #kolla | 17:50 | |
*** achanda has joined #kolla | 17:52 | |
openstackgerrit | Merged openstack/kolla: Spelling corrections in cinder guide https://review.openstack.org/224994 | 17:54 |
openstackgerrit | Merged openstack/kolla: Spell corrections in AIO doc https://review.openstack.org/224995 | 17:54 |
openstackgerrit | Merged openstack/kolla: Spell corrections in dev quickstart guide https://review.openstack.org/224996 | 17:55 |
openstackgerrit | Merged openstack/kolla: Spell corrections in Image building guide https://review.openstack.org/224997 | 17:56 |
sdake | SamYaple would you midn reviewing https://review.openstack.org/#/c/225202/ for correctness | 18:01 |
sdake | it looks good to me, but I'm not certain if there is some reason the tags are specified as they are, or if what is there is just a bug | 18:01 |
openstackgerrit | Jeff Peeler proposed openstack/kolla: Add Ansible support for Ironic https://review.openstack.org/219747 | 18:02 |
sdake | jpeeler woudl you mind giving a review of https://review.openstack.org/#/c/224847/ | 18:05 |
sdake | dont just rubber stamp but check for correctness and coherency :) | 18:05 |
sdake | rhallisey ^^ as well? | 18:05 |
* sdake wants m0ar docs | 18:06 | |
*** dwalsh has joined #kolla | 18:06 | |
sdake | rhallisey ping re the json pathset | 18:06 |
rhallisey | sdake, hey | 18:19 |
sdake | so on a scale of 1 to 10 how well did you test the latet patch set | 18:19 |
rhallisey | I haven't yet it's still building | 18:19 |
sdake | i see | 18:19 |
rhallisey | build should be done soon | 18:19 |
rhallisey | why is it totally bust? | 18:20 |
sdake | no idea | 18:20 |
sdake | that is why I asked :) | 18:20 |
rhallisey | ya I haven't tested | 18:20 |
jerryz | sdake: i know this is a corner case but i yesterday experienced a power down of the physical server and some of the httpd related services couldn't start because they thought httpd (pid 1) already running | 18:22 |
sdake | jerryz i responded in irc to that | 18:22 |
sdake | we know about that problem | 18:22 |
jerryz | sdake: ok | 18:22 |
sdake | the person working on it seems to have not followed up on teh patch | 18:22 |
sdake | there is a bugfiled for it iirc | 18:22 |
jerryz | sdake: also in such circumstances, the orchestration can't be guaranteed. | 18:23 |
sdake | well I think it can be guranteed, just not wit hthe curren timplementation :) | 18:24 |
jerryz | sdake: some services that relies on mysql connection will hang there after attempts to connect to mysql even if mysql was up later | 18:25 |
*** shardy has quit IRC | 18:26 | |
sdake | jerryz how did you have this mysql problem yo udescribed? | 18:28 |
jerryz | sdake: mariadb was up later than nova conductor, consoleauth | 18:29 |
*** dwalsh has quit IRC | 18:34 | |
jerryz | sdake: nova conductor would give up aftre 10 attempts | 18:37 |
*** unicell has quit IRC | 18:37 | |
jerryz | sdake: roughly 2 mins | 18:38 |
*** unicell has joined #kolla | 18:40 | |
jerryz | sdake: and nova conductor daemon wouldn't exit so docker daemon won't restart the container | 18:45 |
*** banix has joined #kolla | 18:47 | |
rhallisey | sdake, ok test worked. Just need to tweak libvirt templat | 18:55 |
rhallisey | e | 18:55 |
*** achanda has quit IRC | 18:57 | |
sdake | jerryz I am curious why the nova condcutor daemon shoud have exited? | 19:04 |
sdake | jerryz what was your expectation of how the system should have behaved compared to how it acctually behaved? | 19:04 |
sdake | rhallisey sounds good | 19:05 |
jerryz | sdake: if conductor just gave up after 10 attempts to connect mysql, then there is no point for it to stay there | 19:05 |
sdake | is this using sam's refactor of set_ocnfigs rhallisey ? | 19:05 |
rhallisey | ya | 19:05 |
rhallisey | I rebased on top | 19:05 |
sdake | so the ocnductor gives up on mysql but then it doesn't exit? | 19:06 |
jerryz | sdake: it appears to me so | 19:06 |
sdake | jerryz would you do me a super solid and file a bug for that please? | 19:06 |
sdake | that sounds like a serious problem | 19:06 |
jerryz | sdake: otherwise, docker daemon would try to restart it right? | 19:06 |
sdake | i would expect it to keep retrying to connect to the db | 19:06 |
sdake | or alternatvely exit if its hit a end of the road | 19:07 |
sdake | is there a retry limit or something? | 19:07 |
jerryz | sdake: seems like an oslo db issue | 19:08 |
sdake | jerryz http://docs.openstack.org/havana/config-reference/content/section_configuring-database-connections.html | 19:10 |
sdake | max_retries = 10 | 19:10 |
sdake | perhaps it shoul dbe set to -1 as a default in kolla | 19:10 |
sdake | jerryz how precisely did you get into a situation where the database limit was hit as you described? | 19:11 |
jerryz | sdake: a server reboot | 19:11 |
*** jtriley_ has joined #kolla | 19:11 | |
jerryz | sdake: and mariadb is behind haproxy | 19:12 |
sdake | how many nodes did you have in your enviornment? | 19:12 |
jerryz | sdake: it is unclear to me when haproxy deemed mariadb back online | 19:12 |
jerryz | sdake: just one controller and one compute | 19:13 |
sdake | which did you reboot, the compute node? | 19:13 |
jerryz | sdake: controller | 19:14 |
sdake | i na proper deployment that wouldn't have happened becuase you would have 3 control nodes i think | 19:14 |
*** jtriley has quit IRC | 19:14 | |
jerryz | sdake: it is another scenario | 19:15 |
sdake | but we should hve max_retries at -1 anyway | 19:16 |
jerryz | sdake: how about retry interval? | 19:17 |
sdake | well that could be cranked up a bit | 19:17 |
sdake | 10 seconds is pretty short | 19:17 |
sdake | if max_retries = -1, it will just retry forever | 19:18 |
sdake | what should happen is if the max_retries limit is hit, the service shouldexit | 19:18 |
sdake | but clearly that isn't happening | 19:18 |
jpeeler | tests are failing because horizon requires a later RPM version than what epel provides. i assume that would normally be put in delorean | 19:18 |
sdake | jpeeler huh? | 19:19 |
jerryz | sdake: in oslo messaging, if iirc, the retry interval would increase after several short attempts | 19:19 |
jpeeler | sdake: the non-voting gates, that's why they are failing right now | 19:19 |
jerryz | sdake: oslo db seems to use a fixed interval | 19:19 |
sdake | requires alater rpm version of which package jpeeler? | 19:19 |
jpeeler | Requires: python-django-pyscss >= 2.0.2 Available: python-django-pyscss-1.0.5-2.el7.noarch (epel) | 19:20 |
sdake | jpeeler thanks for hunting that down, i wa going to look into that | 19:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Glance https://review.openstack.org/218501 | 19:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Keystone https://review.openstack.org/218497 | 19:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Heat https://review.openstack.org/224891 | 19:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Rabbitmq https://review.openstack.org/218496 | 19:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Cinder https://review.openstack.org/224872 | 19:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Neutron (thin) https://review.openstack.org/224829 | 19:20 |
openstackgerrit | Ryan Hallisey proposed openstack/kolla: Replace config-external with a JSON file for Nova https://review.openstack.org/218505 | 19:20 |
jpeeler | Requires: python-scss >= 1.3.4 Available: python-scss-1.2.1-1.el7.x86_64 (epel) | 19:20 |
rhallisey | ^ those are all set | 19:20 |
sdake | rhallisey grats on learning how to use git rebase -i ;) | 19:20 |
sdake | it will make you much more productive now :) | 19:20 |
rhallisey | yes | 19:21 |
rhallisey | :) | 19:21 |
jpeeler | sdake: might be best to disable checking of horizon until that RPM gets added (i think that's the proper fix) | 19:21 |
sdake | jpeeler cool can you fix that up and we can get it merged? | 19:21 |
jpeeler | i guess so heh | 19:22 |
sdake | jpeeler did you inform the delorean cats about the repo problem? | 19:28 |
openstackgerrit | Jeff Peeler proposed openstack/kolla: Disable horizon build checking for now https://review.openstack.org/225286 | 19:29 |
jpeeler | sdake: no, am i right about it needing to be put in delorean? | 19:30 |
sdake | yes clearly something needs to provide that requirement :) | 19:31 |
sdake | i'm not sure if its delorean or what | 19:31 |
sdake | but starting a discussion on the mailing list would probably be helpful to get it fixed | 19:31 |
sdake | i know why that change is needed, - the current containers install pycss from pip | 19:31 |
sdake | horizon can't compress correctly | 19:31 |
sdake | rhallisey can you ack jpeeler's change please | 19:31 |
jpeeler | hrm, well i didn't look too closely at horizon. if we're doing something weird, maybe it's not delorean's fault? | 19:32 |
sdake | jpeeler the pip install occurs after the yum install | 19:32 |
sdake | it is failing on the yum install line | 19:32 |
jpeeler | ah ok | 19:33 |
sdake | the pip install just installs the latesst via pip packaging | 19:33 |
jpeeler | is it safe to pip upgrade a RPM installed package? | 19:34 |
sdake | ymmv | 19:34 |
sdake | it works for hoirzon | 19:34 |
jpeeler | yeah i bet it practically works, just not sure how pip upgrades work | 19:35 |
sdake | i knew it would be temporary and we would remove it | 19:35 |
sdake | so i went with it since its temporary and without it horizon was bustola | 19:35 |
sdake | ideally we wont be using pip installs with rpm packaged distros | 19:35 |
*** absubram has quit IRC | 19:40 | |
*** smeisner|afk is now known as smeisner | 19:45 | |
*** sdake has quit IRC | 19:46 | |
jpeeler | where did sdake goooooooooooooooo | 19:53 |
jpeeler | does anybody know why we're using kilo packages in kolla master? | 19:53 |
*** sdake has joined #kolla | 19:53 | |
sdake | jpeeler can you ack https://review.openstack.org/#/c/223963/ | 19:54 |
jpeeler | sdake: why are we using kilo packages in kolla master? | 19:55 |
sdake | openvswitch comes from that repo | 19:55 |
sdake | delorean requires installing kilo repo for dependencies | 19:55 |
sdake | its right in the documentation on trunk website | 19:55 |
sdake | i dont know why delorean doesn't just keep a copy of those files directly in its repo | 19:56 |
sdake | maybe a maintenance thing | 19:56 |
sdake | as in trying to reduce duplication of work | 19:56 |
sdake | once liberty is released in rdo we will have to get rid of the delorean reposentirely in the branch i make on the 25th | 19:57 |
sdake | coolsvap around? | 19:57 |
openstackgerrit | David Moreau Simard proposed openstack/kolla: Add missing dependency repository for Liberty for EL https://review.openstack.org/225294 | 19:57 |
sdake | jpeeler do you know this david fellow? | 19:58 |
sdake | i wonder if that fixes the horizon problem | 19:58 |
jpeeler | it does | 19:58 |
jpeeler | that's what we're talking about | 19:58 |
sdake | damn | 19:58 |
jpeeler | in #rdo | 19:58 |
sdake | well i guess we need to revert that horizon patch | 19:59 |
jpeeler | or at least, that's what he claims | 19:59 |
jpeeler | once we see that it passes, we can | 19:59 |
jpeeler | if not, best to let it go ahead in | 19:59 |
sdake | rhallisey can you remove your workflow +1 on https://review.openstack.org/#/c/225286/ | 20:00 |
jpeeler | or you could just -2 and it hope the other patch works | 20:00 |
openstackgerrit | David Moreau Simard proposed openstack/kolla: Add missing dependency repository for Liberty for EL https://review.openstack.org/225294 | 20:04 |
jpeeler | wow he actually followed up on it | 20:05 |
*** jtriley_ has quit IRC | 20:07 | |
*** jtriley has joined #kolla | 20:08 | |
openstackgerrit | Merged openstack/kolla: Fix broken centos-source- build: add rdo repository https://review.openstack.org/223963 | 20:10 |
openstackgerrit | Steven Dake proposed openstack/kolla: Remove pip install of pyscss in Horizon https://review.openstack.org/225301 | 20:11 |
jpeeler | should have made that a dependency technically | 20:12 |
sdake | ya let me edit it | 20:12 |
openstackgerrit | Steven Dake proposed openstack/kolla: Remove pip install of pyscss in Horizon https://review.openstack.org/225301 | 20:13 |
sdake | jpeeler how does that look | 20:13 |
jpeeler | i've never seen that before "depends-on"? | 20:14 |
jpeeler | i meant a gerrit dependency | 20:14 |
jpeeler | apparently depends-on is used for cross-repo depends because gerrit doesn't do that | 20:15 |
jpeeler | it'll probably do "the right thing", but the easy way would have been to pull down the other change in your repo and submit. | 20:22 |
sdake | ok moment illl do that | 20:24 |
jpeeler | it's no big deal | 20:26 |
openstackgerrit | Steven Dake proposed openstack/kolla: Remove pip install of pyscss in Horizon https://review.openstack.org/225301 | 20:26 |
openstackgerrit | Steven Dake proposed openstack/kolla: Add missing dependency repository for Liberty for EL https://review.openstack.org/225294 | 20:26 |
openstackgerrit | Steven Dake proposed openstack/kolla: Remove pip install of pyscss in Horizon https://review.openstack.org/225301 | 20:26 |
openstackgerrit | Steven Dake proposed openstack/kolla: Add missing dependency repository for Liberty for EL https://review.openstack.org/225294 | 20:26 |
sdake | there ya go jpeeler :) | 20:26 |
jpeeler | yeah, it reset the tests though :/ the downside | 20:27 |
jpeeler | and apparently it changed the committer, which i did not think would happen | 20:27 |
jpeeler | so maybe i should have kept my mouth shut | 20:27 |
jpeeler | and i need to focus on ironic. running out of time | 20:28 |
sdake | jpeeler reading thread moment | 20:29 |
sdake | jpeeler i'll accept ironic after 25th | 20:29 |
sdake | it looks close enough to being solid | 20:30 |
jpeeler | oh thanks :) but either way, still need to get it done today | 20:30 |
sdake | i just dont want people starting new work today and expecting it to hit the repo for the rcs :) | 20:30 |
sdake | well we have a full week left before the deadline | 20:30 |
jpeeler | what did you think about the templating of configuration comments? | 20:31 |
sdake | jpeeler which templating are you talking about | 20:33 |
sdake | I was just reading the thread about trivial changes | 20:33 |
sdake | adrian's suggestion seems solid | 20:34 |
sdake | i'll bring it up next wekenesday and we can see if folks are open to relaxing the rules | 20:34 |
sdake | I dont mind given adrian's suggested approach | 20:34 |
jpeeler | yeah i'm glad that thread came up... | 20:34 |
jpeeler | i was talking about https://review.openstack.org/#/c/224847/ | 20:34 |
sdake | oh reading your review moment | 20:35 |
sdake | ya so the "requires much more work" is the thing I am avoidant about :) | 20:37 |
sdake | the docs have to be referenced anyway in most cases | 20:37 |
sdake | so that isn't really a good enough tradeoff in my opino | 20:37 |
sdake | idont htink it conflicts though | 20:37 |
sdake | as in "somehow conflicts with additoina lcustom options" I dont think I made that argument? | 20:38 |
sdake | jpeeler ^^ | 20:38 |
jpeeler | ok well, i guess i'm in favor of documenting certain options that have limited choices | 20:38 |
jpeeler | but i did finish with a "maybe I'm wrong" | 20:39 |
sdake | sam takes a pretyt hardline approach on this | 20:39 |
sdake | his statement was you can't have it both ways | 20:40 |
sdake | I feel you can | 20:40 |
sdake | but just because we can doesn't mean we should :) | 20:40 |
sdake | I htink we can make things simple but in very limited cases template options | 20:40 |
sdake | for example, I think at some point we will want to template MTU | 20:40 |
sdake | because it will need to be applied and calculated and we don't necessarily want to have the operator figure out the 5-10 config options required to change mtu globally for a deployment | 20:41 |
sdake | but for something simple like virt type, the operator can go look at the upstream docs, rather then us documenting the same thing over agian | 20:41 |
jpeeler | maybe i still don't understand "templating" | 20:42 |
sdake | take that virt tyep as an example | 20:43 |
jpeeler | basically defining the available choices in textual form, right? | 20:43 |
sdake | tempatling tha towuld be adding to globals.yml | 20:43 |
jpeeler | right | 20:43 |
sdake | a nova_virt_type variable | 20:43 |
sdake | and then that would get jammed into the config | 20:43 |
jpeeler | i guess it is hard to know where to draw the line - wouldn't want kolla doing it for every variable ever | 20:44 |
sdake | yup and that is what it leads to | 20:44 |
jpeeler | but drawing attention to some i think will be helpful | 20:44 |
sdake | I think in very limited circumstances we can do so | 20:44 |
sdake | like mtu | 20:44 |
sdake | there are some things we can't ovveride in kolla's system | 20:44 |
sdake | like how haproxy has timings for ha detection | 20:45 |
sdake | the problem is once we template it, its permanently in thesystem as a config option | 20:45 |
jpeeler | yeah. when you correct the spelling errors my -1 will go away and i won't contest it | 20:45 |
sdake | more config options = more complexity for the operator to sort out | 20:45 |
sdake | atm kolal is dead simple | 20:45 |
sdake | I suspect over time we will come to a general agreement about what we are going to template | 20:46 |
jpeeler | but then you're relying on a bunch of default config options | 20:46 |
sdake | but I'm going to be pushing back pretty hard in almost allcases :) | 20:46 |
sdake | the 2 I am in support of now are the haproxy timeouts and MTU | 20:46 |
jpeeler | have you looked at openstack-ansible? | 20:47 |
sdake | looked about 1 year ago | 20:47 |
sdake | or maybe 8 months or so | 20:47 |
jpeeler | i'm curious what they do. i know their configuration is located at the service level | 20:47 |
sdake | have also looked at bluebox | 20:47 |
sdake | they template everything | 20:47 |
sdake | they have like a million options | 20:47 |
sdake | they both operate the same way wit hteh templating | 20:48 |
jpeeler | ok | 20:48 |
sdake | the problem is the config options maybe deprecated | 20:48 |
sdake | or be added | 20:48 |
sdake | you end up with hundreds of config options | 20:49 |
jpeeler | i mean, there's definite maintenance burden | 20:49 |
sdake | and it requires a dev/test cycle to change things | 20:49 |
sdake | if I was an operator I wouldn't want ot rely on a dev/test cycle and a variable and subjective approval process for customizing my deployment | 20:49 |
sdake | i'd just wan to jam thevariable in | 20:50 |
jpeeler | i think i'd be satisified if the original config file contents remained from the RPM commented out | 20:50 |
sdake | jpeeler what do yo umean - don't understand | 20:51 |
jpeeler | the config file that ends up on disk is only what you put in it. i don't honestly understand how the merging works | 20:52 |
jpeeler | but i suspect the solution would be to populate the 0 length files in the tree with the contents of the RPM | 20:52 |
jpeeler | (in etc/kolla/config) | 20:54 |
sdake | the merging is necessary because otherwise the operator has to figure out how to get the out of the box configright which wouldbe very challenging | 20:54 |
jpeeler | i know why you have to set the options | 20:55 |
jpeeler | i'm just saying it's a bare bones file instead of containing the original RPM contents | 20:55 |
jpeeler | i think the merging should be done with that | 20:55 |
sdake | you mean we should merge with the rpm dist config? | 20:56 |
sdake | I would like to completely remove the dist config loading | 20:56 |
sdake | i just htink we are short on time to do it this cycle ;) | 20:56 |
jpeeler | i know it can't be done now. why do you mean completely remove the dist config loading? | 20:57 |
jpeeler | *what | 20:57 |
*** blakec has joined #kolla | 21:01 | |
openstackgerrit | Steven Dake proposed openstack/kolla: Add a customize deployment document https://review.openstack.org/224847 | 21:12 |
sdake | jpeeler have a look at that | 21:12 |
sdake | jpeeler what I mean is at the moment for example if you load glance, glance has a config file call glance-dist.ini | 21:13 |
sdake | or glance-dist.conf I think | 21:13 |
sdake | and it gets loaded into glance as a configuration file | 21:13 |
jpeeler | i thought that the dist file got merged into the main glance configuration file | 21:13 |
sdake | it does, but I wan t to remove it completely | 21:14 |
sdake | that way there is no variance between distros | 21:14 |
jpeeler | that's fine | 21:14 |
sdake | i want to specify --config-file xyz | 21:14 |
jpeeler | just keep the vanilla upstream config file | 21:14 |
jpeeler | then it's consistent and complete too | 21:14 |
jpeeler | so i'm mistaken about the original files being in the RPM. they are merged at build time, so the RPM doesn't help | 21:17 |
jpeeler | i guess what i want is only possible with source builds then | 21:17 |
*** dayou has quit IRC | 21:19 | |
sdake | what is it you want exaclty? | 21:22 |
jpeeler | all the potential available options to be shown | 21:23 |
jpeeler | maybe since they'd have to be configured trough ansible anyway it doesn't matter to have them in the container | 21:23 |
*** diogogmt has joined #kolla | 21:29 | |
*** dims_ has joined #kolla | 21:29 | |
*** dimsum__ has quit IRC | 21:32 | |
*** jtriley has quit IRC | 21:47 | |
*** blakec has quit IRC | 21:49 | |
sdake | jpeelerit hink that line of thinking is correct | 21:50 |
*** blakec has joined #kolla | 21:51 | |
*** jpeeler has quit IRC | 22:05 | |
openstackgerrit | Hui Kang proposed openstack/kolla: Fix a small bug of wrong path to validate-docker-execuate https://review.openstack.org/225354 | 22:21 |
*** sdake_ has joined #kolla | 22:40 | |
*** sdake has quit IRC | 22:43 | |
*** openstackgerrit has quit IRC | 22:46 | |
*** openstackgerrit has joined #kolla | 22:46 | |
*** sdake has joined #kolla | 22:48 | |
*** sdake_ has quit IRC | 22:51 | |
*** achanda has joined #kolla | 22:52 | |
*** dims_ has quit IRC | 22:56 | |
*** banix has quit IRC | 23:10 | |
*** banix has joined #kolla | 23:11 | |
*** blahRus has quit IRC | 23:22 | |
*** dimsum__ has joined #kolla | 23:23 | |
*** weiyu has joined #kolla | 23:34 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!