*** dims_ has joined #kolla | 00:02 | |
*** salv-orlando has quit IRC | 00:03 | |
*** dims has quit IRC | 00:05 | |
*** tpeoples has quit IRC | 00:08 | |
*** tpeoples has joined #kolla | 00:10 | |
*** dwalsh has joined #kolla | 00:41 | |
*** neilus has joined #kolla | 00:48 | |
*** salv-orlando has joined #kolla | 00:49 | |
*** neilus has quit IRC | 00:52 | |
*** Jeffrey4l_ has joined #kolla | 01:02 | |
*** dims_ has quit IRC | 01:04 | |
*** salv-orlando has quit IRC | 01:23 | |
*** weiyu has joined #kolla | 01:26 | |
*** dwalsh has quit IRC | 01:41 | |
*** salv-orlando has joined #kolla | 01:45 | |
*** iceyao has joined #kolla | 01:50 | |
*** iceyao has quit IRC | 01:56 | |
*** Allen_Gao has joined #kolla | 02:02 | |
*** dims has joined #kolla | 02:02 | |
*** Marga_ has joined #kolla | 02:07 | |
*** Marga_ has joined #kolla | 02:08 | |
*** dims has quit IRC | 02:12 | |
*** dims has joined #kolla | 02:12 | |
*** dims has quit IRC | 02:13 | |
*** salv-orlando has quit IRC | 02:17 | |
*** tfukushima has joined #kolla | 02:17 | |
*** kejlly_ has quit IRC | 02:19 | |
*** iceyao has joined #kolla | 02:20 | |
*** Marga_ has quit IRC | 02:35 | |
*** neilus has joined #kolla | 02:36 | |
*** Marga_ has joined #kolla | 02:36 | |
*** neilus has quit IRC | 02:41 | |
*** salv-orlando has joined #kolla | 02:42 | |
*** coolsvap|away is now known as coolsvap | 03:02 | |
*** dwalsh has joined #kolla | 03:02 | |
*** yuanying has quit IRC | 03:22 | |
*** yuanying has joined #kolla | 03:22 | |
*** salv-orlando has quit IRC | 03:26 | |
*** tfukushima has quit IRC | 03:32 | |
*** tfukushima has joined #kolla | 03:34 | |
*** tfukushima has quit IRC | 03:36 | |
*** tfukushima has joined #kolla | 03:42 | |
*** klint has joined #kolla | 03:43 | |
*** Allen_Gao has quit IRC | 03:45 | |
*** tfukushima has quit IRC | 03:47 | |
*** tfukushima has joined #kolla | 03:49 | |
*** iceyao has quit IRC | 03:54 | |
*** iceyao has joined #kolla | 03:55 | |
*** unicell has quit IRC | 04:02 | |
*** yuanying has quit IRC | 04:06 | |
*** unicell has joined #kolla | 04:10 | |
*** weiyu has quit IRC | 04:22 | |
*** iceyao has quit IRC | 04:22 | |
*** salv-orlando has joined #kolla | 04:24 | |
*** neilus has joined #kolla | 04:24 | |
*** neilus has quit IRC | 04:29 | |
*** iceyao has joined #kolla | 04:30 | |
*** tfukushima has quit IRC | 04:31 | |
*** achanda has quit IRC | 04:44 | |
*** iceyao has quit IRC | 04:45 | |
*** iceyao has joined #kolla | 04:46 | |
*** Marga_ has quit IRC | 04:50 | |
*** weiyu has joined #kolla | 04:51 | |
*** achanda has joined #kolla | 04:55 | |
*** weiyu has quit IRC | 05:02 | |
*** salv-orlando has quit IRC | 05:06 | |
*** tfukushima has joined #kolla | 05:08 | |
*** Marga_ has joined #kolla | 05:08 | |
*** tfukushima has quit IRC | 05:09 | |
*** tfukushima has joined #kolla | 05:11 | |
*** salv-orlando has joined #kolla | 05:17 | |
*** jasonsb has joined #kolla | 05:21 | |
*** jasonsb has quit IRC | 05:25 | |
*** jasonsb has joined #kolla | 05:29 | |
*** salv-orlando has quit IRC | 05:35 | |
*** coolsvap is now known as coolsvap|away | 05:40 | |
*** tfukushima has quit IRC | 05:44 | |
*** weiyu has joined #kolla | 05:45 | |
*** achanda_ has joined #kolla | 05:47 | |
*** iceyao has quit IRC | 05:49 | |
*** dwalsh has quit IRC | 05:49 | |
*** Kennan has quit IRC | 05:49 | |
*** logan- has quit IRC | 05:49 | |
*** cloudnull has quit IRC | 05:49 | |
*** achanda has quit IRC | 05:49 | |
*** coolsvap|away is now known as coolsvap | 05:49 | |
*** logan- has joined #kolla | 05:50 | |
*** iceyao has joined #kolla | 05:50 | |
*** Allen_Gao has joined #kolla | 05:56 | |
*** Kennan has joined #kolla | 05:58 | |
*** Marga_ has quit IRC | 06:04 | |
*** jasonsb has quit IRC | 06:08 | |
*** salv-orlando has joined #kolla | 06:13 | |
*** iceyao has quit IRC | 06:21 | |
*** dave-mccowan has quit IRC | 06:21 | |
*** iceyao has joined #kolla | 06:22 | |
*** Marga_ has joined #kolla | 06:22 | |
*** chandankumar has joined #kolla | 06:33 | |
*** cloudnul- has joined #kolla | 06:39 | |
*** jasonsb has joined #kolla | 06:47 | |
*** cloudnul- is now known as cloudnull | 06:51 | |
*** tfukushima has joined #kolla | 06:55 | |
*** Allen_Gao has quit IRC | 06:56 | |
*** salv-orlando has quit IRC | 06:57 | |
*** achanda_ is now known as achanda | 06:57 | |
*** neilus has joined #kolla | 07:07 | |
*** jasonsb has quit IRC | 07:08 | |
*** salv-orlando has joined #kolla | 07:09 | |
*** Allen_Gao has joined #kolla | 07:09 | |
*** neilus has quit IRC | 07:11 | |
*** ppetit has joined #kolla | 07:25 | |
*** ppetit has quit IRC | 07:27 | |
*** ppetit has joined #kolla | 07:29 | |
*** ppetit has quit IRC | 07:30 | |
*** ppetit has joined #kolla | 07:36 | |
*** salv-orlando has quit IRC | 07:43 | |
*** RA_ has quit IRC | 07:44 | |
*** mbound has joined #kolla | 08:04 | |
*** Marga_ has quit IRC | 08:06 | |
*** salv-orlando has joined #kolla | 08:06 | |
*** fgimenez has joined #kolla | 08:08 | |
*** fgimenez has quit IRC | 08:08 | |
*** fgimenez has joined #kolla | 08:08 | |
*** mkoderer has quit IRC | 08:14 | |
*** tfukushima has quit IRC | 08:19 | |
*** tfukushima has joined #kolla | 08:20 | |
*** dwalsh has joined #kolla | 08:22 | |
*** salv-orlando has quit IRC | 08:25 | |
*** achanda has quit IRC | 08:31 | |
*** coolsvap is now known as coolsvap|away | 08:36 | |
*** achanda has joined #kolla | 08:37 | |
*** achanda has quit IRC | 08:39 | |
*** shardy has joined #kolla | 08:42 | |
*** mkoderer has joined #kolla | 08:43 | |
*** diga has joined #kolla | 08:46 | |
*** kproskurin has joined #kolla | 08:47 | |
*** kproskurin has quit IRC | 08:49 | |
*** chandankumar has quit IRC | 08:49 | |
*** macsz1 has joined #kolla | 08:50 | |
*** kproskurin has joined #kolla | 08:51 | |
*** dwalsh has quit IRC | 09:00 | |
*** diga_ has joined #kolla | 09:00 | |
*** diga has quit IRC | 09:01 | |
*** ppetit has quit IRC | 09:03 | |
*** vbel1 has quit IRC | 09:04 | |
*** dwalsh has joined #kolla | 09:06 | |
*** ppetit has joined #kolla | 09:07 | |
*** salv-orlando has joined #kolla | 09:07 | |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Add neutron config https://review.openstack.org/265109 | 09:14 |
---|---|---|
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Categorize variables in etc/globals.yml https://review.openstack.org/274560 | 09:14 |
*** macsz1 has quit IRC | 09:19 | |
*** macsz1 has joined #kolla | 09:20 | |
*** mbound has quit IRC | 09:20 | |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Use docker_remove_delay for auto-removing containers https://review.openstack.org/270213 | 09:22 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Remove rsyslog from all profiles https://review.openstack.org/270151 | 09:22 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Use private network in default settings https://review.openstack.org/269545 | 09:22 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Categorize variables in etc/globals.yml https://review.openstack.org/274560 | 09:22 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Add neutron config https://review.openstack.org/265109 | 09:22 |
*** macsz1 has quit IRC | 09:22 | |
*** athomas has joined #kolla | 09:22 | |
*** salv-orlando has quit IRC | 09:27 | |
*** mbound has joined #kolla | 09:36 | |
openstackgerrit | Merged openstack/kolla: Fix missing swift proxy server image in pull action https://review.openstack.org/274268 | 09:41 |
*** ppetit has quit IRC | 09:44 | |
openstackgerrit | Proskurin Kirill proposed openstack/kolla-mesos: Support deploy without configs https://review.openstack.org/266476 | 09:48 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Remove rsyslog from all profiles https://review.openstack.org/270151 | 09:50 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Use private network in default settings https://review.openstack.org/269545 | 09:50 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Categorize variables in etc/globals.yml https://review.openstack.org/274560 | 09:50 |
openstackgerrit | Michal Rostecki proposed openstack/kolla-mesos: Add neutron config https://review.openstack.org/265109 | 09:50 |
*** egonzalez90 has joined #kolla | 09:50 | |
*** ppetit has joined #kolla | 09:51 | |
*** egonzalez90 is now known as egonzalez | 09:52 | |
openstackgerrit | Angus Salkeld proposed openstack/kolla-mesos: Dependencies clean up / simplification https://review.openstack.org/272912 | 09:52 |
openstackgerrit | Angus Salkeld proposed openstack/kolla-mesos: Add some unit tests for show_tasks https://review.openstack.org/273842 | 09:52 |
openstackgerrit | Angus Salkeld proposed openstack/kolla-mesos: Use a new per-service format https://review.openstack.org/273843 | 09:52 |
openstackgerrit | Angus Salkeld proposed openstack/kolla-mesos: Fix file_utils.find_config_file (remove kolla) https://review.openstack.org/274576 | 09:52 |
openstackgerrit | Angus Salkeld proposed openstack/kolla-mesos: add a "fake" option to zk_connection() https://review.openstack.org/274577 | 09:52 |
*** akwasnie has joined #kolla | 09:53 | |
*** ajafo has quit IRC | 09:55 | |
*** ajafo has joined #kolla | 09:55 | |
*** ppetit has quit IRC | 09:57 | |
*** ppetit has joined #kolla | 09:58 | |
*** openstackgerrit has quit IRC | 10:02 | |
*** openstackgerrit_ has joined #kolla | 10:02 | |
*** openstackgerrit_ has quit IRC | 10:03 | |
*** salv-orlando has joined #kolla | 10:03 | |
*** achanda has joined #kolla | 10:09 | |
*** achanda has quit IRC | 10:14 | |
*** dwalsh has quit IRC | 10:21 | |
*** ppetit has quit IRC | 10:23 | |
*** tfukushima has quit IRC | 10:24 | |
*** macsz1 has joined #kolla | 10:25 | |
*** tfukushima has joined #kolla | 10:26 | |
*** tfukushima has quit IRC | 10:26 | |
*** ppetit has joined #kolla | 10:28 | |
*** ajafo has quit IRC | 10:34 | |
*** egonzalez has quit IRC | 10:36 | |
*** salv-orlando has quit IRC | 10:40 | |
*** ajafo has joined #kolla | 10:41 | |
*** akwasnie has quit IRC | 10:43 | |
*** tfukushima has joined #kolla | 10:46 | |
*** macsz1 has quit IRC | 10:46 | |
*** salv-orlando has joined #kolla | 10:50 | |
*** weiyu has quit IRC | 10:52 | |
*** ppetit has quit IRC | 10:56 | |
*** macsz1 has joined #kolla | 10:56 | |
*** ppetit has joined #kolla | 10:57 | |
*** macsz1 has quit IRC | 10:58 | |
*** dims has joined #kolla | 11:09 | |
*** achanda has joined #kolla | 11:11 | |
*** achanda has quit IRC | 11:17 | |
*** fgimenez has quit IRC | 11:19 | |
*** RA_ has joined #kolla | 11:19 | |
*** fgimenez has joined #kolla | 11:19 | |
*** iceyao has quit IRC | 11:22 | |
*** iceyao has joined #kolla | 11:22 | |
*** chandankumar has joined #kolla | 11:28 | |
*** jmccarthy has quit IRC | 11:28 | |
*** jmccarthy has joined #kolla | 11:29 | |
*** weiyu has joined #kolla | 11:34 | |
*** akwasnie has joined #kolla | 11:41 | |
*** macsz has joined #kolla | 11:45 | |
*** ppetit has quit IRC | 11:53 | |
*** openstackgerrit has joined #kolla | 11:53 | |
*** openstackgerrit has quit IRC | 11:54 | |
kproskurin | Looks like http://trunk.rdoproject.org/centos7 is dead :-\ | 11:54 |
*** openstackgerrit_ has joined #kolla | 11:54 | |
*** ajafo has quit IRC | 11:55 | |
*** openstackgerrit_ is now known as openstackgerrit | 11:55 | |
*** chandankumar has quit IRC | 11:55 | |
*** ajafo has joined #kolla | 11:55 | |
*** weiyu has quit IRC | 11:58 | |
*** weiyu has joined #kolla | 11:59 | |
*** openstackgerrit has quit IRC | 11:59 | |
*** athomas has quit IRC | 12:00 | |
*** diga_ has quit IRC | 12:02 | |
*** salv-orl_ has joined #kolla | 12:03 | |
*** weiyu has quit IRC | 12:04 | |
*** salv-orlando has quit IRC | 12:06 | |
*** openstackgerrit has joined #kolla | 12:07 | |
*** ppetit has joined #kolla | 12:08 | |
openstackgerrit | Allen Gao proposed openstack/kolla: Remove early failure on install types in dockerfile https://review.openstack.org/274629 | 12:11 |
*** weiyu has joined #kolla | 12:12 | |
*** chandankumar has joined #kolla | 12:13 | |
*** chandankumar has quit IRC | 12:15 | |
*** jtriley has joined #kolla | 12:15 | |
*** fthiagogv has joined #kolla | 12:26 | |
*** akwasnie has quit IRC | 12:32 | |
*** chandankumar has joined #kolla | 12:32 | |
*** akwasnie has joined #kolla | 12:35 | |
*** fthiagogv has quit IRC | 12:37 | |
*** fthiagogv has joined #kolla | 12:40 | |
openstackgerrit | Merged openstack/kolla-mesos: Fix file_utils.find_config_file (remove kolla) https://review.openstack.org/274576 | 12:41 |
*** kproskurin has quit IRC | 12:42 | |
*** fthiagogv has quit IRC | 12:42 | |
*** fthiagogv has joined #kolla | 12:42 | |
*** fthiagogv has quit IRC | 12:43 | |
*** fthiagogv has joined #kolla | 12:43 | |
*** salv-orl_ has quit IRC | 12:47 | |
*** chandankumar has quit IRC | 12:53 | |
openstackgerrit | Proskurin Kirill proposed openstack/kolla-mesos: Add heat config https://review.openstack.org/271978 | 13:02 |
*** salv-orlando has joined #kolla | 13:02 | |
*** kproskurin has joined #kolla | 13:06 | |
*** dims has quit IRC | 13:06 | |
*** shardy has quit IRC | 13:06 | |
*** dims has joined #kolla | 13:09 | |
*** dwalsh has joined #kolla | 13:14 | |
*** weiyu has quit IRC | 13:17 | |
*** dwalsh has quit IRC | 13:21 | |
*** dave-mccowan has joined #kolla | 13:22 | |
*** Jeffrey4l_ has quit IRC | 13:23 | |
*** fgimenez has quit IRC | 13:28 | |
*** fgimenez has joined #kolla | 13:29 | |
*** chandankumar has joined #kolla | 13:32 | |
*** fthiagogv has quit IRC | 13:36 | |
*** fthiagogv has joined #kolla | 13:37 | |
*** fthiagogv has quit IRC | 13:38 | |
*** fthiagogv has joined #kolla | 13:38 | |
*** Allen_Gao has quit IRC | 13:40 | |
*** fthiagogv_ has joined #kolla | 13:40 | |
*** fthiagogv_ has quit IRC | 13:40 | |
*** fthiagogv has quit IRC | 13:40 | |
*** fthiagogv has joined #kolla | 13:41 | |
*** chandankumar has quit IRC | 13:46 | |
*** Jeffrey4l has joined #kolla | 13:47 | |
openstackgerrit | Proskurin Kirill proposed openstack/kolla-mesos: Add heat config https://review.openstack.org/271978 | 13:48 |
*** dwalsh has joined #kolla | 13:50 | |
*** klint has quit IRC | 14:00 | |
*** jtriley has quit IRC | 14:01 | |
*** diogogmt has quit IRC | 14:16 | |
*** akwasnie has quit IRC | 14:18 | |
*** diogogmt has joined #kolla | 14:24 | |
*** RA_ has quit IRC | 14:40 | |
*** diogogmt has quit IRC | 14:45 | |
*** iceyao has quit IRC | 15:03 | |
nihilifer | SamYaple: kproskurin: guys, getting back to the mesos volume thing | 15:05 |
nihilifer | i have no idea how to clean named volumes in mesos | 15:05 |
nihilifer | for 99% there is no support for it | 15:05 |
kproskurin | nihilifer: Imo we just need to add to our cleanup tool docker call with wipe of ALL volumes | 15:06 |
nihilifer | can we provisionaly accept the solution with host-bound columes? | 15:06 |
nihilifer | kproskurin: and what will call docker on all hosts? | 15:06 |
kproskurin | nihilifer: well, I didnt though about it in multynode… yet. :-) | 15:06 |
nihilifer | also, we use mesos to *not* call docker | 15:07 |
nihilifer | by hand | 15:07 |
kproskurin | In what case we really should dig into mesos PS | 15:07 |
nihilifer | s/dig/contribute to | 15:07 |
kproskurin | well, it’s allredy in some experemntal state, so start with test | 15:07 |
nihilifer | guys, we have the three options | 15:08 |
nihilifer | 1) accept host bound volumes temporarily and wait for named volumes support in mesos | 15:08 |
nihilifer | 2) accept my workaround for using named volumes where there is no clean way to clear volumes (bad solution imo) | 15:09 |
nihilifer | 3) complain to the end of the world and block the development... | 15:09 |
kproskurin | %-) | 15:09 |
nihilifer | i'm for 1st solution | 15:09 |
nihilifer | please let me know whether you have some other propositions or whether you agree with some point (1-2 of course ;) ) | 15:10 |
kproskurin | Honestly, Im ok with use named volumes(current patch) + create a docker call in cleanup, so it will be working in AIO without any problems. And think about fix for multinode. It will unblock dev, it will work for AIO. We dont really test multinode yet, so... | 15:11 |
nihilifer | i'll be afk, getting back in ~2hrs probably | 15:11 |
nihilifer | ok, so SamYaple, your vote will be decisive :P | 15:11 |
*** achanda has joined #kolla | 15:18 | |
*** achanda has quit IRC | 15:23 | |
openstackgerrit | Steve Noyes proposed openstack/kolla-mesos: Add state info to commands https://review.openstack.org/271422 | 15:26 |
*** jtriley has joined #kolla | 15:26 | |
*** mdnadeem has quit IRC | 15:29 | |
*** mdnadeem has joined #kolla | 15:29 | |
*** achanda has joined #kolla | 15:30 | |
*** kproskurin has quit IRC | 15:33 | |
*** kproskurin has joined #kolla | 15:33 | |
*** fgimenez has quit IRC | 15:35 | |
*** diogogmt has joined #kolla | 15:36 | |
*** blahRus has joined #kolla | 15:36 | |
*** blahRus has quit IRC | 15:37 | |
*** blahRus has joined #kolla | 15:38 | |
Jeffrey4l | SamYaple, morning. Do you depoy the kolla in multi host recently? I try to deploy it(for the first time), but the mariadb always failed. | 15:38 |
*** fgimenez has joined #kolla | 15:38 | |
*** achanda has quit IRC | 15:41 | |
*** inc0 has joined #kolla | 15:46 | |
*** dtturner has joined #kolla | 15:49 | |
inc0 | good morning | 15:50 |
*** kproskurin has quit IRC | 15:51 | |
*** kproskurin has joined #kolla | 15:51 | |
pbourke | hey inc0 | 15:52 |
pbourke | inc0: Im looking at your nova upgrade as a basis for swift. Wondering why you break out the services into upgrade/compute.yml, upgrade/nova.yml, etc. rather than just 'include start.yml' the way you did in keystone? | 15:53 |
inc0 | pbourke, mostly because nova is more complicated | 15:54 |
inc0 | for the sake of clarity | 15:54 |
inc0 | for ks it's just rebuild of containers reallyh | 15:54 |
inc0 | for nova there are different steps | 15:54 |
inc0 | and I wanted to clearly separate compute part so people would have easier time to work on it | 15:55 |
*** salv-orlando has quit IRC | 15:57 | |
pbourke | inc0: also whats up with the sighup stuff why not just docker restart | 15:59 |
*** dave-mccowan has quit IRC | 16:03 | |
*** ccesario has joined #kolla | 16:08 | |
*** dave-mccowan has joined #kolla | 16:18 | |
*** anteaya has quit IRC | 16:18 | |
*** thumpba has joined #kolla | 16:19 | |
inc0 | fuck. | 16:23 |
inc0 | we have problem | 16:23 |
inc0 | upgrades might actually be really bad experience for us | 16:23 |
inc0 | SamYaple, around? | 16:26 |
pbourke | inc0: ? | 16:30 |
inc0 | so we run vms in a container | 16:30 |
inc0 | and we started making use of new docker stuff | 16:31 |
inc0 | while being stuch with 1.8 before | 16:31 |
*** absubram has quit IRC | 16:35 | |
*** akwasnie has joined #kolla | 16:40 | |
*** salv-orlando has joined #kolla | 16:42 | |
inc0 | which means restarting docker, which means restarting libvirt container | 16:42 |
*** fgimenez has quit IRC | 16:43 | |
*** tfukushima has quit IRC | 16:43 | |
inc0 | which may mean restarting vms, unless we will find out how to use pid=host to our benefit | 16:43 |
*** Marga_ has joined #kolla | 16:44 | |
*** Marga_ has quit IRC | 16:44 | |
*** fgimenez has joined #kolla | 16:45 | |
*** Marga_ has joined #kolla | 16:45 | |
*** diogogmt has quit IRC | 16:51 | |
*** akwasnie has quit IRC | 16:51 | |
*** akwasnie has joined #kolla | 16:51 | |
SamYaple | inc0: around | 16:52 |
*** diogogmt has joined #kolla | 16:52 | |
SamYaple | Jeffrey4l: i have not be able to deploy multinode since i moved (about 2 months back). i wont be able to until right around the time of the midcycle either | 16:52 |
inc0 | SamYaple, restarting docker without restarting running vms | 16:53 |
inc0 | we need to figure it out | 16:53 |
SamYaple | nihilifer: my vote is always going to be the one to unblock dev since mesos isnt 'stable' yet it doesn't matter what temporary hacks we do. However if at all possible we need to attempt to used named volumes in my opinion | 16:53 |
SamYaple | inc0: as i can see it there is no solution | 16:54 |
SamYaple | docker "fixed" that bug in 1.6.x | 16:54 |
inc0 | which means upgrades are no-go | 16:54 |
SamYaple | so a kill -9 of the docker daemon is the only option to preserve the vms | 16:54 |
SamYaple | im -2 on a kill -9 | 16:54 |
inc0 | I don't want upgrades to be no-go | 16:54 |
SamYaple | this isn't a killer for upgrades. dont be so dramatic inc0 :P | 16:55 |
inc0 | it is | 16:55 |
SamYaple | it isn't | 16:55 |
inc0 | all it takes is one unmigrable vm | 16:55 |
SamYaple | you dont even need to migrate vms to have an upgrade | 16:55 |
inc0 | and we promised that we'll improve upgradability | 16:55 |
SamYaple | what we _promised_ was upgrades with as little down time as possible | 16:55 |
inc0 | how so? | 16:55 |
SamYaple | shutting down vms is not the end of the world no matter what you say | 16:56 |
inc0 | which currently means restarting vms, that's more than non-kolla deployed cloud | 16:56 |
inc0 | way more | 16:56 |
inc0 | it actually is killer for most users I know of | 16:56 |
SamYaple | its not more... | 16:56 |
SamYaple | I mean i am an operator here. its not ideal, but we most certainly have done it | 16:57 |
inc0 | may be the case for you, but I know ops who can't do stuff like that | 16:57 |
*** jasonsb has joined #kolla | 16:57 | |
inc0 | there are many different SLAs there you know | 16:57 |
SamYaple | I know. but its not a killer | 16:57 |
SamYaple | if thats the way it has to be thats the way it has to be | 16:58 |
SamYaple | this is waht live migrate is for | 16:58 |
SamYaple | complain to the docker-dev mailing list and maybe for M-N we will have the feature you want | 16:58 |
dmsimard | SamYaple: live migration is painful at scale with real SLA'd customers | 16:59 |
inc0 | yeah...but we made decisions fuck up backward compatibility | 16:59 |
dmsimard | There are a ton of issues | 16:59 |
inc0 | potentially impossible to solve issues | 16:59 |
dmsimard | for instance between different versions of QEMU, you can't live migrate an instance that has both ephemeral and attached volumes, etc. | 16:59 |
dmsimard | It's such a headache | 16:59 |
pbourke | i feel its not so much us that made these decisions as it is the docker team | 16:59 |
SamYaple | dmsimard: i agree, but saying upgrades are a no-go here is a hugely negative uneeded statement | 17:00 |
SamYaple | pbourke: i agree 100% with that too | 17:00 |
dmsimard | SamYaple: if it can take weeks instead of months to upgrade I'm cool with that | 17:00 |
SamYaple | dmsimard: no reason it can't | 17:01 |
SamYaple | you can limit per compute node upgrades | 17:01 |
SamYaple | im not recommending running in that state for a long time, but thats what these methods are there for | 17:01 |
dmsimard | yeah there's things to take into account with api backwards compatibility flags | 17:01 |
SamYaple | dmsimard: for kolla our backend we recommend is ceph for a reason. it does solve alot of those "live-migration" headaches you describ | 17:02 |
dmsimard | SamYaple: is ephemeral on ceph too ? | 17:02 |
SamYaple | dmsimard: indeed | 17:02 |
inc0 | it does not solve memory-bound vms | 17:02 |
dmsimard | inc0: yeah we've had customers that would dirty their memory faster than it would transfer | 17:03 |
inc0 | as unmigrable because too much memory get shuffled in | 17:03 |
dmsimard | nuts | 17:03 |
inc0 | it's unsolvable problem without RDMA | 17:03 |
dmsimard | windows was notoriously worse | 17:03 |
SamYaple | but all of that is outside kollas control | 17:03 |
inc0 | but that's the world | 17:03 |
SamYaple | if that compute node dies all the data is down. outside of kolla control | 17:03 |
SamYaple | we arent solving those issues | 17:03 |
inc0 | and currently we introduced something that breaks upgradability terribly | 17:03 |
SamYaple | we are making the upgrade with as little downtime as kolla can provide as painless as possible | 17:04 |
SamYaple | you are freaking otu for no reason again | 17:04 |
inc0 | SamYaple, and we failed to do this because it's considerably more painful with kolla than without | 17:04 |
SamYaple | I disagree and the operators I know would too (though that is a subset of them for sure) | 17:04 |
SamYaple | it won't work for everyone but it absolutely will work for some | 17:05 |
SamYaple | but thats all beside the point. purpose a solution | 17:05 |
kproskurin | Guys, could you please review this heat trusts? https://review.openstack.org/#/c/236198 I belive it’s ready to merge. | 17:05 |
SamYaple | "upgrades are no-go" is unacceptable and not helpful | 17:05 |
inc0 | we might leverage pid=host | 17:05 |
SamYaple | we do already | 17:05 |
SamYaple | we run with pid=host | 17:05 |
inc0 | even if that means moving qemu out of container after upgrade | 17:05 |
SamYaple | hell no | 17:05 |
inc0 | I know, that's why it might be solvable problem | 17:05 |
SamYaple | thats a -2 idea right there | 17:05 |
kproskurin | SamYaple: I fixed your comments in heat: https://review.openstack.org/#/c/271978/ Takw alook then you have time | 17:05 |
inc0 | might be | 17:06 |
SamYaple | kproskurin: absolutely ill look now | 17:06 |
kproskurin | thank you! | 17:06 |
SamYaple | inc0: what you are asking for is a change in docker. so hit up the mailing list | 17:06 |
SamYaple | this was the original behaviour of pid=host and you want it back | 17:06 |
SamYaple | thats a use case | 17:06 |
SamYaple | but its not oging to happen now | 17:07 |
inc0 | what I'm asking is how to solve our biggest priority, even if that breaks cleanliness of solution | 17:07 |
SamYaple | im -2 on anything touching the host like that at all. im positive sdake is too | 17:07 |
inc0 | or rollback changes that require us to upgrade docker | 17:07 |
inc0 | until docker is ready to solve this problem | 17:08 |
SamYaple | these are not options at all. telling operators to migrate vms is an option however | 17:08 |
SamYaple | we arent rolling back the entire mitaka cycles worth of ork | 17:08 |
SamYaple | work* | 17:08 |
pbourke | SamYaple: tbh even if inc0 is being dramatic I dont think its wise to dismiss real operator concerns | 17:13 |
SamYaple | just fyi dmsimard and inc0. to pull in a new version of qemu you absolutely must migrate/restart the vm. | 17:13 |
SamYaple | pbourke: im not. im acknowleging it! but its not the end of hte world | 17:13 |
inc0 | but we don't need to upgrade qemu every 6 months | 17:13 |
SamYaple | we will absolutely do this without stopping vms if possible | 17:13 |
pbourke | ok cool | 17:13 |
SamYaple | inc0: yes. yes we do | 17:13 |
inc0 | we should make this optional | 17:13 |
SamYaple | its baked into the package repos | 17:13 |
SamYaple | there is nothing optional here | 17:14 |
inc0 | keep the old container | 17:14 |
pbourke | which features are we using again that requires 1.9 | 17:14 |
inc0 | because as dmsimard said - you upgrade one node, say bye-bye to LM to or from it | 17:14 |
SamYaple | inc0: that wont work.... | 17:14 |
SamYaple | and thats not entirely true | 17:14 |
inc0 | pbourke, 1.10 | 17:14 |
SamYaple | you can migrate from different versions of qemu to eachother | 17:14 |
inc0 | named volumes, thin containers | 17:14 |
*** kproskurin has quit IRC | 17:15 | |
SamYaple | inc0: we _need_ thin containers for no downtime | 17:15 |
SamYaple | this was also one of your complaints | 17:15 |
dmsimard | SamYaple: some version of qemu are NOT compatible | 17:15 |
dmsimard | I'm not the who took care of this but there was a large issue between qemu 12.04 and 14.04 | 17:15 |
dmsimard | no migration path | 17:15 |
inc0 | and we can't be sure if new version will be compatible | 17:15 |
dmsimard | we had to compile our own version with a fix | 17:15 |
SamYaple | thats fair | 17:16 |
SamYaple | but qemu is making efforts to ensure that doesnt happen in the future | 17:16 |
SamYaple | dmsimard: additionally we arent using the 14.04 qemu | 17:16 |
SamYaple | we are stepping with cloud-archive for ubuntu | 17:16 |
SamYaple | and so far all of those versions have been compatible (probably by design) | 17:16 |
SamYaple | not saying it is a certain thing, but these are outside of kollas control | 17:17 |
dmsimard | yeah, I'm not overreacting or anything. I'm just saying that most of the time live migrations are not easy at scale | 17:17 |
SamYaple | i agree dmsimard. im not dismissing that. but there is only so much kolla can do to fix that at this time | 17:18 |
SamYaple | we need _any_ upgrades now, and then we refine them | 17:18 |
SamYaple | this is far from a "upgrades are a no-go" problem | 17:18 |
dmsimard | sure, iterative | 17:18 |
inc0 | it's just - right now we're doing worse than devstack would | 17:18 |
inc0 | and that's....depressing | 17:18 |
SamYaple | dont be such a drama queen | 17:19 |
SamYaple | we arent | 17:19 |
SamYaple | if qemu needs tob e upgraded it has to be | 17:19 |
SamYaple | and last i checked devstacks multinode is awful | 17:19 |
inc0 | you should be able to run qemu 2.4 for some time | 17:20 |
inc0 | it's not every 6 months problem | 17:20 |
SamYaple | it is when you have to follow canonical | 17:21 |
*** rhallisey has joined #kolla | 17:21 | |
SamYaple | and they have the newest versions every 6 months | 17:21 |
*** unicell has quit IRC | 17:21 | |
SamYaple | this is whats "supported" | 17:21 |
*** akwasnie has quit IRC | 17:23 | |
*** ssurana has joined #kolla | 17:31 | |
*** daneyon_ has joined #kolla | 17:32 | |
*** absubram has joined #kolla | 17:33 | |
*** daneyon has quit IRC | 17:35 | |
*** rhallisey has quit IRC | 17:36 | |
*** salv-orl_ has joined #kolla | 17:36 | |
*** salv-orlando has quit IRC | 17:39 | |
*** fgimenez has quit IRC | 17:43 | |
*** akwasnie has joined #kolla | 17:44 | |
*** akwasnie1 has joined #kolla | 17:49 | |
*** akwasnie has quit IRC | 17:51 | |
openstackgerrit | Paul Bourke proposed openstack/kolla: Fix image plugin functionality for oslo.config https://review.openstack.org/268211 | 17:52 |
*** pbourke has quit IRC | 17:59 | |
*** pbourke has joined #kolla | 18:00 | |
openstackgerrit | Sam Yaple proposed openstack/kolla: Rename kolla_ansible to kolla_toolbox https://review.openstack.org/274154 | 18:03 |
pbourke | inc0: if you get a chance could you address the question around sighup on the nova review? would be good to know as am hoping to attack swift tomorrow | 18:04 |
pbourke | thanks :) | 18:04 |
*** unicell has joined #kolla | 18:04 | |
inc0 | pbourke, sighup is less disruptive | 18:05 |
inc0 | and works well, there is no need for restart imho | 18:05 |
*** dwalsh has quit IRC | 18:06 | |
openstackgerrit | Jeffrey Zhang proposed openstack/kolla: Playbook for horizon upgrade https://review.openstack.org/274827 | 18:07 |
SamYaple | inc0: i think we need a conversation around that | 18:07 |
SamYaple | inc0: i want to start doing that for config updates, but tehre was... concern when i mentioned it before | 18:07 |
inc0 | which was..? | 18:07 |
SamYaple | it was never actually stated | 18:07 |
SamYaple | just "concern" | 18:07 |
inc0 | I mean apart from "not everything supports it" | 18:07 |
inc0 | what was the concern? | 18:08 |
SamYaple | thats my point | 18:08 |
SamYaple | it was just stated as "concern" so we need to have the conversaion | 18:08 |
inc0 | ok...who has these concerns? | 18:09 |
SamYaple | last time the conversation was had i don't think you were even part of the community | 18:09 |
*** jasonsb has quit IRC | 18:09 | |
SamYaple | i dont recall everyone, but sdake was one | 18:10 |
inc0 | sdake commented in my review that he liked this solution | 18:10 |
inc0 | so I guess let's have a conversation when someone have "concern";) I'm happy to have it | 18:10 |
SamYaple | well well have it again in a wider audience to see if anyone sees an issue with this approach. | 18:11 |
SamYaple | last time it was suggested was around the time of the kolla-ansible spec | 18:11 |
inc0 | that's what gerrit is for | 18:13 |
inc0 | if someone has this concern, he/she is free to review this patch | 18:13 |
inc0 | but unless someone actually does that, I assume it's ok | 18:14 |
SamYaple | gerrit is not for a wider audeience. you are thinking of the mailing list | 18:14 |
inc0 | as for sdake's concern, https://review.openstack.org/#/c/254395/12/ansible/roles/nova/tasks/upgrade/reload.yml he did comment on that specific one | 18:14 |
*** Jeffrey4l has quit IRC | 18:14 | |
inc0 | I did in upgrades thread | 18:15 |
*** dtturner has quit IRC | 18:15 | |
inc0 | I specifically said there I'm going to sighup services | 18:15 |
openstackgerrit | Qiu Yu proposed openstack/kolla: Fix Swift for multinode P+ACO deployment https://review.openstack.org/274215 | 18:15 |
SamYaple | inc0: im not in the mood to do this with you today | 18:15 |
inc0 | me neither, trust me | 18:15 |
SamYaple | then drop it and move on | 18:15 |
*** limamauricio has joined #kolla | 18:15 | |
*** Marga_ has quit IRC | 18:16 | |
inc0 | feel free to start ML thread if you feel there is need for conversation about that, I'm happy to have it | 18:16 |
*** akwasnie1 has quit IRC | 18:17 | |
limamauricio | Hello, I'm having some difficulty to give root privileges to manila access some directories. /var/lib/manila and /var/cache/manila | 18:17 |
SamYaple | limamauricio: what trouble are you talking about? | 18:18 |
SamYaple | during build or after? | 18:18 |
limamauricio | After | 18:18 |
limamauricio | build and deploy works | 18:18 |
SamYaple | i believe the container is running as the manila user | 18:19 |
SamYaple | so in the build you would have to chown those folders | 18:19 |
SamYaple | do you have a patchset you are wrokging on? | 18:19 |
limamauricio | permissions are given in the build or deploy? | 18:21 |
*** dims_ has joined #kolla | 18:21 | |
*** dims has quit IRC | 18:22 | |
SamYaple | limamauricio: both, but mostly build | 18:22 |
limamauricio | I do not think I ran the build after my last change. | 18:23 |
limamauricio | Should be it | 18:24 |
limamauricio | Thank you | 18:24 |
limamauricio | I'll check it now | 18:24 |
SamYaple | limamauricio: ok let me know! | 18:25 |
limamauricio | I run build once, can I run again? | 18:26 |
limamauricio | or you have to clean up for work? | 18:26 |
limamauricio | I have* | 18:27 |
SamYaple | limamauricio: you can run it again | 18:27 |
limamauricio | Ok | 18:27 |
SamYaple | the images it puts out from a successful run _should_ be the latest | 18:27 |
limamauricio | ok | 18:27 |
SamYaple | though you may want to clean all images and rebuild fresh as a final test to ensure it works as desired | 18:27 |
limamauricio | ok] | 18:28 |
*** Marga_ has joined #kolla | 18:51 | |
*** ppetit has quit IRC | 18:53 | |
*** rmart04 has joined #kolla | 18:57 | |
*** salv-orl_ has quit IRC | 19:00 | |
*** ajafo has quit IRC | 19:21 | |
*** thumpba has quit IRC | 19:23 | |
*** thumpba has joined #kolla | 19:26 | |
*** ajafo has joined #kolla | 19:32 | |
*** dave-mccowan has quit IRC | 19:57 | |
*** salv-orlando has joined #kolla | 20:03 | |
*** salv-orlando has quit IRC | 20:07 | |
*** dave-mccowan has joined #kolla | 20:16 | |
*** nihilifer has quit IRC | 20:26 | |
*** nihilifer has joined #kolla | 20:30 | |
SamYaple | has anyone tried to boot a vm on a fresh build from master in the past few days? | 20:49 |
SamYaple | I am getting this bug https://bugs.launchpad.net/kolla/+bug/1540579 | 20:49 |
openstack | Launchpad bug 1540579 in kolla "nova-api -- No sql_connection parameter is established" [Undecided,New] | 20:49 |
*** salv-orlando has joined #kolla | 20:53 | |
*** thomasem is now known as thomasem-away | 20:53 | |
dmsimard | SamYaple: we're seeing this in RDO as well | 20:56 |
dmsimard | SamYaple: I haven't found the fix but I found this https://review.openstack.org/#/c/274703/ | 20:57 |
dmsimard | http://lists.openstack.org/pipermail/openstack-dev/2016-February/085497.html | 20:57 |
dmsimard | I don't know if there's a relationship, I haven't looked much at all yet | 20:57 |
SamYaple | dmsimard: ok cool not crazy then | 20:58 |
dmsimard | SamYaple: if you find the problem, do let me know - I'll do the same, I subscribed to the bug in the meantime :) | 20:58 |
*** thumpba has quit IRC | 21:00 | |
*** dims has joined #kolla | 21:02 | |
SamYaple | dmsimard: i did a git blame on nova _and_ oslo.db right after it first happened | 21:03 |
SamYaple | could not track it down | 21:03 |
*** dims_ has quit IRC | 21:03 | |
SamYaple | not that oslo.db is running master in kolla or anything, but still | 21:03 |
dmsimard | yeah it's a mess, it could be almost anyone's fault | 21:03 |
SamYaple | it might be oslo.config | 21:03 |
dmsimard | I saw something about moving to keystoneauth1 in nova too | 21:03 |
SamYaple | but i can't see it being anything else | 21:03 |
SamYaple | it doesn't seem to be an auth issue | 21:04 |
SamYaple | the object itself was missing info, so maybe oslo issue somewhere... | 21:04 |
SamYaple | what recently bumped? | 21:04 |
SamYaple | dmsimard: i bet i found it https://github.com/openstack/requirements/commit/0520b3a219560c79da43c0bd27133377da1459cb | 21:04 |
SamYaple | should be a quick test | 21:05 |
dmsimard | I just asked #openstack-dev to see if anyone else has seen it | 21:05 |
dmsimard | SamYaple: are you getting that from source too ? on which distro ? | 21:05 |
*** unicell has quit IRC | 21:06 | |
SamYaple | dmsimard: ubutnu source | 21:08 |
SamYaple | i bet its that oslo.config change | 21:08 |
SamYaple | im rebuilding now | 21:08 |
SamYaple | testign ETA 15m | 21:08 |
dmsimard | that's very cool, seeing that on binary RDO | 21:08 |
dmsimard | cool as in it's not isolated to one type | 21:08 |
SamYaple | yea | 21:08 |
dims | SamYaple : we haven't released any libs today | 21:19 |
SamYaple | dims: it happened last week | 21:20 |
SamYaple | thought it was isolated to me | 21:20 |
SamYaple | i think it was the oslo.config bump to 3.4.0 | 21:20 |
SamYaple | im testing that theory | 21:20 |
dims | SamYaple : ack https://pypi.python.org/pypi/oslo.config/3.4.0 was on Jan 26th | 21:21 |
SamYaple | yea then globals got bumped right after dims | 21:21 |
SamYaple | shouold know momentarily | 21:21 |
dims | SamYaple : oslo.db was on 1/23 as well - https://pypi.python.org/pypi/oslo.db/ | 21:21 |
SamYaple | its not oslo.db, tested taht last week | 21:22 |
SamYaple | well i say not, its _proabbly_ not | 21:22 |
dims | SamYaple : cool :) | 21:22 |
SamYaple | its downgrading log fixes it ill git blame oslo.log and narrow it down | 21:22 |
SamYaple | im thinking its a nova bug oslo brought out though, just my gut | 21:23 |
*** mbound has quit IRC | 21:23 | |
dims | SamYaple : thanks! just holler on either the Nova or the Oslo channels :) | 21:23 |
SamYaple | will do dims | 21:23 |
dims | Thanks! | 21:24 |
SamYaple | git blame oslo.config* dims | 21:25 |
SamYaple | wrong oslo project ;) | 21:25 |
*** dwalsh has joined #kolla | 21:32 | |
SamYaple | dims: doesn't look like older versions of oslo fixes this, going to pbr and see if i can figure it out | 21:47 |
*** tpot has joined #kolla | 22:01 | |
SamYaple | arrrrrggg dims dmsimard https://github.com/openstack/nova/commit/df0fca62cf5324f5b6eae0fed1f88c6c9ed61c71 | 22:02 |
SamYaple | specifically https://github.com/openstack/nova/blob/df0fca62cf5324f5b6eae0fed1f88c6c9ed61c71/releasenotes/notes/request-spec-api-db-b9cc6e0624d563c5.yaml | 22:02 |
*** thumpba has joined #kolla | 22:02 | |
SamYaple | inc0: you too | 22:02 |
SamYaple | thats goign to hit upgrades | 22:02 |
dmsimard | Wow, there's a nova-api database now ? | 22:03 |
SamYaple | apparently | 22:03 |
SamYaple | i need a drink | 22:03 |
SamYaple | ill push up a patch when i get back | 22:03 |
dmsimard | SamYaple: I was going to open a bug to puppet-nova but someone beat me to it https://bugs.launchpad.net/puppet-nova/+bug/1539793 | 22:05 |
openstack | Launchpad bug 1539793 in puppet-nova "Nova Mitaka requires a new nova_api database" [High,In progress] - Assigned to Dan Prince (dan-prince) | 22:05 |
inc0 | omfg | 22:06 |
inc0 | and I mean omfg | 22:06 |
*** thomasem-away is now known as thomasem | 22:09 | |
SamYaple | inc0: right? | 22:09 |
dmsimard | Why don't they use the nova database :( | 22:09 |
dims | SamYaple : i had no idea :) | 22:09 |
SamYaple | it was dims GET HIM! | 22:10 |
dims | LOL | 22:10 |
dims | i would have expected to have defaulted to the older config(s) if the new one was not there... | 22:10 |
SamYaple | dims: why need second database tho? | 22:10 |
SamYaple | :( | 22:10 |
dims | let's ask alaski over on #openstack-nova | 22:11 |
*** tpot has quit IRC | 22:12 | |
dmsimard | I'm coming with the popcorn | 22:13 |
*** thomasem is now known as thomasem-away | 22:15 | |
*** kproskurin has joined #kolla | 22:15 | |
kproskurin | Hey guys, could you pls look into heat trusts review? https://review.openstack.org/#/c/236198/ Im really think it's ready for merge | 22:16 |
SamYaple | kproskurin: looking | 22:16 |
SamYaple | kproskurin: my job there is done | 22:17 |
kproskurin | Sam, you allready have +2 | 22:17 |
kproskurin | :-) | 22:17 |
kproskurin | Some1 else? :-) | 22:18 |
SamYaple | inc0: api_database has been there since liberty | 22:19 |
SamYaple | inc0: join #openstack-nova | 22:19 |
*** jtriley has quit IRC | 22:21 | |
inc0 | it's like...we made rule to use conductor for every db write...but we can't now, so let's make new db to not use conductor | 22:25 |
*** inc0 has quit IRC | 22:26 | |
*** RA_ has joined #kolla | 22:28 | |
*** dwalsh has quit IRC | 22:42 | |
*** yuanying has joined #kolla | 23:02 | |
*** RA_ has quit IRC | 23:02 | |
openstackgerrit | Sam Yaple proposed openstack/kolla: Create nova-api database https://review.openstack.org/274928 | 23:04 |
*** kproskurin has quit IRC | 23:09 | |
*** RA has joined #kolla | 23:19 | |
*** RA is now known as Guest51478 | 23:20 | |
*** rmart04 has quit IRC | 23:27 | |
*** alisonh has quit IRC | 23:27 | |
*** alisonh has joined #kolla | 23:33 | |
*** blahRus has quit IRC | 23:37 | |
*** salv-orl_ has joined #kolla | 23:37 | |
openstackgerrit | Merged openstack/kolla-mesos: Remove hostname-unique pidfile for mariadb https://review.openstack.org/274584 | 23:39 |
*** stvnoyes has quit IRC | 23:40 | |
*** salv-orlando has quit IRC | 23:40 | |
*** stvnoyes has joined #kolla | 23:41 | |
*** diogogmt has quit IRC | 23:56 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!