*** racedo_ has joined #openstack-operators | 00:11 | |
*** racedo has quit IRC | 00:11 | |
*** bapalm has quit IRC | 00:22 | |
*** bapalm has joined #openstack-operators | 00:25 | |
*** dtrainor has joined #openstack-operators | 00:28 | |
*** ducttape_ has joined #openstack-operators | 00:33 | |
*** gyee has quit IRC | 00:38 | |
*** fragatina has quit IRC | 00:44 | |
*** dtrainor has quit IRC | 01:04 | |
*** ducttape_ has quit IRC | 01:09 | |
*** saneax is now known as saneax_AFK | 01:12 | |
*** Apoorva_ has joined #openstack-operators | 01:13 | |
*** britthouser has joined #openstack-operators | 01:13 | |
*** britthou_ has joined #openstack-operators | 01:14 | |
*** ducttape_ has joined #openstack-operators | 01:15 | |
*** Apoorva has quit IRC | 01:16 | |
*** Apoorva_ has quit IRC | 01:17 | |
*** britthouser has quit IRC | 01:18 | |
*** zul has quit IRC | 01:50 | |
*** piet has quit IRC | 01:52 | |
*** zul_ has joined #openstack-operators | 02:01 | |
*** zul has joined #openstack-operators | 02:02 | |
*** zul_ has quit IRC | 02:10 | |
*** jamesdenton has joined #openstack-operators | 02:28 | |
*** ducttape_ has quit IRC | 02:35 | |
*** piet has joined #openstack-operators | 02:43 | |
*** piet has quit IRC | 02:54 | |
*** piet has joined #openstack-operators | 02:54 | |
*** kstev has quit IRC | 03:06 | |
*** jamesdenton has quit IRC | 03:10 | |
*** piet has quit IRC | 03:16 | |
*** kstev has joined #openstack-operators | 03:17 | |
*** jamesdenton has joined #openstack-operators | 03:17 | |
*** armax has quit IRC | 03:29 | |
*** markvoelker has joined #openstack-operators | 03:32 | |
*** markvoelker_ has joined #openstack-operators | 03:35 | |
*** markvoelker has quit IRC | 03:38 | |
*** markvoelker has joined #openstack-operators | 03:46 | |
*** markvoelker_ has quit IRC | 03:49 | |
*** julim has quit IRC | 03:58 | |
*** jamesdenton has quit IRC | 04:01 | |
*** ducttape_ has joined #openstack-operators | 04:06 | |
*** ducttape_ has quit IRC | 04:11 | |
*** kstev has quit IRC | 04:31 | |
*** saneax_AFK is now known as saneax | 04:32 | |
*** d0ugal has quit IRC | 05:01 | |
*** fawadkhaliq has joined #openstack-operators | 05:01 | |
*** ducttape_ has joined #openstack-operators | 05:07 | |
*** ducttape_ has quit IRC | 05:12 | |
*** markvoelker_ has joined #openstack-operators | 05:16 | |
*** zeih has quit IRC | 05:18 | |
*** markvoelker has quit IRC | 05:19 | |
*** breton has quit IRC | 05:26 | |
*** liverpooler has joined #openstack-operators | 05:36 | |
*** breton has joined #openstack-operators | 05:41 | |
*** arif-ali has quit IRC | 05:45 | |
*** markvoelker_ has quit IRC | 05:45 | |
*** breton has quit IRC | 05:46 | |
*** breton has joined #openstack-operators | 05:47 | |
*** breton has quit IRC | 05:54 | |
*** simon-AS5591 has quit IRC | 05:54 | |
*** breton has joined #openstack-operators | 05:54 | |
*** fawadkhaliq has quit IRC | 05:58 | |
*** rcernin has joined #openstack-operators | 05:58 | |
*** Rockyg has quit IRC | 05:59 | |
*** d0ugal has joined #openstack-operators | 06:04 | |
*** ducttape_ has joined #openstack-operators | 06:08 | |
*** breton has quit IRC | 06:14 | |
*** ducttape_ has quit IRC | 06:15 | |
*** breton has joined #openstack-operators | 06:21 | |
*** breton has quit IRC | 06:26 | |
*** eddima has joined #openstack-operators | 06:28 | |
*** breton has joined #openstack-operators | 06:28 | |
*** d0ugal has quit IRC | 06:43 | |
*** zeih has joined #openstack-operators | 06:46 | |
*** simon-AS559 has joined #openstack-operators | 06:51 | |
*** simon-AS5591 has joined #openstack-operators | 06:52 | |
*** simon-AS559 has quit IRC | 06:55 | |
*** fawadkhaliq has joined #openstack-operators | 06:56 | |
*** britthou_ has quit IRC | 06:58 | |
*** fawadkhaliq has quit IRC | 06:59 | |
*** fawadkhaliq has joined #openstack-operators | 06:59 | |
*** britthouser has joined #openstack-operators | 06:59 | |
*** tesseract- has joined #openstack-operators | 07:00 | |
*** pcaruana has joined #openstack-operators | 07:00 | |
*** simon-AS5591 has quit IRC | 07:06 | |
*** ducttape_ has joined #openstack-operators | 07:10 | |
*** simon-AS5591 has joined #openstack-operators | 07:14 | |
*** ducttape_ has quit IRC | 07:15 | |
*** fragatina has joined #openstack-operators | 07:17 | |
*** fragatina has quit IRC | 07:18 | |
*** fragatina has joined #openstack-operators | 07:19 | |
*** breton has quit IRC | 07:27 | |
*** admin0 has joined #openstack-operators | 07:40 | |
*** breton has joined #openstack-operators | 07:41 | |
*** admin0 has quit IRC | 07:42 | |
*** admin0 has joined #openstack-operators | 07:44 | |
*** beddari has quit IRC | 07:48 | |
*** breton has quit IRC | 07:49 | |
*** breton has joined #openstack-operators | 07:50 | |
*** dfflanders has quit IRC | 07:52 | |
*** beddari has joined #openstack-operators | 07:52 | |
*** breton has quit IRC | 07:55 | |
*** breton has joined #openstack-operators | 07:56 | |
*** zeih has quit IRC | 07:56 | |
*** admin0 has quit IRC | 07:57 | |
*** beddari has quit IRC | 07:58 | |
*** fawadkhaliq has quit IRC | 07:59 | |
*** dtrainor has joined #openstack-operators | 08:00 | |
*** zeih has joined #openstack-operators | 08:01 | |
*** breton has quit IRC | 08:01 | |
*** fawadkhaliq has joined #openstack-operators | 08:01 | |
*** breton has joined #openstack-operators | 08:02 | |
*** beddari has joined #openstack-operators | 08:02 | |
*** admin0 has joined #openstack-operators | 08:04 | |
*** fawadkhaliq has quit IRC | 08:05 | |
*** dbecker has joined #openstack-operators | 08:06 | |
*** breton has quit IRC | 08:07 | |
*** beddari has quit IRC | 08:08 | |
*** dtrainor has quit IRC | 08:09 | |
*** ducttape_ has joined #openstack-operators | 08:11 | |
*** beddari has joined #openstack-operators | 08:12 | |
*** ducttape_ has quit IRC | 08:15 | |
*** beddari has quit IRC | 08:18 | |
*** derekh has joined #openstack-operators | 08:20 | |
*** beddari has joined #openstack-operators | 08:23 | |
*** zeih has quit IRC | 08:24 | |
*** zeih has joined #openstack-operators | 08:26 | |
*** beddari has quit IRC | 08:28 | |
*** admin0 has quit IRC | 08:28 | |
*** beddari has joined #openstack-operators | 08:32 | |
*** admin0 has joined #openstack-operators | 08:36 | |
*** beddari has quit IRC | 08:38 | |
*** beddari has joined #openstack-operators | 08:42 | |
*** beddari has quit IRC | 08:48 | |
*** beddari has joined #openstack-operators | 08:52 | |
*** electrofelix has joined #openstack-operators | 08:56 | |
*** beddari has quit IRC | 08:58 | |
*** fawadkhaliq has joined #openstack-operators | 09:02 | |
*** beddari has joined #openstack-operators | 09:02 | |
*** fawadkhaliq has quit IRC | 09:06 | |
*** ducttape_ has joined #openstack-operators | 09:12 | |
*** ducttape_ has quit IRC | 09:16 | |
*** fawadkhaliq has joined #openstack-operators | 09:24 | |
*** dtrainor has joined #openstack-operators | 09:32 | |
*** zeih has quit IRC | 09:36 | |
*** admin0 has quit IRC | 09:46 | |
*** d0ugal has joined #openstack-operators | 10:03 | |
*** simon-AS5591 has quit IRC | 10:05 | |
*** admin0 has joined #openstack-operators | 10:08 | |
*** hieulq_ has quit IRC | 10:16 | |
*** breton has joined #openstack-operators | 10:16 | |
*** zeih has joined #openstack-operators | 10:30 | |
*** hieulq_ has joined #openstack-operators | 10:31 | |
*** arif-ali has joined #openstack-operators | 10:50 | |
*** arnewiebalck has quit IRC | 10:58 | |
*** arnewiebalck has joined #openstack-operators | 11:02 | |
*** julim has joined #openstack-operators | 11:05 | |
*** zeih has quit IRC | 11:11 | |
*** britthouser has quit IRC | 11:22 | |
*** julim has quit IRC | 11:23 | |
*** admin0 has quit IRC | 11:27 | |
*** bmwiedemann has joined #openstack-operators | 11:30 | |
bmwiedemann | Hi, what is the easiest way to create a tenant/project with a certain project-id ? (would like to have that to make migration from another cloud easier) or could I just dump+import the appropriate table from the keystone DB? | 11:31 |
---|---|---|
*** simon-AS559 has joined #openstack-operators | 11:31 | |
*** simon-AS559 has quit IRC | 11:49 | |
*** admin0 has joined #openstack-operators | 11:49 | |
*** fawadkhaliq has quit IRC | 11:50 | |
*** ducttape_ has joined #openstack-operators | 11:58 | |
*** jokke_ has quit IRC | 11:59 | |
*** jokke_ has joined #openstack-operators | 11:59 | |
*** beddari has quit IRC | 12:08 | |
*** zeih has joined #openstack-operators | 12:08 | |
*** fawadkhaliq has joined #openstack-operators | 12:17 | |
*** ducttape_ has quit IRC | 12:17 | |
*** fawadkhaliq has quit IRC | 12:20 | |
*** piet has joined #openstack-operators | 12:22 | |
*** zeih has quit IRC | 12:25 | |
*** zeih has joined #openstack-operators | 12:27 | |
*** markvoelker has joined #openstack-operators | 12:34 | |
*** piet has quit IRC | 12:40 | |
*** piet has joined #openstack-operators | 12:40 | |
*** makowals has joined #openstack-operators | 13:00 | |
*** admin0 has quit IRC | 13:05 | |
*** britthouser has joined #openstack-operators | 13:05 | |
*** ducttape_ has joined #openstack-operators | 13:08 | |
*** admin0 has joined #openstack-operators | 13:09 | |
*** Trozz has quit IRC | 13:11 | |
*** admin0 has quit IRC | 13:15 | |
*** admin0 has joined #openstack-operators | 13:16 | |
*** ducttape_ has quit IRC | 13:16 | |
*** jamesdenton has joined #openstack-operators | 13:16 | |
*** mriedem_away is now known as mriedem | 13:17 | |
*** vinsh has quit IRC | 13:17 | |
*** britthouser has quit IRC | 13:19 | |
*** britthouser has joined #openstack-operators | 13:20 | |
*** julim has joined #openstack-operators | 13:21 | |
*** zeih has quit IRC | 13:21 | |
*** julim has quit IRC | 13:23 | |
*** dtrainor_ has joined #openstack-operators | 13:29 | |
*** dbecker_ has joined #openstack-operators | 13:29 | |
*** d0ugal_ has joined #openstack-operators | 13:30 | |
*** dtrainor has quit IRC | 13:32 | |
*** dbecker has quit IRC | 13:32 | |
*** d0ugal has quit IRC | 13:33 | |
*** d0ugal_ is now known as d0ugal | 13:35 | |
*** d0ugal is now known as Guest65715 | 13:36 | |
*** Guest65715 has quit IRC | 13:36 | |
*** d0ugal_ has joined #openstack-operators | 13:36 | |
*** dtrainor_ has quit IRC | 13:38 | |
*** racedo_ has quit IRC | 13:40 | |
*** dtrainor has joined #openstack-operators | 13:42 | |
*** racedo has joined #openstack-operators | 13:43 | |
*** d0ugal_ has quit IRC | 13:44 | |
*** d0ugal has joined #openstack-operators | 13:44 | |
*** racedo has quit IRC | 13:47 | |
*** kstev has joined #openstack-operators | 13:53 | |
*** Fin1te has joined #openstack-operators | 14:01 | |
med_ | \o | 14:02 |
med_ | crickets | 14:03 |
*** cdelatte has joined #openstack-operators | 14:03 | |
med_ | I show a meeting in this channel now per tom email but it seems pretty vacant. | 14:04 |
med_ | clayton, concur? | 14:04 |
*** piet has quit IRC | 14:04 | |
med_ | apparently not | 14:05 |
clayton | I had it on my calendar for now | 14:09 |
*** markvoelker has quit IRC | 14:11 | |
*** admin0 has quit IRC | 14:11 | |
*** ducttape_ has joined #openstack-operators | 14:11 | |
*** jlk has quit IRC | 14:15 | |
*** jlk` has joined #openstack-operators | 14:15 | |
bmwiedemann | these openstack channels seem pretty sleepy ;-) | 14:16 |
*** admin0 has joined #openstack-operators | 14:16 | |
bmwiedemann | but now I got a simple question: if you are an openstack-operator, how big is your cloud? Mine is 10 nodes with ~700 MB RAM and 120 cores total. | 14:18 |
*** mriedem1 has joined #openstack-operators | 14:28 | |
*** piet has joined #openstack-operators | 14:28 | |
*** mriedem has quit IRC | 14:29 | |
*** markvoelker has joined #openstack-operators | 14:30 | |
*** julim has joined #openstack-operators | 14:31 | |
*** mriedem1 is now known as mriedem | 14:31 | |
bmwiedemann | err. meant 700GB RAM | 14:31 |
*** Fin1te has quit IRC | 14:41 | |
*** egonzalez has joined #openstack-operators | 14:41 | |
*** vinsh has joined #openstack-operators | 14:47 | |
*** vinsh_ has joined #openstack-operators | 14:50 | |
*** zeih has joined #openstack-operators | 14:51 | |
*** vinsh has quit IRC | 14:53 | |
*** vinsh_ has quit IRC | 14:54 | |
*** vinsh has joined #openstack-operators | 14:54 | |
*** vinsh has quit IRC | 14:55 | |
*** Fin1te has joined #openstack-operators | 14:58 | |
*** saneax is now known as saneax_AFK | 15:09 | |
*** dronshaw has joined #openstack-operators | 15:13 | |
*** Fin1te has quit IRC | 15:18 | |
*** belmoreira has joined #openstack-operators | 15:18 | |
*** egonzalez has quit IRC | 15:32 | |
*** armax has joined #openstack-operators | 15:32 | |
*** admin0 has quit IRC | 15:32 | |
*** ducttape_ has quit IRC | 15:37 | |
*** makowals has quit IRC | 15:38 | |
*** ducttape_ has joined #openstack-operators | 15:40 | |
*** belmoreira has quit IRC | 15:42 | |
*** fragatina has quit IRC | 15:44 | |
*** openfly has quit IRC | 15:47 | |
*** fragatina has joined #openstack-operators | 15:49 | |
*** mestery has quit IRC | 15:49 | |
*** mriedem1 has joined #openstack-operators | 15:49 | |
*** Guest52040 has joined #openstack-operators | 15:50 | |
*** mestery has joined #openstack-operators | 15:50 | |
*** mriedem has quit IRC | 15:51 | |
*** mriedem has joined #openstack-operators | 15:52 | |
*** mriedem1 has quit IRC | 15:54 | |
*** gyee has joined #openstack-operators | 15:55 | |
*** pcaruana has quit IRC | 16:00 | |
*** rcernin has quit IRC | 16:03 | |
*** eddima has quit IRC | 16:03 | |
*** liverpooler has quit IRC | 16:08 | |
*** britthouser has quit IRC | 16:09 | |
*** tesseract- has quit IRC | 16:09 | |
*** liverpooler has joined #openstack-operators | 16:10 | |
*** ggillies has quit IRC | 16:13 | |
*** david-lyle has joined #openstack-operators | 16:13 | |
*** ggillies has joined #openstack-operators | 16:14 | |
haukebruno | bmwiedemann, currently our 2 plattforms are smaller than 10 compute nodes, but we ran one last year with 65 compute nodes | 16:16 |
*** david-lyle has quit IRC | 16:21 | |
*** armax_ has joined #openstack-operators | 16:22 | |
*** armax has quit IRC | 16:24 | |
*** armax_ is now known as armax | 16:24 | |
*** d0ugal has quit IRC | 16:24 | |
*** dbecker_ has quit IRC | 16:25 | |
*** jlk` is now known as jlk | 16:26 | |
*** jlk has quit IRC | 16:27 | |
*** jlk has joined #openstack-operators | 16:27 | |
*** catintheroof has joined #openstack-operators | 16:28 | |
*** dtrainor has quit IRC | 16:29 | |
*** makowals has joined #openstack-operators | 16:30 | |
*** fragatina has quit IRC | 16:31 | |
*** Rockyg has joined #openstack-operators | 16:34 | |
*** admin0 has joined #openstack-operators | 16:45 | |
*** dbecker has joined #openstack-operators | 16:46 | |
*** Apoorva has joined #openstack-operators | 16:55 | |
*** Apoorva has quit IRC | 16:55 | |
*** derekh has quit IRC | 16:56 | |
*** Apoorva has joined #openstack-operators | 17:00 | |
*** armax_ has joined #openstack-operators | 17:04 | |
*** armax has quit IRC | 17:07 | |
*** armax_ is now known as armax | 17:07 | |
*** admin0 has quit IRC | 17:26 | |
*** eddima has joined #openstack-operators | 17:32 | |
*** makowals has quit IRC | 17:34 | |
*** makowals has joined #openstack-operators | 17:34 | |
*** makowals has quit IRC | 17:35 | |
*** makowals has joined #openstack-operators | 17:36 | |
*** eddima has quit IRC | 17:36 | |
*** britthouser has joined #openstack-operators | 17:39 | |
*** openfly has joined #openstack-operators | 17:44 | |
*** electrofelix has quit IRC | 17:57 | |
*** fawadkhaliq has joined #openstack-operators | 17:57 | |
*** admin0 has joined #openstack-operators | 17:57 | |
*** Apoorva_ has joined #openstack-operators | 17:59 | |
*** Guest52040 has quit IRC | 18:00 | |
*** Apoorva has quit IRC | 18:03 | |
*** liverpooler has quit IRC | 18:11 | |
*** ducttape_ has quit IRC | 18:11 | |
*** ducttape_ has joined #openstack-operators | 18:16 | |
*** dbecker has quit IRC | 18:19 | |
*** mriedem1 has joined #openstack-operators | 18:27 | |
*** Apoorva_ has quit IRC | 18:28 | |
*** Apoorva has joined #openstack-operators | 18:28 | |
*** mriedem2 has joined #openstack-operators | 18:29 | |
*** mriedem has quit IRC | 18:29 | |
*** ducttape_ has quit IRC | 18:30 | |
*** mriedem1 has quit IRC | 18:32 | |
*** mriedem2 is now known as mriedem | 18:35 | |
*** admin0 has quit IRC | 18:38 | |
*** piet has quit IRC | 18:48 | |
*** krobzaur has joined #openstack-operators | 18:53 | |
*** piet has joined #openstack-operators | 18:57 | |
*** Andhra_Guy has joined #openstack-operators | 19:04 | |
Andhra_Guy | having issues ipv6 network in liberty | 19:04 |
Andhra_Guy | created ipv6 subnet with DHCPv6 stateful mode but instances not getting ipv6 address only link local address | 19:05 |
*** ducttape_ has joined #openstack-operators | 19:06 | |
*** Andhra_Guy has left #openstack-operators | 19:15 | |
*** gyee has quit IRC | 19:18 | |
*** julim has quit IRC | 19:30 | |
*** esker has joined #openstack-operators | 19:33 | |
*** fragatina has joined #openstack-operators | 19:33 | |
*** krobzaur has quit IRC | 19:43 | |
*** fragatina has quit IRC | 19:44 | |
*** maishsk has joined #openstack-operators | 19:52 | |
*** fawadkhaliq has quit IRC | 19:53 | |
*** Apoorva has quit IRC | 19:59 | |
*** julim has joined #openstack-operators | 19:59 | |
*** Apoorva has joined #openstack-operators | 20:00 | |
*** zeih has quit IRC | 20:01 | |
*** britthouser has quit IRC | 20:03 | |
*** mriedem1 has joined #openstack-operators | 20:05 | |
*** simon-AS559 has joined #openstack-operators | 20:05 | |
*** mriedem has quit IRC | 20:08 | |
*** mriedem has joined #openstack-operators | 20:10 | |
*** britthouser has joined #openstack-operators | 20:11 | |
*** mriedem1 has quit IRC | 20:12 | |
*** cdelatte has quit IRC | 20:25 | |
*** jamesdenton has quit IRC | 20:34 | |
*** priteau has joined #openstack-operators | 20:47 | |
*** esker has quit IRC | 20:48 | |
*** markvoelker has quit IRC | 20:49 | |
*** cdelatte has joined #openstack-operators | 20:50 | |
*** piet has quit IRC | 20:56 | |
*** simon-AS559 has quit IRC | 20:58 | |
*** markvoelker has joined #openstack-operators | 21:00 | |
*** zeih has joined #openstack-operators | 21:01 | |
*** julian1 has joined #openstack-operators | 21:02 | |
*** piet has joined #openstack-operators | 21:07 | |
*** fragatina has joined #openstack-operators | 21:08 | |
*** Trident has joined #openstack-operators | 21:13 | |
*** fragatina has quit IRC | 21:15 | |
*** julian1 has quit IRC | 21:20 | |
*** rcernin has joined #openstack-operators | 21:21 | |
*** maishsk_ has joined #openstack-operators | 21:21 | |
*** esker has joined #openstack-operators | 21:22 | |
*** zeih has quit IRC | 21:22 | |
klindgren | wow - think I just solved a long running performance issue that we were seeing where eventually we got into a state where requests to keyston/neutron were getting hammered against a single server. | 21:23 |
*** maishsk has quit IRC | 21:24 | |
*** maishsk_ is now known as maishsk | 21:24 | |
klindgren | inside haproxy configured neutron/keystone for option forceclose (also enabled tw_reuse) | 21:24 |
klindgren | before we were getting "runs" against servers where it would recieve a request for 20 seconds, then get 30-40 in a second | 21:25 |
*** ducttape_ has quit IRC | 21:26 | |
*** esker has quit IRC | 21:27 | |
*** cdelatte has quit IRC | 21:28 | |
klindgren | requests weren't being balanced across all the servers effectively. I think this is mainly from http keepalive and eventlet pooling and requests not being balanced well inside eventlet | 21:28 |
klindgren | so sessions were being kept open for upwards of 200 seconds before being reusued | 21:28 |
*** esker has joined #openstack-operators | 21:28 | |
*** priteau has quit IRC | 21:32 | |
*** priteau has joined #openstack-operators | 21:33 | |
*** esker has quit IRC | 21:33 | |
*** ducttape_ has joined #openstack-operators | 21:44 | |
*** britthouser has quit IRC | 21:54 | |
*** markvoelker has quit IRC | 21:59 | |
*** markvoelker has joined #openstack-operators | 22:04 | |
*** mriedem has quit IRC | 22:08 | |
*** priteau has quit IRC | 22:09 | |
*** priteau has joined #openstack-operators | 22:10 | |
*** priteau has quit IRC | 22:13 | |
*** zeih has joined #openstack-operators | 22:19 | |
*** zeih has quit IRC | 22:25 | |
*** rcernin has quit IRC | 22:35 | |
*** zul has quit IRC | 22:36 | |
*** zul has joined #openstack-operators | 22:37 | |
jlk | Okay, wtf is Senlin, and why is it different from Heat? | 22:38 |
jlk | klindgren: interesting! | 22:38 |
jlk | klindgren: are you running keystone in eventlet still? | 22:38 |
klindgren | nope keystone is in uwsgi | 22:39 |
klindgren | but the eventlet stuff I believe is coming from nova | 22:40 |
jlk | so are you setting that globally then? | 22:40 |
klindgren | IE nova using some of the client stuff to talk to other services - IE keystone_middleware or nova -> neutron api for port info | 22:40 |
klindgren | so far just in haproxy in front of the servcies | 22:41 |
klindgren | letting it bake for a while before rolling everywhere | 22:41 |
klindgren | Our setup is Real LB -> haproxy on the api servers (terminates ssl) -> uwsgi|eventlet service | 22:42 |
*** _ducttape_ has joined #openstack-operators | 22:42 | |
*** ducttape_ has quit IRC | 22:42 | |
dmsimard | jlk: re selin: I don't have an answer for you but you made me choke on my drink. | 22:42 |
klindgren | keystone and nova are uwsgi - neutron is still eventlet | 22:42 |
jlk | dmsimard: it appears to have been created to provide autoscaling features, but HEAT now does autoscaling, so ¯\_(ツ)_/¯ | 22:43 |
*** ducttape_ has joined #openstack-operators | 22:43 | |
dmsimard | jlk: I think it's a legit question | 22:44 |
jlk | the repo is still getting commits, so somebody thinks it's useful | 22:44 |
klindgren | does heat *really* do autoscaling?) | 22:44 |
dmsimard | klindgren: yeah, it requires ceilometer/gnocchi/alarming | 22:44 |
dmsimard | basically you can tell it to spawn other things when cpu usage is too high or things like that | 22:45 |
klindgren | so... the answer is no then :D | 22:45 |
jlk | klindgren: okay. We're using haproxy as our LB, fronting all the services. Keystone is behind apache and uwsgi, the rest eventlet | 22:45 |
jlk | http://docs.openstack.org/developer/heat/template_guide/openstack.html#OS::Heat::AutoScalingGroup | 22:45 |
jlk | so you can do autoscaling, with ceilometer (and now aodh) alarming, and even use lbaasv2 | 22:45 |
dmsimard | klindgren: don't shoot the messenger, I hate heat :) | 22:45 |
jlk | one of our partners landed on https://wiki.openstack.org/wiki/Heat/AutoScaling and started asking why we don't support Senlin for autoscale. | 22:46 |
klindgren | jlk - yea basically when I was watching the logs, I would see a server getting a bunch of requets, then nothing for a while (10 seconds to a few minutes) then getting slammed with requests) - bascially the load was very bursty and not spread out at all | 22:46 |
*** _ducttape_ has quit IRC | 22:47 | |
klindgren | also TQ time was in the 10ms-300000ms | 22:47 |
klindgren | depending on how long it had been doing a keepalive and the last time it was used | 22:47 |
klindgren | now they TQ time is all in the 10-200ms range | 22:48 |
jlk | no noticeable ill effect from force close? | 22:48 |
*** ducttape_ has quit IRC | 22:52 | |
*** mriedem has joined #openstack-operators | 22:53 | |
*** markvoelker has quit IRC | 23:00 | |
*** saneax_AFK is now known as saneax | 23:06 | |
*** markvoelker has joined #openstack-operators | 23:06 | |
klindgren | not yet | 23:07 |
klindgren | we also enabled tw_re-use | 23:08 |
klindgren | https://github.com/openstack/oslo.service/blob/master/oslo_service/_options.py#L81 | 23:08 |
klindgren | we think might be the thing thats causing it | 23:08 |
klindgren | it was allegedly fixed, but apparently fix was - add doc notes - keep default the same | 23:08 |
klindgren | https://bugs.launchpad.net/nova/+bug/1361360 | 23:09 |
openstack | Launchpad bug 1361360 in neutron juno "Eventlet green threads not released back to the pool leading to choking of new requests" [Undecided,Fix committed] | 23:09 |
*** catintheroof has quit IRC | 23:09 | |
harlowja | i know klindgren ! | 23:10 |
harlowja | lol | 23:10 |
klindgren | lol - ha Josh has been helping debug this as well | 23:15 |
jlk | so we could set wsgi_keep_alive to false across the services and also "fix" this? | 23:15 |
jlk | and a reasonable timeout | 23:16 |
*** zeih has joined #openstack-operators | 23:20 | |
*** fragatina has joined #openstack-operators | 23:21 | |
*** zeih has quit IRC | 23:26 | |
*** fragatina has quit IRC | 23:28 | |
*** mjrichardson has quit IRC | 23:34 | |
*** mjrichardson has joined #openstack-operators | 23:34 | |
*** ducttape_ has joined #openstack-operators | 23:39 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!