*** Hosam_ has quit IRC | 00:00 | |
*** Hosam has joined #openstack-operators | 00:01 | |
*** Hosam has quit IRC | 00:05 | |
*** VW has joined #openstack-operators | 00:05 | |
*** chlong has joined #openstack-operators | 00:12 | |
*** catintheroof has quit IRC | 00:38 | |
*** catintheroof has joined #openstack-operators | 00:39 | |
*** simon-AS5591 has quit IRC | 00:42 | |
*** catintheroof has quit IRC | 00:43 | |
*** VW has quit IRC | 00:50 | |
*** ducttape_ has joined #openstack-operators | 00:55 | |
*** ducttape_ has quit IRC | 00:55 | |
*** ducttape_ has joined #openstack-operators | 00:56 | |
*** VW has joined #openstack-operators | 01:11 | |
*** ducttape_ has quit IRC | 01:12 | |
*** ducttape_ has joined #openstack-operators | 01:14 | |
*** ducttape_ has quit IRC | 01:36 | |
mnaser | <logan->we're doing netboot ramdisk for stateless hypervisors. < that's quite badasss | 01:39 |
---|---|---|
mnaser | we could probably do the same honestly, considering we're using rbd only | 01:39 |
*** VW has quit IRC | 01:49 | |
*** ducttape_ has joined #openstack-operators | 01:50 | |
*** VW has joined #openstack-operators | 01:52 | |
*** Apoorva has quit IRC | 01:57 | |
*** Apoorva has joined #openstack-operators | 02:00 | |
*** Apoorva has quit IRC | 02:05 | |
*** ducttape_ has quit IRC | 02:10 | |
*** chlong has quit IRC | 02:11 | |
*** akanksha__ has quit IRC | 02:22 | |
*** david_c_ has quit IRC | 02:45 | |
*** mriedem has quit IRC | 02:52 | |
*** markvoelker has quit IRC | 03:07 | |
*** ducttape_ has joined #openstack-operators | 03:11 | |
*** VW has quit IRC | 03:15 | |
*** ducttape_ has quit IRC | 03:16 | |
*** harlowja has quit IRC | 03:33 | |
*** Apoorva has joined #openstack-operators | 04:01 | |
*** Apoorva has quit IRC | 04:06 | |
*** sudipto has joined #openstack-operators | 04:10 | |
*** sudipto_ has joined #openstack-operators | 04:10 | |
*** ducttape_ has joined #openstack-operators | 04:12 | |
*** VW has joined #openstack-operators | 04:12 | |
*** ducttape_ has quit IRC | 04:17 | |
*** markvoelker has joined #openstack-operators | 04:21 | |
logan- | mnaser: thanks :D same re: rbd only (for now). i'm looking at building out a locally backed aggregate and its more debatable but still leaning towards stateless os | 04:21 |
*** ducttape_ has joined #openstack-operators | 04:28 | |
*** harlowja has joined #openstack-operators | 04:38 | |
*** VW has quit IRC | 04:40 | |
*** ducttape_ has quit IRC | 04:46 | |
*** fragatin_ has joined #openstack-operators | 04:53 | |
*** fragatina has quit IRC | 04:57 | |
*** fragatin_ has quit IRC | 04:57 | |
*** fragatina has joined #openstack-operators | 05:00 | |
*** fragatina has quit IRC | 05:01 | |
*** Rockyg has quit IRC | 05:25 | |
*** twiggy has joined #openstack-operators | 05:30 | |
*** VW has joined #openstack-operators | 05:33 | |
*** fragatina has joined #openstack-operators | 05:37 | |
*** VW has quit IRC | 05:38 | |
*** simon-AS559 has joined #openstack-operators | 05:43 | |
*** armax has quit IRC | 05:43 | |
*** Apoorva has joined #openstack-operators | 05:43 | |
*** simon-AS5591 has joined #openstack-operators | 05:45 | |
*** ducttape_ has joined #openstack-operators | 05:46 | |
*** simon-AS559 has quit IRC | 05:47 | |
*** ducttape_ has quit IRC | 05:51 | |
*** harlowja has quit IRC | 05:51 | |
*** harlowja has joined #openstack-operators | 05:52 | |
*** negronjl has quit IRC | 05:59 | |
*** negronjl has joined #openstack-operators | 06:01 | |
*** makowals_ has quit IRC | 06:10 | |
*** Apoorva has quit IRC | 06:18 | |
*** udesale has joined #openstack-operators | 06:59 | |
*** tesseract has joined #openstack-operators | 07:03 | |
*** tesseract is now known as Guest7605 | 07:03 | |
*** rcernin has joined #openstack-operators | 07:11 | |
*** belmoreira has joined #openstack-operators | 07:12 | |
*** Miouge has joined #openstack-operators | 07:14 | |
*** simon-AS5591 has quit IRC | 07:19 | |
*** VW has joined #openstack-operators | 07:35 | |
*** makowals has joined #openstack-operators | 07:35 | |
*** VW has quit IRC | 07:40 | |
*** simon-AS559 has joined #openstack-operators | 07:40 | |
*** ducttape_ has joined #openstack-operators | 07:48 | |
*** ducttape_ has quit IRC | 07:53 | |
*** harlowja has quit IRC | 08:03 | |
*** Miouge has quit IRC | 08:42 | |
*** ducttape_ has joined #openstack-operators | 08:49 | |
*** Miouge has joined #openstack-operators | 08:54 | |
*** ducttape_ has quit IRC | 08:54 | |
*** Miouge has quit IRC | 08:55 | |
*** paramite has joined #openstack-operators | 08:56 | |
*** Miouge has joined #openstack-operators | 09:17 | |
*** derekh has joined #openstack-operators | 09:25 | |
*** derekh has quit IRC | 09:29 | |
*** VW has joined #openstack-operators | 09:38 | |
*** VW has quit IRC | 09:43 | |
*** derekh has joined #openstack-operators | 09:47 | |
*** openstackgerrit has quit IRC | 09:48 | |
*** openstackgerrit has joined #openstack-operators | 09:49 | |
*** electrofelix has joined #openstack-operators | 10:01 | |
*** VW has joined #openstack-operators | 10:40 | |
*** simon-AS559 has quit IRC | 10:42 | |
*** VW has quit IRC | 10:46 | |
*** d0ugal has quit IRC | 11:07 | |
*** matrohon has joined #openstack-operators | 11:38 | |
*** chaology has quit IRC | 11:56 | |
*** chaology has joined #openstack-operators | 11:56 | |
*** chaology has quit IRC | 11:58 | |
*** matrohon has quit IRC | 11:59 | |
*** chaology has joined #openstack-operators | 11:59 | |
*** haplo37 has quit IRC | 12:05 | |
*** maticue has joined #openstack-operators | 12:07 | |
peterjenkins_ | anyone using Ceph cache tiering? | 12:12 |
*** haplo37 has joined #openstack-operators | 12:15 | |
*** catintheroof has joined #openstack-operators | 12:27 | |
*** catintheroof has quit IRC | 12:31 | |
*** catintheroof has joined #openstack-operators | 12:40 | |
*** markvoelker has quit IRC | 12:44 | |
*** mjrichardson has quit IRC | 12:57 | |
*** mjrichardson has joined #openstack-operators | 12:58 | |
*** ducttape_ has joined #openstack-operators | 13:08 | |
*** simon-AS559 has joined #openstack-operators | 13:15 | |
*** VW has joined #openstack-operators | 13:16 | |
*** Hosam has joined #openstack-operators | 13:18 | |
*** VW has quit IRC | 13:21 | |
*** VW has joined #openstack-operators | 13:28 | |
*** VW has quit IRC | 13:30 | |
*** Hosam has quit IRC | 13:32 | |
*** Hosam has joined #openstack-operators | 13:32 | |
*** markvoelker has joined #openstack-operators | 13:35 | |
*** Hosam has quit IRC | 13:36 | |
*** ducttape_ has quit IRC | 13:40 | |
*** catinthe_ has joined #openstack-operators | 14:05 | |
*** mriedem has joined #openstack-operators | 14:07 | |
*** catintheroof has quit IRC | 14:08 | |
*** Miouge has quit IRC | 14:09 | |
dmsimard | peterjenkins_: there was a discussion about it fairly recently: http://eavesdrop.openstack.org/irclogs/%23openstack-operators/%23openstack-operators.2016-11-03.log.html#t2016-11-03T11:52:44 | 14:12 |
peterjenkins_ | Thanks! Very helpful | 14:17 |
*** VW has joined #openstack-operators | 14:33 | |
*** ducttape_ has joined #openstack-operators | 14:36 | |
*** dansmith is now known as superdan | 14:37 | |
*** VW has quit IRC | 14:37 | |
*** d0ugal has joined #openstack-operators | 14:40 | |
*** ducttape_ has quit IRC | 14:40 | |
*** udesale has quit IRC | 14:46 | |
*** ducttape_ has joined #openstack-operators | 15:07 | |
*** AlexeyAbashkin has quit IRC | 15:11 | |
*** Miouge has joined #openstack-operators | 15:22 | |
*** mriedem1 has joined #openstack-operators | 15:26 | |
*** twiggy has quit IRC | 15:26 | |
*** liverpooler has joined #openstack-operators | 15:27 | |
*** mriedem has quit IRC | 15:27 | |
*** mriedem1 is now known as mriedem | 15:30 | |
*** marst has quit IRC | 15:38 | |
*** liverpooler has quit IRC | 15:40 | |
*** mriedem has quit IRC | 15:41 | |
*** mriedem has joined #openstack-operators | 15:45 | |
*** fragatina has quit IRC | 15:45 | |
openstackgerrit | Merged openstack/osops-tools-contrib: Lint the lampstack wordpress role https://review.openstack.org/394047 | 15:46 |
*** fragatina has joined #openstack-operators | 15:46 | |
*** marst has joined #openstack-operators | 15:47 | |
*** uxdanielle has joined #openstack-operators | 15:50 | |
*** rcernin has quit IRC | 16:05 | |
*** Oku_OS is now known as Oku_OS-away | 16:06 | |
*** marst has quit IRC | 16:06 | |
*** marst has joined #openstack-operators | 16:06 | |
*** Miouge has quit IRC | 16:08 | |
*** VW has joined #openstack-operators | 16:11 | |
*** paramite has quit IRC | 16:13 | |
*** makowals has quit IRC | 16:14 | |
*** makowals has joined #openstack-operators | 16:15 | |
*** fragatina has quit IRC | 16:16 | |
*** armax has joined #openstack-operators | 16:23 | |
*** mriedem1 has joined #openstack-operators | 16:26 | |
*** mriedem1 has quit IRC | 16:26 | |
*** mriedem1 has joined #openstack-operators | 16:27 | |
*** mriedem1 is now known as mriedem_afk | 16:27 | |
*** mriedem has quit IRC | 16:28 | |
*** haplo37 has quit IRC | 16:31 | |
*** haplo37 has joined #openstack-operators | 16:32 | |
*** david_c_ has joined #openstack-operators | 16:34 | |
*** piet has joined #openstack-operators | 16:42 | |
*** Guest7605 has quit IRC | 16:43 | |
*** armax has quit IRC | 16:49 | |
*** belmoreira has quit IRC | 16:50 | |
*** armax has joined #openstack-operators | 16:51 | |
*** david-lyle_ has joined #openstack-operators | 16:56 | |
*** david-lyle has quit IRC | 16:58 | |
*** Miouge has joined #openstack-operators | 17:00 | |
*** david-lyle_ has quit IRC | 17:01 | |
*** Miouge has quit IRC | 17:05 | |
*** Miouge has joined #openstack-operators | 17:06 | |
*** Miouge has quit IRC | 17:09 | |
*** dbecker has quit IRC | 17:12 | |
*** Apoorva has joined #openstack-operators | 17:22 | |
*** uxdanielle has quit IRC | 17:24 | |
*** Miouge has joined #openstack-operators | 17:28 | |
*** Miouge has quit IRC | 17:38 | |
*** derekh has quit IRC | 17:42 | |
*** sudipto has quit IRC | 17:51 | |
*** sudipto_ has quit IRC | 17:51 | |
mnaser | "Kernel panic - not syncing: Watchdog detected hard LOCKUP on cpu N" type of friday | 17:51 |
*** chaology has quit IRC | 17:55 | |
*** d0ugal has quit IRC | 17:57 | |
*** chaology has joined #openstack-operators | 17:58 | |
*** chaology has quit IRC | 17:58 | |
*** david-lyle has joined #openstack-operators | 17:58 | |
*** david-lyle has quit IRC | 18:03 | |
*** mriedem_afk is now known as mriedem | 18:03 | |
*** Miouge has joined #openstack-operators | 18:06 | |
*** chaology has joined #openstack-operators | 18:07 | |
*** fragatina has joined #openstack-operators | 18:10 | |
*** makowals has quit IRC | 18:10 | |
*** rcernin has joined #openstack-operators | 18:10 | |
*** d0ugal has joined #openstack-operators | 18:12 | |
*** rcernin has quit IRC | 18:12 | |
*** VW has quit IRC | 18:13 | |
*** makowals has joined #openstack-operators | 18:13 | |
*** piet has quit IRC | 18:16 | |
*** makowals has quit IRC | 18:18 | |
*** VW has joined #openstack-operators | 18:22 | |
*** simon-AS559 has quit IRC | 18:25 | |
*** VW has quit IRC | 18:26 | |
*** fragatina has quit IRC | 18:27 | |
*** fragatina has joined #openstack-operators | 18:28 | |
*** electrofelix has quit IRC | 18:30 | |
*** Miouge has quit IRC | 18:32 | |
*** david-lyle has joined #openstack-operators | 18:36 | |
*** VW has joined #openstack-operators | 18:49 | |
*** piet has joined #openstack-operators | 18:50 | |
*** VW has quit IRC | 18:54 | |
*** harlowja has joined #openstack-operators | 18:55 | |
*** catinthe_ has quit IRC | 18:56 | |
mnaser | has anyone ever had a vm crash an entire compute node (kvm)? | 18:56 |
mnaser | (consistently) | 18:56 |
mnaser | it's a windows 2008 r2 vm | 18:56 |
klindgren__ | consistently no | 18:57 |
klindgren__ | HV's crash - yes | 18:57 |
mnaser | klindgren__: we had a compute node crash, it rebooted and we found this in the logs - Kernel panic - not syncing: Watchdog detected hard LOCKUP on cpu 6 | 18:57 |
mnaser | a few hours later in the day, it happened again. we evacuated the compute node, a bit later another compute node crashes | 18:57 |
mnaser | by luck i saw that the state of one of the VMs was "REBOOT", so i suspected it being the issue. when the compute node came back, that VM started up again, stopping it resulted in the HV crashing agian | 18:58 |
*** Miouge has joined #openstack-operators | 18:58 | |
mnaser | we've locked out the vm to avoid making a bigger mess (nova lock <..>) but i am unsure where to go next :-( | 18:58 |
*** uxdanielle has joined #openstack-operators | 18:58 | |
*** VW has joined #openstack-operators | 19:00 | |
klindgren__ | so one thing in the past - unsure what CPU's you are dealing with | 19:00 |
klindgren__ | but cstates would cause some system stability issues | 19:01 |
mnaser | hmm | 19:02 |
klindgren__ | where their were specific issues on nahelem cpu's that wouldn't correctly wake up from the lower cstates | 19:02 |
klindgren__ | https://support.citrix.com/article/CTX127395 | 19:02 |
*** d0ugal has quit IRC | 19:02 | |
mnaser | i remember this mess back in the xenserver days :p | 19:03 |
mnaser | (we started off with xenserver and moved to kvm) | 19:03 |
klindgren__ | pretty sure it impacts both equally | 19:03 |
klindgren__ | IE its a problem with the cpu - not the HV/OS. | 19:03 |
*** klindgren__ is now known as klindgren | 19:03 | |
klindgren | thats the only thing I can think of. If you pay for support from your distro provider - you might be able to open a ticket with them on what causing the crash | 19:04 |
klindgren | especially sicne you can esily repo it | 19:04 |
klindgren | since* easily* | 19:04 |
mnaser | klindgren: i have vmcore-dmesg and vmcore files which could probably help but we use centos | 19:05 |
*** pcaruana has quit IRC | 19:07 | |
*** kstev has quit IRC | 19:12 | |
*** jamesdenton has joined #openstack-operators | 19:14 | |
*** uxdanielle has quit IRC | 19:24 | |
*** catintheroof has joined #openstack-operators | 19:25 | |
*** uxdanielle has joined #openstack-operators | 19:26 | |
*** catintheroof has quit IRC | 19:27 | |
*** Miouge has quit IRC | 19:27 | |
*** catintheroof has joined #openstack-operators | 19:29 | |
*** makowals has joined #openstack-operators | 19:33 | |
*** simon-AS559 has joined #openstack-operators | 19:34 | |
*** simon-AS5591 has joined #openstack-operators | 19:36 | |
*** ckonstanski has joined #openstack-operators | 19:38 | |
*** simon-AS559 has quit IRC | 19:39 | |
*** catintheroof has quit IRC | 19:42 | |
*** chaology has quit IRC | 19:52 | |
*** chaology has joined #openstack-operators | 19:52 | |
*** chaology has quit IRC | 19:53 | |
*** chaology has joined #openstack-operators | 19:54 | |
*** catintheroof has joined #openstack-operators | 19:55 | |
*** catintheroof has quit IRC | 19:59 | |
*** chaology has quit IRC | 20:00 | |
*** chaology has joined #openstack-operators | 20:09 | |
*** Hosam has joined #openstack-operators | 20:23 | |
*** portante has quit IRC | 20:26 | |
*** portante has joined #openstack-operators | 20:31 | |
*** catintheroof has joined #openstack-operators | 20:45 | |
*** portante has quit IRC | 20:46 | |
*** portante has joined #openstack-operators | 20:51 | |
*** portante has quit IRC | 20:55 | |
*** Apoorva has quit IRC | 20:58 | |
*** haplo37 has quit IRC | 20:58 | |
*** maticue has quit IRC | 21:03 | |
*** haplo37 has joined #openstack-operators | 21:07 | |
*** ducttape_ has quit IRC | 21:09 | |
*** makowals has quit IRC | 21:16 | |
*** makowals has joined #openstack-operators | 21:17 | |
*** portante has joined #openstack-operators | 21:20 | |
*** makowals has quit IRC | 21:21 | |
*** uxdanielle has quit IRC | 21:24 | |
*** harlowja has quit IRC | 21:32 | |
*** catinthe_ has joined #openstack-operators | 21:34 | |
*** catintheroof has quit IRC | 21:34 | |
*** uxdanielle has joined #openstack-operators | 21:38 | |
*** portante has quit IRC | 21:43 | |
*** ducttape_ has joined #openstack-operators | 21:44 | |
*** portante has joined #openstack-operators | 21:48 | |
*** Apoorva has joined #openstack-operators | 21:52 | |
*** piet has quit IRC | 22:03 | |
*** VW has quit IRC | 22:12 | |
*** VW has joined #openstack-operators | 22:12 | |
*** VW has quit IRC | 22:16 | |
*** portante has quit IRC | 22:18 | |
*** portante has joined #openstack-operators | 22:19 | |
*** mriedem has quit IRC | 22:27 | |
*** simon-AS5591 has quit IRC | 22:27 | |
*** jamesdenton has quit IRC | 22:28 | |
*** VW has joined #openstack-operators | 22:36 | |
*** VW has quit IRC | 22:40 | |
*** portante has quit IRC | 22:44 | |
*** portante has joined #openstack-operators | 22:45 | |
*** ckonstanski has quit IRC | 22:56 | |
*** harlowja has joined #openstack-operators | 23:01 | |
*** VW has joined #openstack-operators | 23:03 | |
*** VW has quit IRC | 23:08 | |
*** ducttape_ has quit IRC | 23:24 | |
*** uxdanielle has quit IRC | 23:25 | |
*** ckonstanski has joined #openstack-operators | 23:26 | |
*** VW has joined #openstack-operators | 23:30 | |
*** VW has quit IRC | 23:34 | |
*** VW has joined #openstack-operators | 23:37 | |
*** VW_ has joined #openstack-operators | 23:39 | |
*** marst has quit IRC | 23:40 | |
*** VW has quit IRC | 23:42 | |
*** VW_ has quit IRC | 23:44 | |
*** ducttape_ has joined #openstack-operators | 23:46 | |
*** ducttape_ has quit IRC | 23:47 | |
*** ducttape_ has joined #openstack-operators | 23:47 | |
*** marst has joined #openstack-operators | 23:50 | |
*** Hosam has quit IRC | 23:53 | |
*** Hosam has joined #openstack-operators | 23:54 | |
*** ducttape_ has quit IRC | 23:57 | |
*** catinthe_ has quit IRC | 23:58 | |
*** Hosam has quit IRC | 23:58 |
Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!