Friday, 2016-11-11

*** Hosam_ has quit IRC00:00
*** Hosam has joined #openstack-operators00:01
*** Hosam has quit IRC00:05
*** VW has joined #openstack-operators00:05
*** chlong has joined #openstack-operators00:12
*** catintheroof has quit IRC00:38
*** catintheroof has joined #openstack-operators00:39
*** simon-AS5591 has quit IRC00:42
*** catintheroof has quit IRC00:43
*** VW has quit IRC00:50
*** ducttape_ has joined #openstack-operators00:55
*** ducttape_ has quit IRC00:55
*** ducttape_ has joined #openstack-operators00:56
*** VW has joined #openstack-operators01:11
*** ducttape_ has quit IRC01:12
*** ducttape_ has joined #openstack-operators01:14
*** ducttape_ has quit IRC01:36
mnaser<logan->we're doing netboot ramdisk for stateless hypervisors. < that's quite badasss01:39
mnaserwe could probably do the same honestly, considering we're using rbd only01:39
*** VW has quit IRC01:49
*** ducttape_ has joined #openstack-operators01:50
*** VW has joined #openstack-operators01:52
*** Apoorva has quit IRC01:57
*** Apoorva has joined #openstack-operators02:00
*** Apoorva has quit IRC02:05
*** ducttape_ has quit IRC02:10
*** chlong has quit IRC02:11
*** akanksha__ has quit IRC02:22
*** david_c_ has quit IRC02:45
*** mriedem has quit IRC02:52
*** markvoelker has quit IRC03:07
*** ducttape_ has joined #openstack-operators03:11
*** VW has quit IRC03:15
*** ducttape_ has quit IRC03:16
*** harlowja has quit IRC03:33
*** Apoorva has joined #openstack-operators04:01
*** Apoorva has quit IRC04:06
*** sudipto has joined #openstack-operators04:10
*** sudipto_ has joined #openstack-operators04:10
*** ducttape_ has joined #openstack-operators04:12
*** VW has joined #openstack-operators04:12
*** ducttape_ has quit IRC04:17
*** markvoelker has joined #openstack-operators04:21
logan-mnaser: thanks :D same re: rbd only (for now). i'm looking at building out a locally backed aggregate and its more debatable but still leaning towards stateless os04:21
*** ducttape_ has joined #openstack-operators04:28
*** harlowja has joined #openstack-operators04:38
*** VW has quit IRC04:40
*** ducttape_ has quit IRC04:46
*** fragatin_ has joined #openstack-operators04:53
*** fragatina has quit IRC04:57
*** fragatin_ has quit IRC04:57
*** fragatina has joined #openstack-operators05:00
*** fragatina has quit IRC05:01
*** Rockyg has quit IRC05:25
*** twiggy has joined #openstack-operators05:30
*** VW has joined #openstack-operators05:33
*** fragatina has joined #openstack-operators05:37
*** VW has quit IRC05:38
*** simon-AS559 has joined #openstack-operators05:43
*** armax has quit IRC05:43
*** Apoorva has joined #openstack-operators05:43
*** simon-AS5591 has joined #openstack-operators05:45
*** ducttape_ has joined #openstack-operators05:46
*** simon-AS559 has quit IRC05:47
*** ducttape_ has quit IRC05:51
*** harlowja has quit IRC05:51
*** harlowja has joined #openstack-operators05:52
*** negronjl has quit IRC05:59
*** negronjl has joined #openstack-operators06:01
*** makowals_ has quit IRC06:10
*** Apoorva has quit IRC06:18
*** udesale has joined #openstack-operators06:59
*** tesseract has joined #openstack-operators07:03
*** tesseract is now known as Guest760507:03
*** rcernin has joined #openstack-operators07:11
*** belmoreira has joined #openstack-operators07:12
*** Miouge has joined #openstack-operators07:14
*** simon-AS5591 has quit IRC07:19
*** VW has joined #openstack-operators07:35
*** makowals has joined #openstack-operators07:35
*** VW has quit IRC07:40
*** simon-AS559 has joined #openstack-operators07:40
*** ducttape_ has joined #openstack-operators07:48
*** ducttape_ has quit IRC07:53
*** harlowja has quit IRC08:03
*** Miouge has quit IRC08:42
*** ducttape_ has joined #openstack-operators08:49
*** Miouge has joined #openstack-operators08:54
*** ducttape_ has quit IRC08:54
*** Miouge has quit IRC08:55
*** paramite has joined #openstack-operators08:56
*** Miouge has joined #openstack-operators09:17
*** derekh has joined #openstack-operators09:25
*** derekh has quit IRC09:29
*** VW has joined #openstack-operators09:38
*** VW has quit IRC09:43
*** derekh has joined #openstack-operators09:47
*** openstackgerrit has quit IRC09:48
*** openstackgerrit has joined #openstack-operators09:49
*** electrofelix has joined #openstack-operators10:01
*** VW has joined #openstack-operators10:40
*** simon-AS559 has quit IRC10:42
*** VW has quit IRC10:46
*** d0ugal has quit IRC11:07
*** matrohon has joined #openstack-operators11:38
*** chaology has quit IRC11:56
*** chaology has joined #openstack-operators11:56
*** chaology has quit IRC11:58
*** matrohon has quit IRC11:59
*** chaology has joined #openstack-operators11:59
*** haplo37 has quit IRC12:05
*** maticue has joined #openstack-operators12:07
peterjenkins_anyone using Ceph cache tiering?12:12
*** haplo37 has joined #openstack-operators12:15
*** catintheroof has joined #openstack-operators12:27
*** catintheroof has quit IRC12:31
*** catintheroof has joined #openstack-operators12:40
*** markvoelker has quit IRC12:44
*** mjrichardson has quit IRC12:57
*** mjrichardson has joined #openstack-operators12:58
*** ducttape_ has joined #openstack-operators13:08
*** simon-AS559 has joined #openstack-operators13:15
*** VW has joined #openstack-operators13:16
*** Hosam has joined #openstack-operators13:18
*** VW has quit IRC13:21
*** VW has joined #openstack-operators13:28
*** VW has quit IRC13:30
*** Hosam has quit IRC13:32
*** Hosam has joined #openstack-operators13:32
*** markvoelker has joined #openstack-operators13:35
*** Hosam has quit IRC13:36
*** ducttape_ has quit IRC13:40
*** catinthe_ has joined #openstack-operators14:05
*** mriedem has joined #openstack-operators14:07
*** catintheroof has quit IRC14:08
*** Miouge has quit IRC14:09
dmsimardpeterjenkins_: there was a discussion about it fairly recently: http://eavesdrop.openstack.org/irclogs/%23openstack-operators/%23openstack-operators.2016-11-03.log.html#t2016-11-03T11:52:4414:12
peterjenkins_Thanks! Very helpful14:17
*** VW has joined #openstack-operators14:33
*** ducttape_ has joined #openstack-operators14:36
*** dansmith is now known as superdan14:37
*** VW has quit IRC14:37
*** d0ugal has joined #openstack-operators14:40
*** ducttape_ has quit IRC14:40
*** udesale has quit IRC14:46
*** ducttape_ has joined #openstack-operators15:07
*** AlexeyAbashkin has quit IRC15:11
*** Miouge has joined #openstack-operators15:22
*** mriedem1 has joined #openstack-operators15:26
*** twiggy has quit IRC15:26
*** liverpooler has joined #openstack-operators15:27
*** mriedem has quit IRC15:27
*** mriedem1 is now known as mriedem15:30
*** marst has quit IRC15:38
*** liverpooler has quit IRC15:40
*** mriedem has quit IRC15:41
*** mriedem has joined #openstack-operators15:45
*** fragatina has quit IRC15:45
openstackgerritMerged openstack/osops-tools-contrib: Lint the lampstack wordpress role  https://review.openstack.org/39404715:46
*** fragatina has joined #openstack-operators15:46
*** marst has joined #openstack-operators15:47
*** uxdanielle has joined #openstack-operators15:50
*** rcernin has quit IRC16:05
*** Oku_OS is now known as Oku_OS-away16:06
*** marst has quit IRC16:06
*** marst has joined #openstack-operators16:06
*** Miouge has quit IRC16:08
*** VW has joined #openstack-operators16:11
*** paramite has quit IRC16:13
*** makowals has quit IRC16:14
*** makowals has joined #openstack-operators16:15
*** fragatina has quit IRC16:16
*** armax has joined #openstack-operators16:23
*** mriedem1 has joined #openstack-operators16:26
*** mriedem1 has quit IRC16:26
*** mriedem1 has joined #openstack-operators16:27
*** mriedem1 is now known as mriedem_afk16:27
*** mriedem has quit IRC16:28
*** haplo37 has quit IRC16:31
*** haplo37 has joined #openstack-operators16:32
*** david_c_ has joined #openstack-operators16:34
*** piet has joined #openstack-operators16:42
*** Guest7605 has quit IRC16:43
*** armax has quit IRC16:49
*** belmoreira has quit IRC16:50
*** armax has joined #openstack-operators16:51
*** david-lyle_ has joined #openstack-operators16:56
*** david-lyle has quit IRC16:58
*** Miouge has joined #openstack-operators17:00
*** david-lyle_ has quit IRC17:01
*** Miouge has quit IRC17:05
*** Miouge has joined #openstack-operators17:06
*** Miouge has quit IRC17:09
*** dbecker has quit IRC17:12
*** Apoorva has joined #openstack-operators17:22
*** uxdanielle has quit IRC17:24
*** Miouge has joined #openstack-operators17:28
*** Miouge has quit IRC17:38
*** derekh has quit IRC17:42
*** sudipto has quit IRC17:51
*** sudipto_ has quit IRC17:51
mnaser"Kernel panic - not syncing: Watchdog detected hard LOCKUP on cpu N" type of friday17:51
*** chaology has quit IRC17:55
*** d0ugal has quit IRC17:57
*** chaology has joined #openstack-operators17:58
*** chaology has quit IRC17:58
*** david-lyle has joined #openstack-operators17:58
*** david-lyle has quit IRC18:03
*** mriedem_afk is now known as mriedem18:03
*** Miouge has joined #openstack-operators18:06
*** chaology has joined #openstack-operators18:07
*** fragatina has joined #openstack-operators18:10
*** makowals has quit IRC18:10
*** rcernin has joined #openstack-operators18:10
*** d0ugal has joined #openstack-operators18:12
*** rcernin has quit IRC18:12
*** VW has quit IRC18:13
*** makowals has joined #openstack-operators18:13
*** piet has quit IRC18:16
*** makowals has quit IRC18:18
*** VW has joined #openstack-operators18:22
*** simon-AS559 has quit IRC18:25
*** VW has quit IRC18:26
*** fragatina has quit IRC18:27
*** fragatina has joined #openstack-operators18:28
*** electrofelix has quit IRC18:30
*** Miouge has quit IRC18:32
*** david-lyle has joined #openstack-operators18:36
*** VW has joined #openstack-operators18:49
*** piet has joined #openstack-operators18:50
*** VW has quit IRC18:54
*** harlowja has joined #openstack-operators18:55
*** catinthe_ has quit IRC18:56
mnaserhas anyone ever had a vm crash an entire compute node (kvm)?18:56
mnaser(consistently)18:56
mnaserit's a windows 2008 r2 vm18:56
klindgren__consistently no18:57
klindgren__HV's crash - yes18:57
mnaserklindgren__: we had a compute node crash, it rebooted and we found this in the logs - Kernel panic - not syncing: Watchdog detected hard LOCKUP on cpu 618:57
mnasera few hours later in the day, it happened again.  we evacuated the compute node, a bit later another compute node crashes18:57
mnaserby luck i saw that the state of one of the VMs was "REBOOT", so i suspected it being the issue.  when the compute node came back, that VM started up again, stopping it resulted in the HV crashing agian18:58
*** Miouge has joined #openstack-operators18:58
mnaserwe've locked out the vm to avoid making a bigger mess (nova lock <..>) but i am unsure where to go next :-(18:58
*** uxdanielle has joined #openstack-operators18:58
*** VW has joined #openstack-operators19:00
klindgren__so one thing in the past - unsure what CPU's you are dealing with19:00
klindgren__but cstates would cause some system stability issues19:01
mnaserhmm19:02
klindgren__where their were specific issues on nahelem cpu's that wouldn't correctly wake up from the lower cstates19:02
klindgren__https://support.citrix.com/article/CTX12739519:02
*** d0ugal has quit IRC19:02
mnaseri remember this mess back in the xenserver days :p19:03
mnaser(we started off with xenserver and moved to kvm)19:03
klindgren__pretty sure it impacts both equally19:03
klindgren__IE its a problem with the cpu - not the HV/OS.19:03
*** klindgren__ is now known as klindgren19:03
klindgrenthats the only thing I can think of.  If you pay for support from your distro provider - you might be able to open a ticket with them on what causing the crash19:04
klindgrenespecially sicne you can esily repo it19:04
klindgrensince* easily*19:04
mnaserklindgren: i have vmcore-dmesg and vmcore files which could probably help but we use centos19:05
*** pcaruana has quit IRC19:07
*** kstev has quit IRC19:12
*** jamesdenton has joined #openstack-operators19:14
*** uxdanielle has quit IRC19:24
*** catintheroof has joined #openstack-operators19:25
*** uxdanielle has joined #openstack-operators19:26
*** catintheroof has quit IRC19:27
*** Miouge has quit IRC19:27
*** catintheroof has joined #openstack-operators19:29
*** makowals has joined #openstack-operators19:33
*** simon-AS559 has joined #openstack-operators19:34
*** simon-AS5591 has joined #openstack-operators19:36
*** ckonstanski has joined #openstack-operators19:38
*** simon-AS559 has quit IRC19:39
*** catintheroof has quit IRC19:42
*** chaology has quit IRC19:52
*** chaology has joined #openstack-operators19:52
*** chaology has quit IRC19:53
*** chaology has joined #openstack-operators19:54
*** catintheroof has joined #openstack-operators19:55
*** catintheroof has quit IRC19:59
*** chaology has quit IRC20:00
*** chaology has joined #openstack-operators20:09
*** Hosam has joined #openstack-operators20:23
*** portante has quit IRC20:26
*** portante has joined #openstack-operators20:31
*** catintheroof has joined #openstack-operators20:45
*** portante has quit IRC20:46
*** portante has joined #openstack-operators20:51
*** portante has quit IRC20:55
*** Apoorva has quit IRC20:58
*** haplo37 has quit IRC20:58
*** maticue has quit IRC21:03
*** haplo37 has joined #openstack-operators21:07
*** ducttape_ has quit IRC21:09
*** makowals has quit IRC21:16
*** makowals has joined #openstack-operators21:17
*** portante has joined #openstack-operators21:20
*** makowals has quit IRC21:21
*** uxdanielle has quit IRC21:24
*** harlowja has quit IRC21:32
*** catinthe_ has joined #openstack-operators21:34
*** catintheroof has quit IRC21:34
*** uxdanielle has joined #openstack-operators21:38
*** portante has quit IRC21:43
*** ducttape_ has joined #openstack-operators21:44
*** portante has joined #openstack-operators21:48
*** Apoorva has joined #openstack-operators21:52
*** piet has quit IRC22:03
*** VW has quit IRC22:12
*** VW has joined #openstack-operators22:12
*** VW has quit IRC22:16
*** portante has quit IRC22:18
*** portante has joined #openstack-operators22:19
*** mriedem has quit IRC22:27
*** simon-AS5591 has quit IRC22:27
*** jamesdenton has quit IRC22:28
*** VW has joined #openstack-operators22:36
*** VW has quit IRC22:40
*** portante has quit IRC22:44
*** portante has joined #openstack-operators22:45
*** ckonstanski has quit IRC22:56
*** harlowja has joined #openstack-operators23:01
*** VW has joined #openstack-operators23:03
*** VW has quit IRC23:08
*** ducttape_ has quit IRC23:24
*** uxdanielle has quit IRC23:25
*** ckonstanski has joined #openstack-operators23:26
*** VW has joined #openstack-operators23:30
*** VW has quit IRC23:34
*** VW has joined #openstack-operators23:37
*** VW_ has joined #openstack-operators23:39
*** marst has quit IRC23:40
*** VW has quit IRC23:42
*** VW_ has quit IRC23:44
*** ducttape_ has joined #openstack-operators23:46
*** ducttape_ has quit IRC23:47
*** ducttape_ has joined #openstack-operators23:47
*** marst has joined #openstack-operators23:50
*** Hosam has quit IRC23:53
*** Hosam has joined #openstack-operators23:54
*** ducttape_ has quit IRC23:57
*** catinthe_ has quit IRC23:58
*** Hosam has quit IRC23:58

Generated by irclog2html.py 2.14.0 by Marius Gedminas - find it at mg.pov.lt!