*** AlexeyAbashkin has quit IRC | 00:02 | |
*** DuncanT has joined #openstack-ha | 00:11 | |
*** Dinesh_Bhor has joined #openstack-ha | 00:35 | |
*** jmlowe_ has joined #openstack-ha | 00:53 | |
*** jmlowe has quit IRC | 00:55 | |
*** jmlowe_ has quit IRC | 00:59 | |
*** yangyapeng has joined #openstack-ha | 01:10 | |
*** masahito has joined #openstack-ha | 01:29 | |
*** zzhou_tb1 has joined #openstack-ha | 01:52 | |
*** zzhou_tb has quit IRC | 01:53 | |
*** zzhou_tb1 is now known as zzhou_tb | 01:53 | |
*** zzhou_ has quit IRC | 01:54 | |
*** ekcs has quit IRC | 02:16 | |
*** zzhou_tb has quit IRC | 02:36 | |
*** zzhou_tb has joined #openstack-ha | 02:36 | |
*** masahito has quit IRC | 03:06 | |
*** zzhou_ has joined #openstack-ha | 04:04 | |
*** markvoelker_ has joined #openstack-ha | 04:12 | |
*** markvoelker has quit IRC | 04:12 | |
*** kgaillot has quit IRC | 04:57 | |
*** Dinesh_Bhor has quit IRC | 04:58 | |
*** radeks has joined #openstack-ha | 06:03 | |
*** zzhou_tb1 has joined #openstack-ha | 06:30 | |
*** zzhou_ has quit IRC | 06:31 | |
*** zzhou_tb has quit IRC | 06:32 | |
*** zzhou_tb1 is now known as zzhou_tb | 06:32 | |
*** Dinesh_Bhor has joined #openstack-ha | 06:46 | |
*** Dinesh_Bhor has quit IRC | 07:13 | |
*** jpena|off is now known as jpena | 07:39 | |
*** AlexeyAbashkin has joined #openstack-ha | 07:53 | |
*** zzhou_tb has quit IRC | 07:57 | |
*** zzhou_tb has joined #openstack-ha | 07:57 | |
*** hoonetorg has quit IRC | 08:06 | |
*** hoonetorg has joined #openstack-ha | 08:19 | |
*** zzhou_ has joined #openstack-ha | 08:39 | |
-openstackstatus- NOTICE: Our CI system Zuul is currently not accessible. Wait with approving changes and rechecks until it's back online. Currently waiting for an admin to investigate. | 08:47 | |
*** linkmark has joined #openstack-ha | 08:51 | |
*** rossella_s has joined #openstack-ha | 08:52 | |
*** rossella_s has quit IRC | 08:58 | |
*** zzhou_tb1 has joined #openstack-ha | 09:02 | |
*** rossella_s has joined #openstack-ha | 09:02 | |
*** zzhou_ has quit IRC | 09:04 | |
*** zzhou_tb has quit IRC | 09:04 | |
*** zzhou_tb1 is now known as zzhou_tb | 09:04 | |
-openstackstatus- NOTICE: Zuul is back online, looks like a temporary network problem. | 09:08 | |
*** jappleii__ has quit IRC | 09:10 | |
*** rossella_s has quit IRC | 09:35 | |
*** rossella_s has joined #openstack-ha | 09:38 | |
*** ushkalim has joined #openstack-ha | 09:51 | |
*** zzhou_tb has quit IRC | 10:09 | |
*** zzhou_tb has joined #openstack-ha | 10:09 | |
*** rpittau has joined #openstack-ha | 10:26 | |
*** rossella_s has quit IRC | 10:54 | |
*** rossella_s has joined #openstack-ha | 10:54 | |
*** sticker has joined #openstack-ha | 10:59 | |
*** rossella_s has quit IRC | 11:03 | |
*** rossella_s has joined #openstack-ha | 11:06 | |
*** zzhou_ has joined #openstack-ha | 11:14 | |
*** AlexeyAbashkin has quit IRC | 11:15 | |
*** AlexeyAbashkin has joined #openstack-ha | 11:40 | |
*** aasmith has quit IRC | 11:53 | |
*** ethfci has quit IRC | 12:07 | |
*** yangyapeng has quit IRC | 12:08 | |
*** yangyapeng has joined #openstack-ha | 12:09 | |
*** cleong has joined #openstack-ha | 12:09 | |
*** yangyapeng has quit IRC | 12:13 | |
*** ethfci has joined #openstack-ha | 12:18 | |
*** aasmith has joined #openstack-ha | 12:20 | |
*** ethfci has quit IRC | 12:21 | |
*** jpena is now known as jpena|lunch | 12:32 | |
*** sticker has quit IRC | 12:34 | |
NostawRm | got a thought that I don't know if its plausible or if its just a bad idea. When killing a node to ensure its down, I know the primary option is to shut it down via IPMI, but is there anything blatantly wrong/bad with just killing the dedicated storage network port at the switch? | 12:40 |
---|---|---|
NostawRm | I don't see the downsides to this, especially if I can find how to make pacemaker do it because then we can very safely trouble shoot the node and know what went wonky | 12:41 |
*** yangyapeng has joined #openstack-ha | 12:44 | |
*** vuntz has quit IRC | 12:47 | |
*** vuntz has joined #openstack-ha | 12:49 | |
*** vuntz has joined #openstack-ha | 12:49 | |
NostawRm | found an argument against it, switchport fencing would be shutdown only, no reboot, so even though we'd see what was on the terminal at lock up, that resource would be down until we got to it | 12:52 |
*** jpena|lunch is now known as jpena | 13:28 | |
aspiers | NostawRm: resource fencing can be as effective as node fencing in some circumstances. It's a well-known technique | 13:56 |
aspiers | depends on what resources the node was managing | 13:56 |
aspiers | s/-known/-established/ | 13:57 |
NostawRm | well, that's where I'm leaning away from it now. At least to start off, our cluster is hyper converged ceph/openstack, so if a node was to hang, then not only is that hypervisor gone, but so is 3-4 OSDs | 13:57 |
NostawRm | think everyone else who would have hands on it would prefer being able to look at the console to see what's up before the node tried to reboot, but getting those OSDs back is going to be a big deal, especially early on | 13:58 |
*** v12aml has quit IRC | 14:25 | |
*** v12aml has joined #openstack-ha | 14:26 | |
-openstackstatus- NOTICE: We're currently seeing an elevated rate of timeouts in jobs and the zuulv3.openstack.org dashboard is intermittently unresponsive, please stand by while we troubleshoot the issues. | 14:38 | |
*** kgaillot has joined #openstack-ha | 15:11 | |
*** jmlowe has joined #openstack-ha | 15:44 | |
*** jmlowe has quit IRC | 15:48 | |
*** jmlowe has joined #openstack-ha | 16:10 | |
*** jmlowe has quit IRC | 16:21 | |
*** AlexeyAbashkin has quit IRC | 16:26 | |
*** yangyapeng has quit IRC | 16:30 | |
*** radeks has quit IRC | 16:32 | |
*** AlexeyAbashkin has joined #openstack-ha | 16:38 | |
*** jmlowe has joined #openstack-ha | 16:39 | |
*** jmlowe has quit IRC | 16:44 | |
*** jpena is now known as jpena|off | 16:44 | |
*** ushkalim has quit IRC | 16:46 | |
*** AlexeyAbashkin has quit IRC | 16:47 | |
*** rossella_s has quit IRC | 17:03 | |
*** rossella_s has joined #openstack-ha | 17:05 | |
*** yangyapeng has joined #openstack-ha | 17:09 | |
*** aspiers has quit IRC | 17:31 | |
*** aspiers has joined #openstack-ha | 17:35 | |
*** yangyapeng has quit IRC | 17:51 | |
*** rossella_s has quit IRC | 18:04 | |
*** rossella_s has joined #openstack-ha | 18:04 | |
*** jmlowe has joined #openstack-ha | 18:12 | |
*** AlexeyAbashkin has joined #openstack-ha | 18:14 | |
*** AlexeyAbashkin has quit IRC | 18:18 | |
*** AlexeyAbashkin has joined #openstack-ha | 18:34 | |
*** ekcs has joined #openstack-ha | 18:36 | |
*** AlexeyAbashkin has quit IRC | 18:38 | |
*** rossella_s has quit IRC | 18:49 | |
*** rossella_s has joined #openstack-ha | 18:51 | |
*** rossella_s has quit IRC | 19:05 | |
*** rossella_s has joined #openstack-ha | 19:07 | |
*** yangyapeng has joined #openstack-ha | 19:14 | |
*** rossella_s has quit IRC | 19:15 | |
*** rossella_s has joined #openstack-ha | 19:16 | |
*** radeks has joined #openstack-ha | 19:24 | |
*** rossella_s has quit IRC | 19:25 | |
*** rossella_s has joined #openstack-ha | 19:29 | |
*** rossella_s has quit IRC | 19:33 | |
*** rossella_s has joined #openstack-ha | 19:35 | |
*** masuberu has joined #openstack-ha | 19:48 | |
*** masber has quit IRC | 19:51 | |
-openstackstatus- NOTICE: The zuul scheduler has been restarted after lengthy troubleshooting for a memory consumption issue; earlier changes have been reenqueued but if you notice jobs not running for a new or approved change you may want to leave a recheck comment or a new approval vote | 20:15 | |
*** vuntz has quit IRC | 20:35 | |
*** aasmith has quit IRC | 20:35 | |
*** wN has quit IRC | 20:35 | |
*** aasmith has joined #openstack-ha | 20:40 | |
*** wN has joined #openstack-ha | 20:42 | |
*** wN has joined #openstack-ha | 20:42 | |
*** vuntz has joined #openstack-ha | 20:44 | |
*** vuntz has joined #openstack-ha | 20:44 | |
*** mancdaz has quit IRC | 20:45 | |
*** mancdaz has joined #openstack-ha | 20:45 | |
*** rossella_s has quit IRC | 21:13 | |
*** rossella_s has joined #openstack-ha | 21:13 | |
*** linkmark has quit IRC | 21:20 | |
*** jappleii__ has joined #openstack-ha | 21:23 | |
*** jappleii__ has quit IRC | 21:24 | |
*** jappleii__ has joined #openstack-ha | 21:25 | |
*** jappleii__ has quit IRC | 21:26 | |
*** radeks has quit IRC | 21:26 | |
*** jappleii__ has joined #openstack-ha | 21:27 | |
*** jappleii__ has quit IRC | 21:27 | |
*** jappleii__ has joined #openstack-ha | 21:28 | |
*** AlexeyAbashkin has joined #openstack-ha | 21:34 | |
*** AlexeyAbashkin has quit IRC | 21:38 | |
*** sticker has joined #openstack-ha | 21:57 | |
*** AlexeyAbashkin has joined #openstack-ha | 21:57 | |
*** rossella_s has quit IRC | 21:58 | |
*** cleong has quit IRC | 21:59 | |
*** AlexeyAbashkin has quit IRC | 22:02 | |
*** rossella_s has joined #openstack-ha | 22:07 | |
*** sticker has quit IRC | 22:10 | |
*** sticker has joined #openstack-ha | 22:10 | |
*** DjKad has joined #openstack-ha | 22:23 | |
DjKad | hi all | 22:23 |
*** kgaillot has quit IRC | 22:44 | |
*** jmlowe has quit IRC | 22:55 | |
*** jmlowe has joined #openstack-ha | 23:21 | |
*** jmlowe has quit IRC | 23:33 | |
*** jmlowe has joined #openstack-ha | 23:53 | |
*** DjKad has quit IRC | 23:57 |
Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!