Wednesday, 2017-11-29

*** tjakobs_ has quit IRC00:07
*** thorst has joined #openstack-powervm00:16
*** thorst has quit IRC00:21
*** thorst has joined #openstack-powervm00:49
*** thorst has quit IRC00:54
*** thorst has joined #openstack-powervm00:58
*** thorst has quit IRC00:59
*** thorst has joined #openstack-powervm01:06
*** thorst has quit IRC01:21
*** svenkat has joined #openstack-powervm01:49
*** thorst has joined #openstack-powervm01:51
*** thorst has quit IRC01:57
*** thorst has joined #openstack-powervm02:00
*** svenkat has quit IRC02:01
*** thorst has quit IRC02:05
*** svenkat has joined #openstack-powervm02:05
*** svenkat has quit IRC03:01
*** thorst has joined #openstack-powervm03:05
*** thorst has quit IRC03:10
*** thorst has joined #openstack-powervm03:36
*** thorst has quit IRC03:40
*** thorst has joined #openstack-powervm04:12
*** thorst has quit IRC04:17
*** thorst has joined #openstack-powervm04:44
*** thorst has quit IRC04:49
*** thorst has joined #openstack-powervm05:21
*** thorst has quit IRC05:26
*** thorst has joined #openstack-powervm05:29
*** thorst has quit IRC05:34
*** thorst has joined #openstack-powervm05:57
*** thorst has quit IRC06:03
*** thorst has joined #openstack-powervm06:29
*** thorst has quit IRC06:34
*** esberglu has quit IRC06:54
*** thorst has joined #openstack-powervm07:07
*** thorst has quit IRC07:11
*** thorst has joined #openstack-powervm07:42
*** thorst has quit IRC07:46
*** AlexeyAbashkin has joined #openstack-powervm07:47
*** thorst has joined #openstack-powervm08:21
*** thorst has quit IRC08:26
*** thorst has joined #openstack-powervm08:54
*** thorst has quit IRC08:59
*** openstackgerrit has joined #openstack-powervm09:04
openstackgerritOpenStack Proposal Bot proposed openstack/nova-powervm master: Updated from global requirements  https://review.openstack.org/52376709:08
*** thorst has joined #openstack-powervm09:24
*** thorst has quit IRC09:29
*** thorst has joined #openstack-powervm09:55
*** thorst has quit IRC09:59
*** AlexeyAbashkin has quit IRC10:28
*** thorst has joined #openstack-powervm10:31
*** thorst has quit IRC10:36
*** thorst has joined #openstack-powervm11:08
*** thorst has quit IRC11:13
*** AlexeyAbashkin has joined #openstack-powervm11:19
*** AlexeyAbashkin has quit IRC11:23
*** AlexeyAbashkin has joined #openstack-powervm11:27
*** thorst has joined #openstack-powervm11:30
*** thorst has quit IRC11:32
*** thorst has joined #openstack-powervm12:03
*** thorst has quit IRC12:07
*** thorst has joined #openstack-powervm12:18
*** thorst has quit IRC12:24
*** thorst has joined #openstack-powervm12:55
*** svenkat has joined #openstack-powervm12:59
*** edmondsw has joined #openstack-powervm13:32
*** openstackstatus has quit IRC13:43
*** openstack has joined #openstack-powervm13:45
*** ChanServ sets mode: +o openstack13:45
openstackgerritMerged openstack/nova-powervm master: Updated from global requirements  https://review.openstack.org/52376714:15
*** esberglu has joined #openstack-powervm14:31
openstackgerritMerged openstack/networking-powervm master: Updated from global requirements  https://review.openstack.org/52375814:37
*** openstack has quit IRC14:46
*** openstack has joined #openstack-powervm14:50
*** ChanServ sets mode: +o openstack14:50
*** apearson has joined #openstack-powervm15:02
*** edmondsw_ has joined #openstack-powervm16:00
*** edmondsw has quit IRC16:03
*** edmondsw_ is now known as edmondsw16:03
*** AlexeyAbashkin has quit IRC16:23
*** efried is now known as efried_rollin17:22
*** thorst has quit IRC18:00
*** thorst has joined #openstack-powervm18:06
*** thorst has quit IRC18:11
*** thorst has joined #openstack-powervm18:18
*** thorst has quit IRC18:22
*** thorst has joined #openstack-powervm18:40
*** thorst has quit IRC18:40
*** thorst has joined #openstack-powervm18:40
*** efried_rollin is now known as efried20:07
*** AlexeyAbashkin has joined #openstack-powervm20:14
*** AlexeyAbashkin has quit IRC20:18
esbergluefried: I figured out what's going on with the CI logs. journalctl automatically does highlighting, which afaik can't be disabled.21:07
esbergluIf the color codes are removed, everything is displayed properly21:08
esbergluSo we either need to wipe the color codes from the logs before uploading to the logserver, or go back to using screen which can disable log coloring21:08
efriedesberglu There's a flag that's letting the color codes come through.21:09
efriedThe answer is not to remove that flag.21:09
efriedBecause then we get *no* color coding.21:09
efriedThe answer is to figure out why the color codes are all fucked up by the time we get to the browser.21:09
efriedHave we ascertained that they're okay if you actually download the file?  That might be the clue.21:09
esbergluThe logservers apache config has stuff that colorizes the logs21:10
esbergluefried: view-source:http://184.172.12.213/16/523216/3/check/nova-out-of-tree-pvm/893886d/logs/n-cpu.txt.gz21:11
esbergluThe color codes are right before the log level there. If I go on the file and remove those the logs will display properly21:12
esbergluThat's why everything switches to ERROR on L71821:13
esbergluThe error trace doesn't have those codes21:13
efriedBut if I download the file and look at it directly under `less -R`, the color codes are correct.21:14
efriedeverything looks just fine.21:14
efriedWhen I click the file and it renders it in my browser, it's effed up.21:14
esbergluefried: Yeah but the apache config relies on that fact that there aren't color codes in the file21:15
efriedBut it works *sometimes*!21:15
efriedand sometimes it works partially21:15
esbergluIf we get rid of the color codes it will display properly in the browser, but if you download and less -R you won't have color21:15
esbergluBut I would rather have it work in the browser21:16
efriedNo dude, I would rather have it work work.21:20
esbergluefried: http://184.172.12.213/manual/log_txt/logs/n-cpu.txt.gz21:21
efriedIt works for other CIs.  At this point I'm guessing whatever plugin is doing the special handling of the request for a .txt.gz file is downlevel or busted.21:21
esbergluI think we would have to toy with the apache config then21:21
efriedRight.21:21
efriedon the log server.21:21
efriedPossibly the config; possibly just upgrading the plugins.21:21
esbergluefried: Btw other CI's will not give you color on less -R if you download them21:23
esbergluMost other CI's use screen with log color disabled21:24
efriedesberglu http://logs.openstack.org/05/521605/2/check/legacy-tempest-dsvm-multinode-live-migration/9a0e7ad/logs/screen-n-cpu.txt.gz21:27
efriedHow does that show up colored in the browser, but no colors when downloaded?21:28
esbergluefried: There aren't any color codes in that file. If you download and less -R you won't get color21:28
esbergluAll of the coloring is in the apache config21:29
esbergluLet me find the file that does it one sec21:29
efriedSo you're saying if we turn off color codes in our log captures, we'll see colors in the browser??21:29
efriedI'm bothered by that possibility.  But okay.  Take the `-a` flag off of journalctl and that'll strip the color codes.21:30
esbergluefried: Yes that is what I'm saying21:32
esbergluhttps://github.com/openstack-infra/puppet-openstackci/blob/master/templates/logs.vhost.erb#L9521:32
esbergluThere's this htmlify thing that takes the plain txt.gz files does colorizing, timestamps, etc.21:32
efriedesberglu Can we find the source for that guy?21:33
esbergluefried: https://github.com/openstack-infra/os-loganalyze/blob/master/os_loganalyze/view.py21:41
*** edmondsw has quit IRC21:51
*** edmondsw has joined #openstack-powervm21:53
*** edmondsw has quit IRC21:58
*** svenkat has quit IRC22:12
*** thorst has quit IRC22:19
esbergluefried: Confirmed that removing the log coloring colors the logs22:19
esbergluhttp://184.172.12.213/manual/no_color/logs/22:19
efriedesberglu I know you were shooting for removing things from your to-do list, but I'd like to dig deeper and maybe tweak that htmlificator to tolerate (if not observe/interpret) the color codes, so we can have it both ways.22:26
efriedWe can take off the -a for now, though.22:27
esbergluefried: Yep sounds good22:28
*** edmondsw has joined #openstack-powervm22:32
*** edmondsw has quit IRC22:37
*** edmondsw has joined #openstack-powervm22:48
*** thorst has joined #openstack-powervm22:50
*** thorst has quit IRC22:55
*** esberglu has quit IRC22:55
*** thorst has joined #openstack-powervm22:56
*** thorst has quit IRC23:01
*** AlexeyAbashkin has joined #openstack-powervm23:14
*** AlexeyAbashkin has quit IRC23:19
*** apearson has quit IRC23:25
*** thorst has joined #openstack-powervm23:35
*** thorst has quit IRC23:41

Generated by irclog2html.py 2.15.3 by Marius Gedminas - find it at mg.pov.lt!