GoAccess日志分析工具

1.1 GoAccess简介

GoAccess是一个非常良心的开源软件，它的良心之处体现在如下方面：
1）安装简单；
2）操作容易；
3）界面酷炫；
GoAccess 官网 https://goaccess.io

1.2 安装GoAccess

1.2.1 系统环境说明

[root@clsn.io /root]
#cat  /etc/redhat-release
CentOS release 6.8 (Final)

[root@clsn.io /root] 
#uname  -a
Linux clsn.io 4.10.5-1.el6.elrepo.x86_64 #1 SMP Wed Mar 22 14:55:33 EDT 2017 x86_64 x86_64 x86_64 GNU/Linux

[root@clsn.io /root] 
#sestatus
SELinux status:                 disabled

1.2.2 安装GoAccess

官网提供多种系统版本的安装方法： https://goaccess.io/download#installation

$ wget https://tar.goaccess.io/goaccess-1.3.tar.gz
$ tar -xzvf goaccess-1.3.tar.gz
$ cd goaccess-1.3/
$ ./configure --enable-utf8 --enable-geoip=legacy
$ make
# make install

配置完成的信息

Your build configuration:

  Prefix         : /usr/local
  Package        : goaccess
  Version        : 1.3
  Compiler flags :  -pthread
  Linker flags   : -lnsl -lncursesw -lGeoIP -lpthread
  Dynamic buffer : no
  Geolocation    : GeoIP Legacy
  Storage method : In-memory Hash Database (Default)
  TLS/SSL        : no
  Bugs           : goaccess@prosoftcorp.com

1.2.3 使用GoAccess分析日志

注：本次分析日志为 nignx 标准输出日志

[root@clsn.io /var/log/nginx] clsn.io Blog WebSite
#goaccess  -f  clsn.io.log

日志格式选为 NCSA Combined Log Format

 回车即可看到当前日志分析结果 

1.3 生成HTML页面

1.3.1 修改配置

查看当前配置

[root@clsn.io /usr/local/etc/goaccess] clsn.io Blog WebSite
#egrep  -v "^#|^$" goaccess.conf
config-dialog false
hl-header true
json-pretty-print false
no-color false
no-column-names false
no-csv-summary false
no-progress false
no-tab-scroll false
with-mouse false
agent-list false
with-output-resolver false
http-method yes
http-protocol yes
no-query-string false
no-term-resolver false
444-as-404 false
4xx-to-unique-count false
all-static-files false
double-decode false
ignore-crawlers false
crawlers-only false
ignore-panel REFERRERS
ignore-panel KEYPHRASES
real-os true
static-file .css
static-file .js
static-file .jpg
static-file .png
static-file .gif
static-file .ico
static-file .jpeg
static-file .pdf
static-file .csv
static-file .mpeg
static-file .mpg
static-file .swf
static-file .woff
static-file .woff2
static-file .xls
static-file .xlsx
static-file .doc
static-file .docx
static-file .ppt
static-file .pptx
static-file .txt
static-file .zip
static-file .ogg
static-file .mp3
static-file .mp4
static-file .exe
static-file .iso
static-file .gz
static-file .rar
static-file .svg
static-file .bmp
static-file .tar
static-file .tgz
static-file .tiff
static-file .tif
static-file .ttf
static-file .flv

由上可见默认配置中并无时间参数，需要在配置中添加时间参数。

[root@clsn.io /usr/local/etc/goaccess] clsn.io Blog WebSite
#cat  >>goaccess.conf<<EOF
> time-format %H:%M:%S
> date-format %d/%b/%Y
> #NCSA Combined Log Format
> log-format %h %^[%d:%t %^] "%r" %s %b "%R" "%u"
> EOF

[root@clsn.io /usr/local/etc/goaccess] clsn.io Blog WebSite
#cp -a goaccess.conf ../

1.3.2 添加定时任务

30 * * * *  /usr/local/bin/goaccess  /var/log/nginx/clsn.io.log* -o /www/wwwroot/monitor/report.html -p /usr/
local/etc/goaccess/goaccess.conf

1.3.3 检查生产页面
https://monitor.clsn.io/report.html

1.4 参考文献

https://www.linuxidc.com/Linux/2016-12/138731.htm
https://goaccess.io/man
https://goaccess.io/
https://www.imydl.tech/lnmp/197.html
https://segmentfault.com/a/1190000011025155