通过openresty和嵌入式的lua脚本，来搭建高并发的日志采集服务器，现在主要采集pc端和app端的日志，数据存储在kafka
openresty 服务搭建步骤(mac,linux)
wget https://www.openssl.org/source/openssl-1.0.2f.tar.gz
tar -zvxf openssl-1.0.2f.tar.gz
wget ftp://ftp.csx.cam.ac.uk/pub/software/programming/pcre/pcre-8.38.tar.gz
tar -xvf pcre-8.38.tar.gz
wget https://openresty.org/download/ngx_openresty-1.9.7.2.tar.gz
tar -zxvf ngx_openresty-1.9.7.2.tar.gz
cd ngx_openresty-1.9.7.2/
./configure --with-openssl=../openssl-1.0.2f \ --with-pcre=../pcre-8.38 make
sudo make install
openresty 安装kafka插件
#下载lua-resty-kafka: wget https://github.com/doujiang24/lua-resty-kafka/archive/master.zip unzip lua-resty-kafka-master.zip -d ~
#拷贝lua-resty-kafka到openrestysudo mkdir /usr/local/openresty/lualib/resty/kafka cp -rf ~/lua-resty-kafka-master/lib/resty /usr/local/openresty/lualib/resty/kafka
#通过git下载代码~这个目录下
cd /usr/local/openresty/nginx
ln -s ~/logadash/src/udf udf
ln -s ~/logadash/conf/mac_nginx.conf nginx.conf
