Azkaban2.5安装部署(系统时区设置 + 安装和配置mysql + Azkaban Web Server 安装 + Azkaban Executor Server安装 + Azkaban web server插件安装 + Azkaban Executor Server 插件安装)(博主推荐)(

本文涉及的产品
RDS MySQL Serverless 基础系列,0.5-2RCU 50GB
检索分析服务 Elasticsearch 版,2核4GB开发者规格 1个月
云数据库 RDS MySQL,集群系列 2核4GB
推荐场景:
搭建个人博客
简介:

 

  准备这四个

 

 

 

 

 

 

 

 

 

 

Azkaban 2.5安装

  • 系统时区设置

  • 安装和配置mysql

  • Azkaban Web Server 安装

  • Azkaban Executor Server安装

  • 启动验证

  • Azkaban web server插件安装

  • Azkaban Executor Server 插件安装

 

 

 

 

 

 

 

 

 

一、系统时区配置

 

1.查看时区

[hadoop@master azkaban-web-2.5.0]$ more /etc/sysconfig/clock
ZONE="Asia/Shanghai"
UTC=true
ARC=false

 

复制代码
[hadoop@master ~]$ more /etc/sysconfig/clock
# The time zone of the system is defined by the contents of /etc/localtime.
# This file is only for evaluation by system-config-date, do not rely on its
# contents elsewhere.
ZONE="Asia/Shanghai"
[hadoop@master ~]$ su root
Password: 
[root@master hadoop]# vim /etc/sysconfig/clock 
[root@master hadoop]# more /etc/sysconfig/clock
# The time zone of the system is defined by the contents of /etc/localtime.
# This file is only for evaluation by system-config-date, do not rely on its
# contents elsewhere.
ZONE="Asia/Shanghai"
UTC=true
ARC=false
[root@master hadoop]# 
复制代码

 

 

 

 

 

 

 

 

 

 

 

 

2.修改时区

时区文件都在/usr/share/zoneinfo,复制相应时区覆盖/etc/localtime即可

[hadoop@master ~]$ ll /usr/share/zoneinfo
cp /usr/share/zoneinfo/Asia/Shanghai  /etc/localtime

 

 

 

 

  修改web server 和excutor server 都需要配置时区,必须和系统时区一致(注意,这一步可以到最后才来修改)

default.timezone.id=Asia/Shanghai

 

 

 

 

 

 

 

 

 

 

 

 

安装mysql

  这个很简单。不多赘述,大家可以去看我的博客

Hive环境的安装部署(完美安装)(集群内或集群外都适用)(含卸载自带mysql安装指定版本)

 

 

 

复制代码
[hadoop@master app]$ pwd
/home/hadoop/app
[hadoop@master app]$ ll
total 48
drwxrwxr-x   7 hadoop hadoop 4096 Apr 21 15:43 elasticsearch-2.4.0
drwxrwxr-x   6 hadoop hadoop 4096 Apr 21 12:12 elasticsearch-2.4.3
lrwxrwxrwx   1 hadoop hadoop   20 Apr 21 15:00 es -> elasticsearch-2.4.0/
lrwxrwxrwx   1 hadoop hadoop   11 Apr 20 12:19 flume -> flume-1.6.0
drwxrwxr-x   7 hadoop hadoop 4096 Apr 20 12:17 flume-1.6.0
drwxrwxr-x   7 hadoop hadoop 4096 Apr 20 12:00 flume-1.7.0
lrwxrwxrwx.  1 hadoop hadoop   12 Apr 12 11:27 hadoop -> hadoop-2.6.0
drwxr-xr-x. 10 hadoop hadoop 4096 Apr 12 16:33 hadoop-2.6.0
lrwxrwxrwx.  1 hadoop hadoop   13 Apr 12 11:28 hbase -> hbase-0.98.19
drwxrwxr-x.  8 hadoop hadoop 4096 Apr 12 17:27 hbase-0.98.19
lrwxrwxrwx.  1 hadoop hadoop   10 Apr 12 11:28 hive -> hive-1.0.0
drwxrwxr-x.  8 hadoop hadoop 4096 Apr 20 11:59 hive-1.0.0
lrwxrwxrwx.  1 hadoop hadoop   11 Apr 12 10:18 jdk -> jdk1.7.0_79
drwxr-xr-x.  8 hadoop hadoop 4096 Apr 11  2015 jdk1.7.0_79
drwxr-xr-x.  8 hadoop hadoop 4096 Aug  5  2015 jdk1.8.0_60
lrwxrwxrwx   1 hadoop hadoop   26 Apr 21 22:18 kibana -> kibana-4.6.3-linux-x86_64/
drwxrwxr-x  11 hadoop hadoop 4096 Nov  4 23:24 kibana-4.6.3-linux-x86_64
lrwxrwxrwx.  1 hadoop hadoop   11 Apr 12 11:28 sqoop -> sqoop-1.4.6
drwxr-xr-x.  9 hadoop hadoop 4096 Apr 27  2015 sqoop-1.4.6
lrwxrwxrwx.  1 hadoop hadoop   15 Apr 12 11:28 zookeeper -> zookeeper-3.4.6
drwxr-xr-x. 10 hadoop hadoop 4096 Apr 12 17:13 zookeeper-3.4.6
[hadoop@master app]$ mkdir azkaban
[hadoop@master app]$ ll
total 52
drwxrwxr-x   2 hadoop hadoop 4096 May  1 11:57 azkaban
drwxrwxr-x   7 hadoop hadoop 4096 Apr 21 15:43 elasticsearch-2.4.0
drwxrwxr-x   6 hadoop hadoop 4096 Apr 21 12:12 elasticsearch-2.4.3
lrwxrwxrwx   1 hadoop hadoop   20 Apr 21 15:00 es -> elasticsearch-2.4.0/
lrwxrwxrwx   1 hadoop hadoop   11 Apr 20 12:19 flume -> flume-1.6.0
drwxrwxr-x   7 hadoop hadoop 4096 Apr 20 12:17 flume-1.6.0
drwxrwxr-x   7 hadoop hadoop 4096 Apr 20 12:00 flume-1.7.0
lrwxrwxrwx.  1 hadoop hadoop   12 Apr 12 11:27 hadoop -> hadoop-2.6.0
drwxr-xr-x. 10 hadoop hadoop 4096 Apr 12 16:33 hadoop-2.6.0
lrwxrwxrwx.  1 hadoop hadoop   13 Apr 12 11:28 hbase -> hbase-0.98.19
drwxrwxr-x.  8 hadoop hadoop 4096 Apr 12 17:27 hbase-0.98.19
lrwxrwxrwx.  1 hadoop hadoop   10 Apr 12 11:28 hive -> hive-1.0.0
drwxrwxr-x.  8 hadoop hadoop 4096 Apr 20 11:59 hive-1.0.0
lrwxrwxrwx.  1 hadoop hadoop   11 Apr 12 10:18 jdk -> jdk1.7.0_79
drwxr-xr-x.  8 hadoop hadoop 4096 Apr 11  2015 jdk1.7.0_79
drwxr-xr-x.  8 hadoop hadoop 4096 Aug  5  2015 jdk1.8.0_60
lrwxrwxrwx   1 hadoop hadoop   26 Apr 21 22:18 kibana -> kibana-4.6.3-linux-x86_64/
drwxrwxr-x  11 hadoop hadoop 4096 Nov  4 23:24 kibana-4.6.3-linux-x86_64
lrwxrwxrwx.  1 hadoop hadoop   11 Apr 12 11:28 sqoop -> sqoop-1.4.6
drwxr-xr-x.  9 hadoop hadoop 4096 Apr 27  2015 sqoop-1.4.6
lrwxrwxrwx.  1 hadoop hadoop   15 Apr 12 11:28 zookeeper -> zookeeper-3.4.6
drwxr-xr-x. 10 hadoop hadoop 4096 Apr 12 17:13 zookeeper-3.4.6
[hadoop@master app]$ 
复制代码

 

 

 

 

 

 

 

 

 

二、配置mysql

  下载mysql数据脚本

wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-sql-script-2.5.0.tar.gz
tar -zxvf azkaban-sql-script-2.5.0.tar.gz –C ~/app/azkaban/

   我下载的是离线,待会上传。

 

 

复制代码
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 0
[hadoop@master azkaban]$ rz

[hadoop@master azkaban]$ ll
total 4
-rw-r--r-- 1 hadoop hadoop 1928 May  1 11:43 azkaban-sql-script-2.5.0.tar.gz
[hadoop@master azkaban]$ 
复制代码

 

 

 

 

 

 

[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 4
-rw-r--r-- 1 hadoop hadoop 1928 May  1 11:43 azkaban-sql-script-2.5.0.tar.gz
[hadoop@master azkaban]$ tar -zxvf azkaban-sql-script-2.5.0.tar.gz 

 

 

 

 

 

复制代码
[hadoop@master azkaban]$ ll
total 8
drwxrwxr-x 2 hadoop hadoop 4096 May  1 12:04 azkaban-2.5.0
-rw-r--r-- 1 hadoop hadoop 1928 May  1 11:43 azkaban-sql-script-2.5.0.tar.gz
[hadoop@master azkaban]$ rm azkaban-sql-script-2.5.0.tar.gz 
[hadoop@master azkaban]$ ll
total 4
drwxrwxr-x 2 hadoop hadoop 4096 May  1 12:04 azkaban-2.5.0
[hadoop@master azkaban]$ 
复制代码

 

 

 

 

 创建用户、分配权限并执行脚本

复制代码
mysql –uroot –pxxxx
创建数据库: CREATE DATABASE azkaban;
创建用户名:CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban'
分配权限:GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON `azkaban`.* TO 'azkaban'@'%' WITH GRANT OPTION;
flush privileges;
quit;
通过azkaban账号登录mysql:mysql –uazkaban –pazkaban
Use azkaban;
source ~/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql
复制代码

 

  先开启mysql服务进程

[root@master azkaban]# service mysqld start
Starting mysqld:                                           [  OK  ]
[root@master azkaban]# su hadoop
[hadoop@master azkaban]$

 

 

 

复制代码
[hadoop@master azkaban]$ mysql -uroot -prootroot
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 2
Server version: 5.1.73 Source distribution

Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> CREATE DATABASE azkaban;
Query OK, 1 row affected (0.00 sec)

mysql> CREATE USER 'azkaban'@'%' IDENTIFIED BY 'azkaban';
Query OK, 0 rows affected (0.00 sec)

mysql> GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON 'azkaban'.* TO 'azkaban'@'%' WITH GRANT OPTION;
ERROR 1064 (42000): You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near ''azkaban'.* TO 'azkaban'@'%' WITH GRANT OPTION' at line 1
mysql> GRANT SELECT,INSERT,UPDATE,DELETE,CREATE,INDEX ON `azkaban`.* TO 'azkaban'@'%' WITH GRANT OPTION;
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> quit;
Bye
[hadoop@master azkaban]$ 
复制代码

 

 

 

 

 

通过azkaban账号登录mysql
mysql –uazkaban –pazkaban
use azkaban;
source ~/app/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql

 

    则,再次执行

 

复制代码
[hadoop@master azkaban]$ mysql -uazkaban -pazkaban
ERROR 1045 (28000): Access denied for user 'azkaban'@'localhost' (using password: YES)
[hadoop@master azkaban]$ mysql -uroot -prootroot
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 4
Server version: 5.1.73 Source distribution

Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'%' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;
Query OK, 0 rows affected (0.00 sec)

mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'master' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;
Query OK, 0 rows affected (0.00 sec)

mysql> GRANT ALL PRIVILEGES ON *.* to 'azkaban'@'localhost' IDENTIFIED BY 'azkaban' WITH GRANT OPTION;
Query OK, 0 rows affected (0.00 sec)

mysql> flush privileges;
Query OK, 0 rows affected (0.00 sec)

mysql> select user,host,password from mysql.user;
+---------+-----------+-------------------------------------------+
| user    | host      | password                                  |
+---------+-----------+-------------------------------------------+
| root    | localhost | *6C362347EBEAA7DF44F6D34884615A35095E80EB |
| root    | master    |                                           |
| root    | 127.0.0.1 |                                           |
|         | localhost |                                           |
|         | master    |                                           |
| hive    | %         | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| hive    | master    | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| hive    | localhost | *4DF1D66463C18D44E3B001A8FB1BBFBEA13E27FC |
| azkaban | %         | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |
| azkaban | master    | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |
| azkaban | localhost | *8E02B7AE57F9A19E165EB45CD3F705BF66985B85 |
+---------+-----------+-------------------------------------------+
11 rows in set (0.01 sec)

mysql> exit;
Bye
[hadoop@master azkaban]$ 
复制代码

 

 

 

   然后,此刻就可以通过azkaban账号登录mysql了。

mysql –uazkaban –pazkaban
use azkaban;
source ~/app/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql

 

  因为,

复制代码
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 4
drwxrwxr-x 2 hadoop hadoop 4096 May  1 12:04 azkaban-2.5.0
[hadoop@master azkaban]$ cd azkaban-2.5.0/
[hadoop@master azkaban-2.5.0]$ pwd
/home/hadoop/app/azkaban/azkaban-2.5.0
[hadoop@master azkaban-2.5.0]$ ll
total 88
-rwxr-xr-x 1 hadoop hadoop  129 Apr 22  2014 create.active_executing_flows.sql
-rwxr-xr-x 1 hadoop hadoop  216 Apr 22  2014 create.active_sla.sql
-rwxr-xr-x 1 hadoop hadoop 4694 Apr 22  2014 create-all-sql-2.5.0.sql
-rwxr-xr-x 1 hadoop hadoop  610 Apr 22  2014 create.execution_flows.sql
-rwxr-xr-x 1 hadoop hadoop  519 Apr 22  2014 create.execution_jobs.sql
-rwxr-xr-x 1 hadoop hadoop  358 Apr 22  2014 create.execution_logs.sql
-rwxr-xr-x 1 hadoop hadoop  224 Apr 22  2014 create.project_events.sql
-rwxr-xr-x 1 hadoop hadoop  227 Apr 22  2014 create.project_files.sql
-rwxr-xr-x 1 hadoop hadoop  280 Apr 22  2014 create.project_flows.sql
-rwxr-xr-x 1 hadoop hadoop  285 Apr 22  2014 create.project_permissions.sql
-rwxr-xr-x 1 hadoop hadoop  294 Apr 22  2014 create.project_properties.sql
-rwxr-xr-x 1 hadoop hadoop  380 Apr 22  2014 create.projects.sql
-rwxr-xr-x 1 hadoop hadoop  325 Apr 22  2014 create.project_versions.sql
-rwxr-xr-x 1 hadoop hadoop  155 Apr 22  2014 create.properties.sql
-rwxr-xr-x 1 hadoop hadoop  498 Apr 22  2014 create.schedules.sql
-rwxr-xr-x 1 hadoop hadoop  189 Apr 22  2014 create.triggers.sql
-rwxr-xr-x 1 hadoop hadoop   22 Apr 22  2014 database.properties
-rwxr-xr-x 1 hadoop hadoop  671 Apr 22  2014 update-all-sql-2.1.sql
-rwxr-xr-x 1 hadoop hadoop  156 Apr 22  2014 update-all-sql-2.2.sql
-rwxr-xr-x 1 hadoop hadoop  395 Apr 22  2014 update.execution_logs.2.1.sql
-rwxr-xr-x 1 hadoop hadoop   59 Apr 22  2014 update.project_properties.2.1.sql
[hadoop@master azkaban-2.5.0]$ 
复制代码

 

 

  

 

  所以,才执行如下

复制代码
[hadoop@master azkaban]$ mysql -uazkaban -pazkaban
Welcome to the MySQL monitor.  Commands end with ; or \g.
Your MySQL connection id is 5
Server version: 5.1.73 Source distribution

Copyright (c) 2000, 2013, Oracle and/or its affiliates. All rights reserved.

Oracle is a registered trademark of Oracle Corporation and/or its
affiliates. Other names may be trademarks of their respective
owners.

Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

mysql> use azkaban;
Database changed
mysql> source /home/hadoop/app/azkaban/azkaban-2.5.0/create-all-sql-2.5.0.sql
Query OK, 0 rows affected (0.03 sec)

Query OK, 0 rows affected (0.03 sec)

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.04 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.02 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.03 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.02 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.00 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.02 sec)

Query OK, 0 rows affected (0.00 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.02 sec)

Query OK, 0 rows affected (0.00 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.00 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.02 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)

Query OK, 0 rows affected (0.01 sec)
Records: 0  Duplicates: 0  Warnings: 0

Query OK, 0 rows affected (0.02 sec)

 mysql> exit;
Bye
 [hadoop@master azkaban]$

复制代码

 

 

 

 



 

 

 

三、Azkaban Web Server 安装

1.下载安装包

wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-web-server-2.5.0.tar.gz
tar –zxvf azkaban-web-server-2.5.0.tar.gz  –C  ~/app/azkaban/

  

  我这里,选择离线上传的方式,之前已经下载好了。

 

复制代码
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 4
drwxrwxr-x 2 hadoop hadoop 4096 May  1 12:04 azkaban-2.5.0
[hadoop@master azkaban]$ rz

[hadoop@master azkaban]$ ll
total 11716
drwxrwxr-x 2 hadoop hadoop     4096 May  1 12:04 azkaban-2.5.0
-rw-r--r-- 1 hadoop hadoop 11989669 May  1 11:44 azkaban-web-server-2.5.0.tar.gz
[hadoop@master azkaban]$ 
复制代码

 

 

 

解压缩

复制代码
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 11716
drwxrwxr-x 2 hadoop hadoop     4096 May  1 12:04 azkaban-2.5.0
-rw-r--r-- 1 hadoop hadoop 11989669 May  1 11:44 azkaban-web-server-2.5.0.tar.gz
[hadoop@master azkaban]$ tar -zxvf azkaban-web-server-2.5.0.tar.gz 
复制代码

 



复制代码
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 11720
drwxrwxr-x 2 hadoop hadoop     4096 May  1 12:04 azkaban-2.5.0
drwxrwxr-x 8 hadoop hadoop     4096 May  1 14:29 azkaban-web-2.5.0
-rw-r--r-- 1 hadoop hadoop 11989669 May  1 11:44 azkaban-web-server-2.5.0.tar.gz
[hadoop@master azkaban]$ rm azkaban-web-server-2.5.0.tar.gz 
[hadoop@master azkaban]$ ll
total 8
drwxrwxr-x 2 hadoop hadoop 4096 May  1 12:04 azkaban-2.5.0
drwxrwxr-x 8 hadoop hadoop 4096 May  1 14:29 azkaban-web-2.5.0
[hadoop@master azkaban]$ 
复制代码

 







 

2.上传依赖包

  上传mysql驱动包至 ~/app/azkaban/azkaban-web-2.5.0/extlib/

 

复制代码
[hadoop@master extlib]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0/extlib
[hadoop@master extlib]$ ll
total 0
[hadoop@master extlib]$ rz
[hadoop@master extlib]$ ll
total 812
-rw-r--r-- 1 hadoop hadoop 827942 Nov  3 09:37 mysql-connector-java-5.1.21.jar
[hadoop@master extlib]$ 
复制代码

 

 

 

3.生成jetty ssl所需密钥文件
复制代码
keytool -keystore keystore -alias jetty -genkey -keyalg RSA
        Enter keystore password:  mysteel
        What is your first and last name?
          [Unknown]:  mysteel
        What is the name of your organizational unit?
          [Unknown]:  mysteel
        What is the name of your organization?
          [Unknown]: mysteel
        What is the name of your City or Locality?
          [Unknown]:SH
        What is the name of your State or Province?
          [Unknown]:SH
        What is the two-letter country code for this unit?
          [Unknown]:CN
       Is CN=mysteel, OU= mysteel, O= mysteel, L=SH, ST=SH, C=CN correct?  
      [no]:  yes  
        Enter key password for < mysteel >
                (RETURN if same as keystore password):  mysteel
复制代码

 

 

复制代码
[hadoop@master extlib]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0/extlib
[hadoop@master extlib]$ keytool -keystore keystore -alias jetty -genkey -keyalg RSA
Enter keystore password:(密码是mysteel)  
Re-enter new password: (密码是mysteel)
What is your first and last name?
  [Unknown]:  mysteel
What is the name of your organizational unit?
  [Unknown]:  mysteel
What is the name of your organization?
  [Unknown]:  mysteel
What is the name of your City or Locality?
  [Unknown]:  SH
What is the name of your State or Province?
  [Unknown]:  SH
What is the two-letter country code for this unit?
  [Unknown]:  CN
Is CN=mysteel, OU=mysteel, O=mysteel, L=SH, ST=SH, C=CN correct?
  [no]:  yes

Enter key password for <jetty>
    (RETURN if same as keystore password):  
Re-enter new password: (密码是mysteel)
[hadoop@master extlib]$ 
复制代码

  注意:这里keystore的密码为mysteel,key的密码为mysteel可自行修改 最后将生成的keystore文件放到 Azkaban安装目录中~/app/azkaban/azkaban-web-2.5.0/ (也可通过修改配置文件改变其默认存放地址)。

 

 

 

 

复制代码
[hadoop@master extlib]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0/extlib
[hadoop@master extlib]$ ll
total 816
-rw-rw-r-- 1 hadoop hadoop   2211 May  1 14:39 keystore
-rw-r--r-- 1 hadoop hadoop 827942 Nov  3 09:37 mysql-connector-java-5.1.21.jar
[hadoop@master extlib]$ mv keystore /home/hadoop/app/azkaban/azkaban-web-2.5.0/
[hadoop@master extlib]$ cd /home/hadoop/app/azkaban/azkaban-web-2.5.0/
[hadoop@master azkaban-web-2.5.0]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0
[hadoop@master azkaban-web-2.5.0]$ ll
total 32
-rw-r--r-- 1 hadoop hadoop  105 Apr 22  2014 azkaban.version
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 bin
drwxr-xr-x 2 hadoop hadoop 4096 May  1 14:29 conf
drwxr-xr-x 2 hadoop hadoop 4096 May  1 14:43 extlib
-rw-rw-r-- 1 hadoop hadoop 2211 May  1 14:39 keystore
drwxr-xr-x 2 hadoop hadoop 4096 May  1 14:29 lib
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 plugins
drwxr-xr-x 6 hadoop hadoop 4096 May  1 14:29 web
[hadoop@master azkaban-web-2.5.0]$ 
复制代码

 

 

 

 

 

 

 

 4.修改配置文件 (conf/azkaban.propreties)

修改首页样式及时区信息

复制代码
azkaban.name=Job Tasks
azkaban.label=mysteel workflow
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai
复制代码

 

 

复制代码
#Azkaban Personalization Settings
azkaban.name=Test
azkaban.label=My Local Azkaban
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=America/Los_Angeles



改为

#Azkaban Personalization Settings
azkaban.name=Job Tasks
azkaban.label=mysteel workflow
azkaban.color=#FF3601
azkaban.default.servlet.path=/index
web.resource.dir=web/
default.timezone.id=Asia/Shanghai

复制代码

 

 

 

 

 

 

 

修改mysql连接,可自行修改

复制代码
database.type=mysql
mysql.port=3306
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100
复制代码

 

 

复制代码
database.type=mysql
mysql.port=3306
mysql.host=localhost
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100


改为


database.type=mysql
mysql.port=3306
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100
复制代码

 

 

 

 

 

 

 

 

 

  修改 Jetty 服务器属性,包括 keystore 的相关配置

复制代码
jetty.maxThreads=25
jetty.ssl.port=8443
jetty.port=8081
jetty.keystore=keystore
jetty.password=mysteel
jetty.keypassword= mysteel
jetty.truststore=keystore
jetty.trustpassword= mysteel
复制代码

 

复制代码
# Azkaban Jetty server properties.
jetty.maxThreads=25
jetty.ssl.port=8443
jetty.port=8081
jetty.keystore=keystore
jetty.password=password
jetty.keypassword=password
jetty.truststore=keystore
jetty.trustpassword=password



改成


# Azkaban Jetty server properties.
jetty.maxThreads=25
jetty.ssl.port=8443
jetty.port=8071
jetty.keystore=keystore
jetty.password=mysteel
jetty.keypassword=mysteel
jetty.truststore=keystore
jetty.trustpassword=mysteel
复制代码

 

 

 

 

 

 

 

 修改邮件设置(可选)

mail.sender=xxxxxxx@mysteel.com
    mail.host=smtp.126.com
    mail.user= xxxxxxx@mysteel.com
    mail.password=xxx (注:发送邮箱的密码)

 

 

 

 

 

5.用户及权限配置

  进入 azkaban web 服务器 conf 目录,修改 azkaban-users.xml ,增加管理员用户:

复制代码
< azkaban-users>
   < user username="azkaban" password="azkaban" roles="admin"  groups="azkaban" />
   < user username="metrics" password="metrics" roles="metrics"/>
   < user username="admin" password="admin" roles="admin,metrics" />
   < role name="admin" permissions="ADMIN" />
   < role name="metrics" permissions="METRICS"/>
< /azkaban-users>
复制代码

 

 

 

 

 

复制代码
<azkaban-users>
        <user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
        <user username="metrics" password="metrics" roles="metrics"/>    
        <role name="admin" permissions="ADMIN" />
        <role name="metrics" permissions="METRICS"/>
</azkaban-users>

改为

<azkaban-users>
        <user username="azkaban" password="azkaban" roles="admin" groups="azkaban" />
        <user username="metrics" password="metrics" roles="metrics"/>
        <user username="admin" password="admin" roles="admin,metrics"/>  
        <role name="admin" permissions="ADMIN" />
        <role name="metrics" permissions="METRICS"/>
</azkaban-users>
复制代码

 

 

 

 

 

 

 

 

 

 

四、Azkaban Executor Server安装

1、下载安装包

wget https://s3.amazonaws.com/azkaban2/azkaban2/2.5.0/azkaban-executor-server-2.5.0.tar.gz
tar –zxvf  azkaban-executor-server-2.5.0.tar.gz  –C  ~/app/azkaban/

  我这里,选择的是离线,再上传的方式

 

 

 

 

复制代码
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 8
drwxrwxr-x 2 hadoop hadoop 4096 May  1 12:04 azkaban-2.5.0
drwxrwxr-x 8 hadoop hadoop 4096 May  1 14:43 azkaban-web-2.5.0
[hadoop@master azkaban]$ rz

[hadoop@master azkaban]$ ll
total 10904
drwxrwxr-x 2 hadoop hadoop     4096 May  1 12:04 azkaban-2.5.0
-rw-r--r-- 1 hadoop hadoop 11157302 May  1 11:44 azkaban-executor-server-2.5.0.tar.gz
drwxrwxr-x 8 hadoop hadoop     4096 May  1 14:43 azkaban-web-2.5.0
[hadoop@master azkaban]$ clear
[hadoop@master azkaban]$
复制代码

 

 

 

   解压缩

复制代码
[hadoop@master azkaban]$ pwd
/home/hadoop/app/azkaban
[hadoop@master azkaban]$ ll
total 10904
drwxrwxr-x 2 hadoop hadoop     4096 May  1 12:04 azkaban-2.5.0
-rw-r--r-- 1 hadoop hadoop 11157302 May  1 11:44 azkaban-executor-server-2.5.0.tar.gz
drwxrwxr-x 8 hadoop hadoop     4096 May  1 14:43 azkaban-web-2.5.0
[hadoop@master azkaban]$ tar -zxvf azkaban-executor-server-2.5.0.tar.gz
复制代码

 

 

 

 

复制代码
[hadoop@master azkaban]$ ll
total 10908
drwxrwxr-x 2 hadoop hadoop     4096 May  1 12:04 azkaban-2.5.0
drwxrwxr-x 7 hadoop hadoop     4096 May  1 15:21 azkaban-executor-2.5.0
-rw-r--r-- 1 hadoop hadoop 11157302 May  1 11:44 azkaban-executor-server-2.5.0.tar.gz
drwxrwxr-x 8 hadoop hadoop     4096 May  1 14:43 azkaban-web-2.5.0
[hadoop@master azkaban]$ rm azkaban-executor-server-2.5.0.tar.gz
[hadoop@master azkaban]$
复制代码

 

 

 

2.修改配置文件 (conf/azkaban.propreties)

修改时区信息

default.timezone.id=Asia/Shanghai

复制代码
[hadoop@master conf]$ pwd
/home/hadoop/app/azkaban/azkaban-executor-2.5.0/conf
[hadoop@master conf]$ ll
total 8
-rw-r--r-- 1 hadoop hadoop  55 Apr 22  2014 azkaban.private.properties
-rw-r--r-- 1 hadoop hadoop 469 Apr 22  2014 azkaban.properties
-rw-r--r-- 1 hadoop hadoop   0 Apr 22  2014 global.properties
[hadoop@master conf]$ vim azkaban.properties
复制代码

 

 

 

 

复制代码
#Azkaban
default.timezone.id=America/Los_Angeles

改为

#Azkaban
default.timezone.id=Asia/Shanghai
复制代码

 

 

 

 

 修改mysql连接,可自行修改

复制代码
database.type=mysql
mysql.port=3306
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100
复制代码

复制代码
database.type=mysql
mysql.port=3306
mysql.host=localhost
mysql.database=azkaban2
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100



改为


database.type=mysql
mysql.port=3306
mysql.host=192.168.80.145
mysql.database=azkaban
mysql.user=azkaban
mysql.password=azkaban
mysql.numconnections=100
复制代码

 

 

 

 

 

 配置端口,默认就好

executor.maxThreads=50
executor.port=12321
executor.flow.threads=30

 

 

 

 

   在web server 的azkaban.properties配置executor的连接,特别注意,如果两个server不是在一台主机上,web server 需要配置executor.host

# Azkaban Executor settings
executor.port=12321
executor.host=ip/hostname

  我这里,仅仅是都安装在单节点master即同一台机器上,所以上述这一小步骤省略。

 

 

 

 

 

 

五、启动验证

启动web server

~/app/azkaban/azkaban-web-2.5.0/bin/azkaban-web-start.sh(azkaban-web-shutdown.sh停止)
 访问 https://master:8443   出现界面安装成功

 访问 https://192.168.80.145:8443   出现界面安装成功

 

 

复制代码
[hadoop@master azkaban-web-2.5.0]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0
[hadoop@master azkaban-web-2.5.0]$ ll
total 32
-rw-r--r-- 1 hadoop hadoop  105 Apr 22  2014 azkaban.version
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 bin
drwxr-xr-x 2 hadoop hadoop 4096 May  1 15:27 conf
drwxr-xr-x 2 hadoop hadoop 4096 May  1 14:43 extlib
-rw-rw-r-- 1 hadoop hadoop 2211 May  1 14:39 keystore
drwxr-xr-x 2 hadoop hadoop 4096 May  1 14:29 lib
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 plugins
drwxr-xr-x 6 hadoop hadoop 4096 May  1 14:29 web
[hadoop@master azkaban-web-2.5.0]$ bin/azkaban-web-start.sh
Using Hadoop from /home/hadoop/app/hadoop-2.6.0
Using Hive from /home/hadoop/app/hive
bin/..
/home/hadoop/app/jdk/lib:.:/home/hadoop/app/jdk/lib:/home/hadoop/app/jdk/jre/lib:bin/../lib/azkaban-2.5.0.jar:bin/../lib/commons-collections-3.2.1.jar:bin/../lib/commons-configuration-1.8.jar:bin/../lib/commons-dbcp-1.4.jar:bin/../lib/commons-dbutils-1.5.jar:bin/../lib/commons-email-1.2.jar:bin/../lib/commons-fileupload-1.2.1.jar:bin/../lib/commons-io-2.4.jar:bin/../lib/commons-jexl-2.1.1.jar:bin/../lib/commons-lang-2.6.jar:bin/../lib/commons-logging-1.1.1.jar:bin/../lib/commons-pool-1.6.jar:bin/../lib/guava-13.0.1.jar:bin/../lib/h2-1.3.170.jar:bin/../lib/httpclient-4.2.1.jar:bin/../lib/httpcore-4.2.1.jar:bin/../lib/jackson-core-asl-1.9.5.jar:bin/../lib/jackson-mapper-asl-1.9.5.jar:bin/../lib/jetty-6.1.26.jar:bin/../lib/jetty-util-6.1.26.jar:bin/../lib/joda-time-2.0.jar:bin/../lib/jopt-simple-4.3.jar:bin/../lib/junit-4.8.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/mail-1.4.5.jar:bin/../lib/mysql-connector-java-5.1.28.jar:bin/../lib/servlet-api-2.5.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.4.jar:bin/../lib/velocity-1.7.jar:bin/../lib/velocity-tools-2.0.jar:bin/../extlib/mysql-connector-java-5.1.21.jar:bin/../plugins/*/*.jar:/home/hadoop/app/hadoop-2.6.0/conf:/home/hadoop/app/hadoop-2.6.0/*:/home/hadoop/app/hive/conf:/home/hadoop/app/hive/lib/*
[hadoop@master azkaban-web-2.5.0]$ 2017/05/01 15:35:30.167 +0800 ERROR [AzkabanWebServer] [Azkaban] Starting Jetty Azkaban Executor...
2017/05/01 15:35:30.278 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from bin/../conf
2017/05/01 15:35:30.280 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2017/05/01 15:35:30.338 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up Jetty Https Server with port:8443 and numThreads:25
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/app/azkaban/azkaban-web-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/app/hive-1.0.0/lib/hive-jdbc-1.0.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.

2017/05/01 15:35:30.532 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2017/05/01 15:35:30.897 +0800 INFO [AzkabanWebServer] [Azkaban] Loading user manager class azkaban.user.XmlUserManager
2017/05/01 15:35:31.352 +0800 INFO [XmlUserManager] [Azkaban] Loading user azkaban
2017/05/01 15:35:31.359 +0800 INFO [XmlUserManager] [Azkaban] Loading user metrics
2017/05/01 15:35:31.360 +0800 INFO [XmlUserManager] [Azkaban] Loading user admin
2017/05/01 15:35:33.429 +0800 INFO [AzkabanWebServer] [Azkaban] Loading JDBC for project management
2017/05/01 15:35:33.450 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old logs from execution_logs
2017/05/01 15:35:33.480 +0800 INFO [ProjectManager] [Azkaban] Project version retention is set to 3
2017/05/01 15:35:34.233 +0800 INFO [ExecutorManager] [Azkaban] Cleaning old log files before 2017-02-06T15:35:33.601+08:00
2017/05/01 15:35:34.283 +0800 INFO [ExecutorManager] [Azkaban] Cleaned up 0 log entries.
2017/05/01 15:35:34.483 +0800 INFO [TriggerManager] [Azkaban] TriggerManager loaded.
2017/05/01 15:35:34.484 +0800 INFO [AzkabanWebServer] [Azkaban] Loading built-in checker and action types
2017/05/01 15:35:34.533 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker BasicTimeChecker
2017/05/01 15:35:34.533 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker SlaChecker
2017/05/01 15:35:34.534 +0800 INFO [CheckerTypeLoader] [Azkaban] Registering checker ExecutionChecker
2017/05/01 15:35:34.534 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action ExecuteFlowAction
2017/05/01 15:35:34.535 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action KillExecutionAction
2017/05/01 15:35:34.550 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action AlertAction
2017/05/01 15:35:34.566 +0800 INFO [ActionTypeLoader] [Azkaban] Registering action CreateTriggerAction
2017/05/01 15:35:34.582 +0800 INFO [AzkabanWebServer] [Azkaban] Loading trigger based scheduler
2017/05/01 15:35:34.620 +0800 INFO [AzkabanWebServer] [Azkaban] Loading plug-in checker and action types
2017/05/01 15:35:34.621 +0800 ERROR [AzkabanWebServer] [Azkaban] plugin path plugins/triggers doesn't exist!
2017/05/01 15:35:34.623 +0800 INFO [AzkabanWebServer] [Azkaban] Setting timezone to Asia/Shanghai
2017/05/01 15:35:34.627 +0800 INFO [AzkabanWebServer] [Azkaban] Registering MBeans...
2017/05/01 15:35:34.747 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2017/05/01 15:35:34.755 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxTriggerManager registered.
2017/05/01 15:35:34.765 +0800 INFO [AzkabanWebServer] [Azkaban] Bean azkaban.jmx.JmxExecutorManager registered.
2017/05/01 15:35:34.770 +0800 INFO [AzkabanWebServer] [Azkaban] Setting up web resource dir web/
2017/05/01 15:35:34.952 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loading all triggers from db.
2017/05/01 15:35:35.047 +0800 INFO [JdbcTriggerLoader] [Azkaban] Loaded 0 triggers.

2017/05/01 15:35:35.048 +0800 INFO [log] [Azkaban] jetty-6.1.26
2017/05/01 15:35:36.445 +0800 INFO [log] [Azkaban] Started SslSocketConnector@0.0.0.0:8443
2017/05/01 15:35:36.446 +0800 INFO [AzkabanWebServer] [Azkaban] Server running on ssl port 8443.

复制代码

 

 

 

 

   这里的用户名好密码都是我们在配置文件里,设置的azkaban

 

 

 

 

 

 

 

 

 

 

 

 

 

 

启动 executor server

~/app/azkaban/azkaban-executor-2.5.0/bin/azkaban-executor-start.sh(azkaban-executor-shutdown.sh 停止

 

复制代码
[hadoop@master azkaban-executor-2.5.0]$ pwd
/home/hadoop/app/azkaban/azkaban-executor-2.5.0
[hadoop@master azkaban-executor-2.5.0]$ ll
total 24
-rw-r--r-- 1 hadoop hadoop  105 Apr 22  2014 azkaban.version
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 bin
drwxr-xr-x 2 hadoop hadoop 4096 May  1 15:34 conf
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 extlib
drwxr-xr-x 2 hadoop hadoop 4096 May  1 15:21 lib
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 plugins
[hadoop@master azkaban-executor-2.5.0]$ bin/azkaban-executor-start.sh
Using Hadoop from /home/hadoop/app/hadoop-2.6.0
Using Hive from /home/hadoop/app/hive
bin/..
/home/hadoop/app/jdk/lib:.:/home/hadoop/app/jdk/lib:/home/hadoop/app/jdk/jre/lib:bin/../lib/azkaban-2.5.0.jar:bin/../lib/commons-collections-3.2.1.jar:bin/../lib/commons-configuration-1.8.jar:bin/../lib/commons-dbcp-1.4.jar:bin/../lib/commons-dbutils-1.5.jar:bin/../lib/commons-email-1.2.jar:bin/../lib/commons-fileupload-1.2.1.jar:bin/../lib/commons-io-2.4.jar:bin/../lib/commons-jexl-2.1.1.jar:bin/../lib/commons-lang-2.6.jar:bin/../lib/commons-logging-1.1.1.jar:bin/../lib/commons-pool-1.6.jar:bin/../lib/guava-13.0.1.jar:bin/../lib/h2-1.3.170.jar:bin/../lib/httpclient-4.2.1.jar:bin/../lib/httpcore-4.2.1.jar:bin/../lib/jackson-core-asl-1.9.5.jar:bin/../lib/jackson-mapper-asl-1.9.5.jar:bin/../lib/jetty-6.1.26.jar:bin/../lib/jetty-util-6.1.26.jar:bin/../lib/joda-time-2.0.jar:bin/../lib/jopt-simple-4.3.jar:bin/../lib/junit-4.8.jar:bin/../lib/log4j-1.2.16.jar:bin/../lib/mail-1.4.5.jar:bin/../lib/mysql-connector-java-5.1.28.jar:bin/../lib/servlet-api-2.5.jar:bin/../lib/slf4j-api-1.6.1.jar:bin/../lib/slf4j-log4j12-1.6.4.jar:bin/../lib/velocity-1.7.jar:bin/../lib/velocity-tools-2.0.jar:bin/../extlib/*.jar:bin/../plugins/*/*.jar:/home/hadoop/app/hadoop-2.6.0/conf:/home/hadoop/app/hadoop-2.6.0/*:/home/hadoop/app/hive/conf:/home/hadoop/app/hive/lib/*
Starting AzkabanExecutorServer on port 12321 ...
[hadoop@master azkaban-executor-2.5.0]$ 2017/05/01 15:43:52.101 +0800 ERROR [AzkabanExecutorServer] [Azkaban] Starting Jetty Azkaban Executor...
2017/05/01 15:43:52.180 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban settings file from bin/../conf
2017/05/01 15:43:52.182 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban private properties file
2017/05/01 15:43:52.187 +0800 INFO [AzkabanServer] [Azkaban] Loading azkaban properties file
2017/05/01 15:43:52.285 +0800 INFO [AzkabanExecutorServer] [Azkaban] Setting timezone to Asia/Shanghai
SLF4J: Class path contains multiple SLF4J bindings.
SLF4J: Found binding in [jar:file:/home/hadoop/app/azkaban/azkaban-executor-2.5.0/lib/slf4j-log4j12-1.6.4.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: Found binding in [jar:file:/home/hadoop/app/hive-1.0.0/lib/hive-jdbc-1.0.0-standalone.jar!/org/slf4j/impl/StaticLoggerBinder.class]
SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2017/05/01 15:43:52.430 +0800 INFO [log] [Azkaban] Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
2017/05/01 15:43:53.334 +0800 INFO [FlowRunnerManager] [Azkaban] Execution dir retention set to 86400000 ms
2017/05/01 15:43:53.388 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning recently finished
2017/05/01 15:43:53.389 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old projects
2017/05/01 15:43:53.390 +0800 INFO [FlowRunnerManager] [Azkaban] Cleaning old execution dirs
2017/05/01 15:43:53.431 +0800 INFO [AzkabanExecutorServer] [Azkaban] Registering MBeans...
2017/05/01 15:43:53.610 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxJettyServer registered.
2017/05/01 15:43:53.639 +0800 INFO [AzkabanExecutorServer] [Azkaban] Bean azkaban.jmx.JmxFlowRunnerManager registered.
2017/05/01 15:43:53.640 +0800 INFO [log] [Azkaban] jetty-6.1.26
2017/05/01 15:43:53.861 +0800 INFO [log] [Azkaban] Started SocketConnector@0.0.0.0:12321
2017/05/01 15:43:53.862 +0800 INFO [AzkabanExecutorServer] [Azkaban] Azkaban Executor Server started on port 12321
复制代码

 

   如何停止

复制代码
[hadoop@master azkaban-web-2.5.0]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0
[hadoop@master azkaban-web-2.5.0]$ jps
5676 AzkabanWebServer
5866 AzkabanExecutorServer
6026 Jps
复制代码

 

 

 

 

复制代码
[hadoop@master azkaban-executor-2.5.0]$ pwd
/home/hadoop/app/azkaban/azkaban-executor-2.5.0
[hadoop@master azkaban-executor-2.5.0]$ ll
total 44
-rw-rw-r-- 1 hadoop hadoop    0 May  1 15:43 azkaban-access.log
-rw-r--r-- 1 hadoop hadoop  105 Apr 22  2014 azkaban.version
-rw-rw-r-- 1 hadoop hadoop  302 May  1 15:43 azkaban-webserver.log
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 bin
drwxr-xr-x 2 hadoop hadoop 4096 May  1 15:34 conf
-rw-rw-r-- 1 hadoop hadoop    5 May  1 15:43 currentpid
drwxrwxr-x 2 hadoop hadoop 4096 May  1 15:43 executions
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 extlib
drwxr-xr-x 2 hadoop hadoop 4096 May  1 15:21 lib
drwxr-xr-x 2 hadoop hadoop 4096 Apr 22  2014 plugins
drwxrwxr-x 2 hadoop hadoop 4096 May  1 15:43 projects
drwxrwxr-x 2 hadoop hadoop 4096 May  1 15:43 temp
[hadoop@master azkaban-executor-2.5.0]$ bin/azkaban-executor-shutdown.sh



[hadoop@master azkaban-executor-2.5.0]$ jps
5676 AzkabanWebServer
6111 Jps
[hadoop@master azkaban-executor-2.5.0]$ 
复制代码

 

 

 

 

 

 

复制代码
[hadoop@master azkaban-web-2.5.0]$ pwd
/home/hadoop/app/azkaban/azkaban-web-2.5.0
[hadoop@master azkaban-web-2.5.0]$ jps
5676 AzkabanWebServer
6087 Jps
[hadoop@master azkaban-web-2.5.0]$ bin/azkaban-web-shutdown.sh
复制代码

    或kill掉

复制代码
[hadoop@master azkaban-web-2.5.0]$ jps
6128 Jps
5676 AzkabanWebServer
[hadoop@master azkaban-web-2.5.0]$ kill -9 5676
[hadoop@master azkaban-web-2.5.0]$ jps
6138 Jps
[hadoop@master azkaban-web-2.5.0]$ 
复制代码

  这里不多赘述了。

 

 

 

 

 

   

六、Azkaban web server插件安装(暂时没用上,不先写了)

  为了后边插件的安装,需要在${AZKABAN_WEB_SERVER}/plugins/目录下创建viewer目录,用来安装各种viewer插件。当安装好一个插件后需要重启服务,让插件生效。

安装HDFS Viewer插件

 1.解压插件

  解压插件 在viewer目录中解压azkaban-hdfs-viewer-2.5.0.tar.gz,得到azkaban-hdfs-viewer-2.5.0目录,将其更名为hdfs。最终,这个插件的目录路径是:${AZKABAN_WEB_SERVER}/plugins/viewer/hdfs。

 

 

安装Job Summary插件

 

 

安装Reportal插件

 

 

 

七、Azkaban Executor Server 插件安装(暂时没用上,不先写了)

 

   进入${AZKABAN_EXECUTOR_SERVER}/plugins目录,在该目录下解压azkaban-jobtype-2.5.0.tar.gz得到目录:azkaban-jobtype-2.5.0。将该目录更名为jobtypes。这个目录用来存放之后安装的所有插件,与Web Server中的viewer目录类似。每次插件的安装配置需要重启Executor Server。

 

 

 

 

安装Reportalhive插件

 


本文转自大数据躺过的坑博客园博客,原文链接:http://www.cnblogs.com/zlslch/p/6296283.html,如需转载请自行联系原作者

相关实践学习
如何在云端创建MySQL数据库
开始实验后,系统会自动创建一台自建MySQL的 源数据库 ECS 实例和一台 目标数据库 RDS。
全面了解阿里云能为你做什么
阿里云在全球各地部署高效节能的绿色数据中心,利用清洁计算为万物互联的新世界提供源源不断的能源动力,目前开服的区域包括中国(华北、华东、华南、香港)、新加坡、美国(美东、美西)、欧洲、中东、澳大利亚、日本。目前阿里云的产品涵盖弹性计算、数据库、存储与CDN、分析与搜索、云通信、网络、管理与监控、应用服务、互联网中间件、移动服务、视频服务等。通过本课程,来了解阿里云能够为你的业务带来哪些帮助 &nbsp; &nbsp; 相关的阿里云产品:云服务器ECS 云服务器 ECS(Elastic Compute Service)是一种弹性可伸缩的计算服务,助您降低 IT 成本,提升运维效率,使您更专注于核心业务创新。产品详情: https://www.aliyun.com/product/ecs
相关文章
|
1月前
|
Java API 数据库
构建RESTful API已经成为现代Web开发的标准做法之一。Spring Boot框架因其简洁的配置、快速的启动特性及丰富的功能集而备受开发者青睐。
【10月更文挑战第11天】本文介绍如何使用Spring Boot构建在线图书管理系统的RESTful API。通过创建Spring Boot项目,定义`Book`实体类、`BookRepository`接口和`BookService`服务类,最后实现`BookController`控制器来处理HTTP请求,展示了从基础环境搭建到API测试的完整过程。
42 4
|
12天前
|
JavaScript 前端开发 开发工具
web项目规范配置(husky、eslint、lint-staged、commit)
通过上述配置,可以确保在Web项目开发过程中自动进行代码质量检查和规范化提交。Husky、ESLint、lint-staged和Commitlint共同作用,使得每次提交代码之前都会自动检查代码风格和语法问题,防止不符合规范的代码进入代码库。这不仅提高了代码质量,还保证了团队协作中的一致性。希望这些配置指南能帮助你建立高效的开发流程。
30 5
|
1月前
|
编解码 前端开发 JavaScript
使用 CSS 打印样式为 Web 页面设置专业的打印机效果
使用 CSS 打印样式为 Web 页面设置专业的打印机效果
50 2
|
1月前
|
监控 Java Maven
springboot学习二:springboot 初创建 web 项目、修改banner、热部署插件、切换运行环境、springboot参数配置,打包项目并测试成功
这篇文章介绍了如何快速创建Spring Boot项目,包括项目的初始化、结构、打包部署、修改启动Banner、热部署、环境切换和参数配置等基础操作。
120 0
|
1月前
|
网络协议 Windows
Windows Server 2019 Web服务器搭建
Windows Server 2019 Web服务器搭建
|
1月前
|
NoSQL Java 数据库连接
springBoot:整合其他框架&condition&切换web配置 (五)
本文档介绍了如何在Spring Boot项目中整合JUnit、Redis和MyBatis等框架,并提供了相应的依赖配置示例。同时,还展示了如何通过条件注解实现Bean的条件创建,以及如何切换Web服务器配置,从默认的Tomcat切换到Jetty。
|
1月前
|
XML JSON API
ServiceStack:不仅仅是一个高性能Web API和微服务框架,更是一站式解决方案——深入解析其多协议支持及简便开发流程,带您体验前所未有的.NET开发效率革命
【10月更文挑战第9天】ServiceStack 是一个高性能的 Web API 和微服务框架,支持 JSON、XML、CSV 等多种数据格式。它简化了 .NET 应用的开发流程,提供了直观的 RESTful 服务构建方式。ServiceStack 支持高并发请求和复杂业务逻辑,安装简单,通过 NuGet 包管理器即可快速集成。示例代码展示了如何创建一个返回当前日期的简单服务,包括定义请求和响应 DTO、实现服务逻辑、配置路由和宿主。ServiceStack 还支持 WebSocket、SignalR 等实时通信协议,具备自动验证、自动过滤器等丰富功能,适合快速搭建高性能、可扩展的服务端应用。
100 3
|
15天前
|
设计模式 前端开发 数据库
Python Web开发:Django框架下的全栈开发实战
【10月更文挑战第27天】本文介绍了Django框架在Python Web开发中的应用,涵盖了Django与Flask等框架的比较、项目结构、模型、视图、模板和URL配置等内容,并展示了实际代码示例,帮助读者快速掌握Django全栈开发的核心技术。
101 44
|
11天前
|
前端开发 API 开发者
Python Web开发者必看!AJAX、Fetch API实战技巧,让前后端交互如丝般顺滑!
在Web开发中,前后端的高效交互是提升用户体验的关键。本文通过一个基于Flask框架的博客系统实战案例,详细介绍了如何使用AJAX和Fetch API实现不刷新页面查看评论的功能。从后端路由设置到前端请求处理,全面展示了这两种技术的应用技巧,帮助Python Web开发者提升项目质量和开发效率。
26 1
|
13天前
|
XML 安全 PHP
PHP与SOAP Web服务开发:基础与进阶教程
本文介绍了PHP与SOAP Web服务的基础和进阶知识,涵盖SOAP的基本概念、PHP中的SoapServer和SoapClient类的使用方法,以及服务端和客户端的开发示例。此外,还探讨了安全性、性能优化等高级主题,帮助开发者掌握更高效的Web服务开发技巧。

热门文章

最新文章