基础配置
三台环境为centos7.9，以下配置需要在每台机器上执行
配置hosts解析
cat >> /etc/hosts <<EOF 192.168.2.23 node1 192.168.2.24 node2 192.168.2.25 node3 EOF
关闭防火墙和selinux
systemctl stop firewalld && systemctl disable firewalld setenforce 0 && sed -i 's/SELINUX=enforcing/SELINUX=disabled/g' /etc/selinux/config
分别在三个节点设置主机名
hostnamectl set-hostname node1 hostnamectl set-hostname node2 hostnamectl set-hostname node3
配置主机时间同步
systemctl restart chronyd.service && systemctl enable chronyd.service
配置免密登录
ssh-keygen ssh-copy-id -i .ssh/id_rsa.pub node1 ssh-copy-id -i .ssh/id_rsa.pub node2 ssh-copy-id -i .ssh/id_rsa.pub node3
安装pip和ansible、git
yum install python-pip ansible git -y
部署ceph集群
克隆存储库
这里我选择安装的是ceph nautilus版本
git clone https://github.com/ceph/ceph-ansible.git cd ceph-ansible git checkout stable-4.0
安装ansible依赖包
pip install --upgrade pip pip install -r requirements.txt
修改hosts文件，添加安装的节点
cat >> /etc/ansible/hosts <<EOF [mons] node1 node2 node3 [osds] node1 node2 node3 [mgrs] node1 [mdss] node1 node2 node3 [clients] node1 node2 node3 [rgws] node1 node2 node3 [grafana-server] node1 EOF
备份group_vars下的yml文件
cd ceph-ansible/group_vars for file in *;do cp $file ${file%.*};done
修改group_vars/all.yml配置
--- dummy: mon_group_name: mons osd_group_name: osds rgw_group_name: rgws mds_group_name: mdss client_group_name: clients mgr_group_name: mgrs grafana_server_group_name: grafana-server configure_firewall: False ceph_origin: repository ceph_origin: repository ceph_repository: community ceph_mirror: http://mirrors.aliyun.com/ceph ceph_stable_key: http://mirrors.aliyun.com/ceph/keys/release.asc ceph_stable_release: nautilus ceph_stable_repo: "{{ ceph_mirror }}/rpm-{{ ceph_stable_release }}" public_network: "192.168.2.0/24" cluster_network: "192.168.2.0/24" monitor_interface: ens33 osd_auto_discovery: true osd_objectstore: filestore radosgw_interface: ens33 dashboard_admin_password: asd123456 grafana_admin_password: admin pg_autoscale_mode: True
修改group_vars/osds.yml配置
devices: - /dev/sdb
修改site.yml配置
开始进行安装
剩下的交给时间吧，十分钟左右就装好了
ansible-playbook -i /etc/ansible/hosts site.yml
查看安装状态，发现有一个警告，这是因为在之前的all.yml配置没有开启允许自动调整pool中的pg数pg_autoscale_mode: False，手动设置下即可
ceph osd pool set <pool-name> pg_autoscale_mode on
