AI 助理
备案控制台
开发者社区 数据库 文章 正文

企业实际应用之同步远程yum源到本地

2017-11-15 1482
版权
版权声明：
本文内容由阿里云实名注册用户自发贡献，版权归原作者所有，阿里云开发者社区不拥有其著作权，亦不承担相应法律责任。具体规则请查看《 阿里云开发者社区用户服务协议》和 《阿里云开发者社区知识产权保护指引》。如果您发现本社区中有涉嫌抄袭的内容，填写 侵权投诉表单进行举报，一经查实，本社区将立刻删除涉嫌侵权内容。
本文涉及的产品
全局流量管理 GTM，标准版 1个月
云解析 DNS，旗舰版 1个月
公共DNS（含HTTPDNS解析），每月1000万次HTTP解析
简介：

最近在弄平台化工作，目前公网dns已经弄完，这样解析工作就很方便了，同时作为公网dns，就不需要每台主机添加nameserver来执行ip，下一步需要弄本地yum源，如果不弄的话，如果机房服务器过多，多个同时yum安装软件的话，很浪费带宽，而且yum源还不容易控制，比如有的软件安装需要epel源，有的需要rpmforge源，所以为了方便管理与控制，在机房内网搭建了一个本地yum源，同步远程的base、epel与rpmforge源（主要是centos 5与6系统的32位于64位的源），内网的主机都通过dns解析后的域名来进行访问。

一、同步远程yum源到本地

下面是我的同步脚本

#!/bin/bash
#Script name:rsync_yumrepo.sh
RsyncBin="/usr/local/rsync-3.1.0/bin/rsync"
RsyncPerm='-avrt --delete --no-iconv --bwlimit=1000'
Centos_5_base='/data/yum_repo/Centos-5/Base/'
Centos_5_epel='/data/yum_repo/Centos-5/Epel/'
Centos_5_rpmforge='/data/yum_repo/Centos-5/Rpmforge/'
Centos_6_base='/data/yum_repo/Centos-6/Base/'
Centos_6_epel='/data/yum_repo/Centos-6/Epel/'
Centos_6_rpmforge='/data/yum_repo/Centos-6/Rpmforge/'
LogFile='/data/yum_repo/rsync_yum_log'
Date=`date +%Y-%m-%d`
#check
function check {
if [ $? -eq 0 ];then
    echo -e "\033[1;32mRsync is success!\033[0m" >>$LogFile/$Date.log
else
    echo -e "\033[1;31mRsync is fail!\033[0m" >>$LogFile/$Date.log
fi
}
if [ ! -d "$LogFile" ];then
    mkdir $LogFile
fi
#rsync centos 5 base
echo 'Now start to rsync centos 5 base!' >>$LogFile/$Date.log
$RsyncBin $RsyncPerm rsync://mirrors.yun-idc.com/centos/5/os/ $Centos_5_base >>$LogFile/$Date.log
check
#rsync centos 5 epel
echo 'Now start to rsync centos 5 epel!' >>$LogFile/$Date.log
$RsyncBin $RsyncPerm --exclude=SRPMS/ --exclude=ppc/ rsync://mirrors.yun-idc.com/epel/5/ $Centos_5_epel >>$LogFile/$Date.log
check
#rsync centos 5 rpmforge
echo 'Now start to rsync centos 5 i386 rpmforge!' >>$LogFile/$Date.log
$RsyncBin $RsyncPerm rsync://ftp-stud.fht-esslingen.de/dag/redhat/el5/en/i386/rpmforge/ $Centos_5_rpmforge/i386/ >>$LogFile/$Date.log
check
echo 'Now start to rsync centos 5 x86_64 rpmforge!' >>$LogFile/$Date.log
$RsyncBin $RsyncPerm rsync://ftp-stud.fht-esslingen.de/dag/redhat/el5/en/x86_64/rpmforge/ $Centos_5_rpmforge/x86_64/ >>$LogFile/$Date.log
check
#rsync centos 6 base
echo 'Now start to rsync centos 6 base!' >>$LogFile/$Date.log
$RsyncBin $RsyncPerm rsync://mirrors.yun-idc.com/centos/6/os/ $Centos_6_base >>$LogFile/$Date.log
check
#rsync centos 6 epel
echo 'Now start to rsync centos 6 epel!' >>$LogFile/$Date.log
$RsyncBin  $RsyncPerm --exclude=SRPMS/ --exclude=ppc64/ rsync://mirrors.yun-idc.com/epel/6/ $Centos_6_epel  >>$LogFile/$Date.log
check
#rsync centos 6 rpmforge
echo 'Now start to rsync centos 6 i386 rpmforge!' >>$LogFile/$Date.log
$RsyncBin $RsyncPerm rsync://ftp-stud.fht-esslingen.de/dag/redhat/el6/en/i386/rpmforge/ $Centos_6_rpmforge/i386/ >>$LogFile/$Date.log
check
echo 'Now start to rsync centos 6 x86_64 rpmforge!' >>$LogFile/$Date.log
$RsyncBin $RsyncPerm rsync://ftp-stud.fht-esslingen.de/dag/redhat/el6/en/x86_64/rpmforge/ $Centos_6_rpmforge/x86_64/ >>$LogFile/$Date.log
check

主要是使用rsync（最新的3.1.0版本），然后然后tcp模式来进行连接，同步mirrors.yun-idc.com的base与epel源到本地，同步ftp-stud.fht-esslingen.de的rpmforge源到本地。然后文件目录与rsync参数自己根据需求修改。

把这个脚本放到crontab里，让它每天凌晨同步

00 02 * * * /bin/bash /data/yum_repo/rsync_yum_shell/rsync_yumrepo.sh

同步后会有一个日子记录，下面是我的日志

Now start to rsync centos 5 base!
*****************************************************
Welcome to CDS(yun-idc.com) Mirror Site Rsync Server!
*****************************************************
receiving incremental file list
sent 42 bytes  received 305,322 bytes  55,520.73 bytes/sec
total size is 10,349,249,542  speedup is 33,891.52
Rsync is success!
Now start to rsync centos 5 epel!
*****************************************************
Welcome to CDS(yun-idc.com) Mirror Site Rsync Server!
*****************************************************
receiving incremental file list
sent 64 bytes  received 1,284,809 bytes  856,582.00 bytes/sec
total size is 17,669,250,363  speedup is 13,751.75
Rsync is success!
Now start to rsync centos 5 i386 rpmforge!
Welcome to the ftp-stud.hs-esslingen.de archives.
If have any unusual problems, please report them via e-mail to
rsync@ftp-stud.hs-esslingen.de.
  All transfers are logged.
  If you don't like this policy, then disconnect now.
  This server does not support --checksum (-c)
  This server does not support --compress (-z)
receiving incremental file list
./
RPMS/
sent 33 bytes  received 548,502 bytes  84,390.00 bytes/sec
total size is 6,891,180,123  speedup is 12,562.88
Rsync is success!
Now start to rsync centos 5 x86_64 rpmforge!
Welcome to the ftp-stud.hs-esslingen.de archives.
If have any unusual problems, please report them via e-mail to
rsync@ftp-stud.hs-esslingen.de.
  All transfers are logged.
  If you don't like this policy, then disconnect now.
  This server does not support --checksum (-c)
  This server does not support --compress (-z)
receiving incremental file list
./
RPMS/
sent 33 bytes  received 551,172 bytes  100,219.09 bytes/sec
total size is 6,500,184,928  speedup is 11,792.68
Rsync is success!
Now start to rsync centos 6 base!
*****************************************************
Welcome to CDS(yun-idc.com) Mirror Site Rsync Server!
*****************************************************
receiving incremental file list
sent 42 bytes  received 546,204 bytes  364,164.00 bytes/sec
total size is 11,109,838,945  speedup is 20,338.53
Rsync is success!
Now start to rsync centos 6 epel!
*****************************************************
Welcome to CDS(yun-idc.com) Mirror Site Rsync Server!
*****************************************************
receiving incremental file list
sent 66 bytes  received 1,749,197 bytes  233,235.07 bytes/sec
total size is 30,814,156,298  speedup is 17,615.51
Rsync is success!
Now start to rsync centos 6 i386 rpmforge!
Welcome to the ftp-stud.hs-esslingen.de archives.
If have any unusual problems, please report them via e-mail to
rsync@ftp-stud.hs-esslingen.de.
  All transfers are logged.
  If you don't like this policy, then disconnect now.
  This server does not support --checksum (-c)
  This server does not support --compress (-z)
receiving incremental file list
./
RPMS/
sent 33 bytes  received 225,253 bytes  50,063.56 bytes/sec
total size is 2,342,484,019  speedup is 10,397.82
Rsync is success!
Now start to rsync centos 6 x86_64 rpmforge!
Welcome to the ftp-stud.hs-esslingen.de archives.
If have any unusual problems, please report them via e-mail to
rsync@ftp-stud.hs-esslingen.de.
  All transfers are logged.
  If you don't like this policy, then disconnect now.
  This server does not support --checksum (-c)
  This server does not support --compress (-z)
receiving incremental file list
./
RPMS/
sent 33 bytes  received 226,542 bytes  50,350.00 bytes/sec
total size is 2,180,556,413  speedup is 9,623.99
Rsync is success!

上面日志都是没有新的同步情况，是因为我之前已经同步完成，远程源没有变化所以我本地也没有变更，下面是我同步的网卡流量监控情况

111034668.jpg

可以看到传输的最大速度是8.65Mbs

二、客户端的repo文件

1、配置web服务器，我选择nginx

我的vhost配置为

server {
        listen       80;
    server_name yum-server.****.net;
    index index.html index.htm index.php;
    root  /data/yum_repo/;
    error_page 502 = /502.html;
    location ~ .*\.(php|php5)?$ {
                #fastcgi_pass  unix:/tmp/php-cgi.sock;
        fastcgi_pass  127.0.0.1:9000;
        fastcgi_index index.php;
        include fastcgi.conf;
    }
    location ~ .*\.(gif|jpg|jpeg|png|bmp|swf|mp3)$ {
        expires      30d;
    }
    location ~ .*\.(js|css)?$ {
        expires      12h;
    }
}
    log_format  access  '$remote_addr - $remote_user [$time_local] "$request" '
        '$status $body_bytes_sent "$http_referer" '
        '"$http_user_agent" $http_x_forwarded_for';
   access_log  /data/logs/access.log  access;

这个servername是你在dns里设置的名称，为了保密我没有写我真实的dns，大家可以根据自己的需求修改。

2、repo文件

Centos-Base-5.repo

[Base]
name=CentOS-Base5 $basearch
baseurl=http://yum-server.****.net/Centos-5/Base/$basearch
enable=1
gpgcheck=1
gpgkey=http://yum-server.****.net/Centos-5/Base/$basearch/RPM-GPG-KEY-CentOS-5
[Epel]
name=CentOS-Base5 $basearch
baseurl=http://yum-server.****.net/Centos-5/Epel/$basearch
enable=1
gpgcheck=0
[Rpmforge]
name=CentOS-Base5 $basearch
baseurl=http://yum-server.****.net/Centos-5/Rpmforge/$basearch
enable=1
gpgcheck=0

Centos-Base-6.repo

[Base]
name=CentOS-Base6 $basearch
baseurl=http://yum-server.****.net/Centos-6/Base/$basearch
enable=1
gpgcheck=1
gpgkey=http://yum-server.****.net/Centos-6/Base/$basearch/RPM-GPG-KEY-CentOS-6
[Epel]
name=CentOS-Base6 $basearch
baseurl=http://yum-server.****.net/Centos-6/Epel/$basearch
enable=1
gpgcheck=0
[Rpmforge]
name=CentOS-Base6 $basearch
baseurl=http://yum-server.****.net/Centos-6/Rpmforge/$basearch
enable=1
gpgcheck=0

然后进行下面操作：

1、按照不同的系统选择不同的repo文件，放到服务器的/etc/yum.repos.d里；

2、删除之前/etc/yum.repos.d里的repo；

3、清理缓存yum clean all；

4、将服务器上的软件包信息现在本地缓存,以提高搜索安装软件的速度 yum makecache.

[root@ip-10-10-13-8 bin]# cd /etc/yum.repos.d
[root@ip-10-10-13-8 yum.repos.d]# ll
总用量 4
-rw-r--r-- 1 root root 453 12月 16 10:04 Centos-Base-6.repo
[root@ip-10-10-13-8 yum.repos.d]# yum clean all
Loaded plugins: aliases, changelog, downloadonly, fastestmirror, kabi, presto, security, tmprepo, verify, versionlock
Loading support for CentOS kernel ABI
Cleaning repos: Base Epel Rpmforge
Cleaning up Everything
Cleaning up list of fastest mirrors
0 delta-package files removed, by presto
[root@ip-10-10-13-8 yum.repos.d]# yum makecache
Loaded plugins: aliases, changelog, downloadonly, fastestmirror, kabi, presto, security, tmprepo, verify, versionlock
Loading support for CentOS kernel ABI
Determining fastest mirrors
Base                                                                                                                                                                    | 3.7 kB     00:00   
Base/group_gz                                                                                                                                                           | 220 kB     00:00   
Base/filelists_db                                                                                                                                                       | 5.9 MB     00:00   
Base/primary_db                                                                                                                                                         | 4.4 MB     00:00   
Base/other_db                                                                                                                                                           | 2.8 MB     00:00   
Epel                                                                                                                                                                    | 4.2 kB     00:00   
Epel/group_gz                                                                                                                                                           | 237 kB     00:00   
Epel/filelists_db                                                                                                                                                       | 7.9 MB     00:00   
Epel/primary_db                                                                                                                                                         | 5.7 MB     00:00   
Epel/other_db                                                                                                                                                           | 3.3 MB     00:00   
Epel/updateinfo                                                                                                                                                         | 678 kB     00:00   
Rpmforge                                                                                                                                                                | 1.9 kB     00:00   
Rpmforge/filelists_db                                                                                                                                                   | 2.3 MB     00:00   
Rpmforge/primary_db                                                                                                                                                     | 2.7 MB     00:00   
Rpmforge/other_db                                                                                                                                                       | 564 kB     00:00   
Metadata Cache Created
[root@ip-10-10-13-8 yum.repos.d]# yum repolist
Loaded plugins: aliases, changelog, downloadonly, fastestmirror, kabi, presto, security, tmprepo, verify, versionlock
Loading support for CentOS kernel ABI
Loading mirror speeds from cached hostfile
repo id                                                                                repo name                                                                                         status
Base                                                                                   CentOS-Base6 x86_64                                                                                6,367
Epel                                                                                   CentOS-Base6 x86_64                                                                               10,138
Rpmforge                                                                               CentOS-Base6 x86_64                                                                                4,650
repolist: 21,155
[root@ip-10-10-13-8 yum.repos.d]# yum list|grep echoping
echoping.x86_64                          5.2.0-1.2.el6.rf               @Rpmforge

现在本地yum源就已经完成，可以控制软件源，并且由于走内网所有不浪费机房公网网络流量。


 本文转自 reinxu 51CTO博客，原文链接：http://blog.51cto.com/dl528888/1342653，如需转载请自行联系原作者






文章标签：
云解析DNS
Linux
网络协议
SQL
安全
关键词：
yum应用
技术小胖子
目录
相关文章
GG2020gg
|
6月前
|
缓存 Linux Shell
RHEL7部署http应用配置共享yum源
RHEL7部署http应用配置共享yum源
GG2020gg
254 0
快乐阿超
|
11月前
|
关系型数据库 MySQL Java
yum安装部署boot应用
yum安装部署boot应用
快乐阿超
40 0
3it3iap2n2xxu
|
Web App开发 Linux
Linux:rpm与yum(内含：1.rpm介绍+2.卸载rpm包+3.安装rpm(应用案例)+4.yum(应用案例))
Linux:rpm与yum(内含：1.rpm介绍+2.卸载rpm包+3.安装rpm(应用案例)+4.yum(应用案例))
3it3iap2n2xxu
260 0
Linux:rpm与yum(内含：1.rpm介绍+2.卸载rpm包+3.安装rpm(应用案例)+4.yum(应用案例))
技术小阿哥
|
缓存 Linux Apache
yum总结以及应用
技术小阿哥
1345 0
余二五
|
Linux 安全 缓存
Linux Yum安装配置与安装命令应用
余二五
2169 0
余二五
|
Linux Python 缓存
在RHEL 5中Yum应用大全
余二五
1181 0
科技小能手
|
Linux
yum在企业网上的应用
科技小能手
1296 0
蓝易云
|
5天前
|
存储 缓存 Linux
【Linux】另一种基于rpm安装yum的方式
通过本文的方法，您可以在离线环境中使用RPM包安装YUM并进行必要的配置。这种方法适用于无法直接访问互联网的服务器或需要严格控制软件源的环境。通过配置本地YUM仓库，确保了软件包的安装和更新可以顺利进行。希望本文能够为您在特定环境中部署YUM提供实用的指导。
蓝易云
34 0
杀死一只知更鸟debug
|
2月前
|
关系型数据库 MySQL Linux
Linux 安装 mysql【使用yum源进行安装】
这篇文章介绍了在Linux系统中使用yum源安装MySQL数据库的步骤，包括配置yum源、安装MySQL服务、启动服务以及修改root用户的默认密码。
杀死一只知更鸟debug
508 0
Linux 安装 mysql【使用yum源进行安装】
游客cxtb2yf2r55as
|
1月前
|
Unix Linux Go
Linux 使用Yum安装Go和配置环境
Linux 使用Yum安装Go和配置环境
游客cxtb2yf2r55as
100 0