keepalived+nginx+tomcat搭建高性能web服务器集群

使用keepalived+nginx+tomcat搭建高性能web服务器集群，前端用nginx做反向代理实现负载均衡，同时结合keepalived对nginx实现高可用，后端使用tomcat做动态jsp解析，实现了动静分离。

（本文永久地址：http://woymk.blog.51cto.com/10000269/1928716）

搭建环境：centos 6.9

准备四台服务器 
vip: 192.168.75.130
master: 192.168.75.131 (安装nginx做反向代理实现负载匀衡，结合keepalived实现高可用）
backup: 192.168.75.132 (同上)
web1: 192.168.75.151 (安装nginx和tomcat实现动静分离)
web2: 192.168.75.152 (同上)
这里为节省服务器，nginx和tomcat装在了一台服务上，也可以分开配置。

配置步骤如下：

1. 安装nginx、tomcat软件

四台服务器分别安装好nginx
安装方法参见：LNMP环境搭建

web1，web2上分别安装好tomcat

安装方法参见：Tomcat8.5的安装配置

web1, web2上分别启动nginx和tomcat
service nginx start
service tomcat start

2. 在master和backup上配置nginx

vi /usr/local/nginx/conf/nginx.conf

加入或修改以下内容：

    upstream web_nginx {
        server 192.168.75.151;
        server 192.168.75.152;
    }

    upstream web_tomcat {

        #ip_hash;

        server 192.168.75.151:8080;
        server 192.168.75.152:8080;
    }

    server {
        listen       80;
        server_name  localhost;

        #charset koi8-r;

        #access_log  logs/host.access.log  main;

        location / {
            proxy_pass      http://web_nginx/;
            proxy_set_header Host   $host;
            proxy_set_header X-Real-IP      $remote_addr;
            proxy_set_header X-Forwarded-For $proxy_add_x_forwarded_for;
        }

        location ~ \.jsp$ {
            proxy_pass   http://web_tomcat/;
        }

    }

分别在master和backup上启动nginx服务

service nginx start

3. 配置keepalived

在master和backup上分别安装keepalived
yum install -y keepalived

1) 配置master
vi /etc/keepalived/keepalived.conf
清空原文，加入如下内容：
! Configuration File for keepalived

global_defs {
   notification_email {
     #acassen@firewall.loc
     #failover@firewall.loc
     #sysadmin@firewall.loc
   }
   #notification_email_from Alexandre.Cassen@firewall.loc
   #smtp_server 192.168.200.1
   #smtp_connect_timeout 30
   router_id LVS_DEVEL
}

vrrp_script chk_http_port {
    script "</dev/tcp/127.0.0.1/80"
    interval 1
    weight -2
}

vrrp_instance VI_1 {
    state MASTER
    interface eth0
    virtual_router_id 51
    priority 100
    advert_int 1
    authentication {
        auth_type PASS
        auth_pass 1111
    }
    virtual_ipaddress {
        192.168.75.130
    }
    track_script {
        chk_http_port
    }
}

2) 配置backup
scp 192.168.75.131:/etc/keepalived/keepalived.conf /etc/keepalived/keepalived.conf

vi /etc/keepalived/keepalived.conf
backup的配置文件只需要修改
state MASTER  -> state BACKUP
priority 100 -> priority 99

最后，分别在master和backup上启动keepalived服务，先主后备
/etc/init.d/keepalived start

4. 测试：

在master上停止nginx服务

[root@master ~]# /etc/init.d/nginx stop
停止 nginx：                                               [确定]

在backup上查看日志

[root@backup ~]# tail -f /var/log/messages

May 23 17:21:33 backup Keepalived_vrrp[1818]: VRRP_Instance(VI_1) forcing a new MASTER election
May 23 17:21:33 backup Keepalived_vrrp[1818]: VRRP_Instance(VI_1) forcing a new MASTER election
May 23 17:21:34 backup Keepalived_vrrp[1818]: VRRP_Instance(VI_1) Transition to MASTER STATE
May 23 17:21:35 backup Keepalived_vrrp[1818]: VRRP_Instance(VI_1) Entering MASTER STATE
May 23 17:21:35 backup Keepalived_vrrp[1818]: VRRP_Instance(VI_1) setting protocol VIPs.
May 23 17:21:35 backup Keepalived_vrrp[1818]: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.75.130
May 23 17:21:35 backup Keepalived_healthcheckers[1817]: Netlink reflector reports IP 192.168.75.130 added
May 23 17:21:40 backup Keepalived_vrrp[1818]: VRRP_Instance(VI_1) Sending gratuitous ARPs on eth0 for 192.168.75.130

日志显示已经成功切换到备用节点上。

[root@backup ~]# curl 192.168.75.130 -I
HTTP/1.1 200 OK
Server: nginx/1.10.3
Date: Tue, 23 May 2017 09:34:21 GMT
Content-Type: text/html
Content-Length: 616
Connection: keep-alive
Last-Modified: Mon, 22 May 2017 10:28:07 GMT
ETag: "5922bd37-268"
Accept-Ranges: bytes

master停掉后，用curl访问web服务，一切正常。