Linux下使用Tomcat7搭建高性能Java服务器

1. 架构说明： nginx + 4个tomcat

nginx作为前端代理，并且肩负负载均衡的作用，多个tomcat可以解决单台服务器高并发的性能问题，至于后端放几个tomcat要看你的服务器有多大内存，我的服务器是4核的CPU，8G内存。

 

2. nginx安装简单说明:

编译参数：

--prefix=/opt/mysql/ --enable-assembler --with-extra-charsets=complex \

--enable-thread-safe-client --with-big-tables --with-readline --with-ssl --with-embedded-server \

--enable-local-infile --with-plugins=innobase

可以根据自己的环境修改配置

 

nginx.conf配置：

 

user  www;
worker_processes	8;
error_log	/opt/logs/nginx/default/error/log;

pid        logs/nginx.pid;

worker_rlimit_nofile	51200; 

events {
	use	epoll;
	worker_connections	1024; #有的设置到65535
}

http {

    include	mime.types;
    default_type	application/octet-stream;

	server_names_hash_bucket_size	128;
	client_header_buffer_size		128k;
	large_client_header_buffers	8	128k;
	client_max_body_size	200m;
	client_body_buffer_size	128k;
	proxy_connect_timeout	600;
	proxy_read_timeout	600;
	proxy_send_timeout	600;
	proxy_buffer_size	16k;
	proxy_buffers	4	32k;
	proxy_busy_buffers_size	64k;
	log_format main '$remote_addr $remote_user [$time_local] "$request" $status $body_bytes_sent "$http_referer" "$http_user_agent"';
	access_log	 /opt/logs/nginx/default/access/log	main;

	sendfile       on;
	tcp_nopush     on;
	tcp_nodelay	   on;

	keepalive_timeout	65;

	fastcgi_connect_timeout 300;
	fastcgi_send_timeout 300;
	fastcgi_read_timeout 300;
	fastcgi_buffer_size 64k;
	fastcgi_buffers 4 64k;
	fastcgi_busy_buffers_size 128k;
	fastcgi_temp_file_write_size 128k;

	gzip  on;
	gzip_min_length		1k;
	gzip_buffers		4 16k;
	gzip_comp_level		8;
	gzip_http_version	1.1;
	gzip_types		text/plain	application/xml;
	gzip_vary		on;

	proxy_temp_path	/opt/nginx_cache/proxy_temp_path;
	proxy_cache_path  /opt/nginx_cache/proxy_cache_path levels=1:2 keys_zone=cache_one:200m inactive=1d max_size=30g;

    upstream testservers { 
        server 127.0.0.1:8080 weight=1 max_fails=2 fail_timeout=30s; 
        server 127.0.0.1:8081 weight=1 max_fails=2 fail_timeout=30s;
        server 127.0.0.1:8082 weight=1 max_fails=2 fail_timeout=30s;
        server 127.0.0.1:8083 weight=1 max_fails=2 fail_timeout=30s;
    }
 
    server {
	    listen	80;
	    server_name test.com;

        index index.html index.htm index.php index.jsp;

		charset	utf-8;

		location ~ .*\.(js|jpg|JPG|jpeg|JPEG|bmp|gif|GIF)$ {

			proxy_cache cache_one;
			proxy_cache_valid 200 304 1h;
			proxy_cache_valid 301 302 1m;
			proxy_cache_valid any 1m;
			proxy_cache_key $host$uri$is_args$args;

			proxy_pass          http://testervers;
			proxy_redirect      default;
			proxy_set_header    X-Forwarded-For            $proxy_add_x_forwarded_for;
			proxy_set_header    X-Real-IP $remote_addr;
			proxy_set_header    Host $http_host;
			proxy_set_header	Range $http_range;

			proxy_next_upstream http_502 http_504 error timeout invalid_header;
		}
		
		location / {

			proxy_pass          http://testservers;
			proxy_redirect      default;
			proxy_set_header    X-Forwarded-For $proxy_add_x_forwarded_for;
			proxy_set_header    X-Real-IP $remote_addr;
			proxy_set_header    Host $http_host;
            proxy_set_header    Range $http_range;

			proxy_next_upstream http_502 http_504 error timeout invalid_header;
		}

                # 对管理后台进行访问限制
        location ^~/manager/ {
            allow 你的IP;
            deny all;

            proxy_pass          http://testservers;
            proxy_redirect      default;
            proxy_set_header    X-Forwarded-For $proxy_add_x_forwarded_for;
            proxy_set_header    X-Real-IP $remote_addr;
            proxy_set_header    Host $http_host;
            proxy_set_header    Range $http_range;

            proxy_next_upstream http_502 http_504 error timeout invalid_header;

        }

        }
    }

}

 

从上面配置可以看出，nginx会把http请求均匀分发给8080,8081,8082,8083几个端口的后端服务，实现负载均衡的效果。

 

3.  Tomcat 配置

 

server.xml配置，由于一个<Service></Service>会启动一个实例，所以我们这里要启动4个tomcat实例就设置4个Service :

 

<?xml version='1.0' encoding='utf-8'?>
<Server port="8005" shutdown="SHUTDOWN">
  <Listener className="org.apache.catalina.core.AprLifecycleListener" SSLEngine="on" />
  <Listener className="org.apache.catalina.core.JasperListener" />
  <Listener className="org.apache.catalina.core.JreMemoryLeakPreventionListener" />
  <Listener className="org.apache.catalina.mbeans.GlobalResourcesLifecycleListener" />
  <Listener className="org.apache.catalina.core.ThreadLocalLeakPreventionListener" />

  <GlobalNamingResources>
    <Resource name="UserDatabase" auth="Container"
              type="org.apache.catalina.UserDatabase"
              description="User database that can be updated and saved"
              factory="org.apache.catalina.users.MemoryUserDatabaseFactory"
              pathname="conf/tomcat-users.xml" />
  </GlobalNamingResources>

  <Service name="Catalina0">
    <Connector port="8080" protocol="HTTP/1.1" 
			   minSpareThreads="100"
			   acceptCount="1000"  
			   connectionTimeout="50000" 
			   maxThreads="3000" 
			   disableUploadTimeout="true"
			   URIEncoding="UTF-8" 
               redirectPort="8443" />
    <Connector port="8009" protocol="AJP/1.3" redirectPort="8443" />
    <Engine name="Catalina" defaultHost="localhost">
      <Realm className="org.apache.catalina.realm.LockOutRealm">
        <Realm className="org.apache.catalina.realm.UserDatabaseRealm"
               resourceName="UserDatabase"/>
      </Realm>
      <Host name="localhost"  appBase="/opt/www/webapps"
            unpackWARs="true" autoDeploy="true">
      </Host>
    </Engine>
  </Service>
	
  <Service name="Catalina1">
    <Connector port="8081" protocol="HTTP/1.1" 
			   minSpareThreads="100"
			   acceptCount="1000"  
			   connectionTimeout="50000" 
			   maxThreads="3000" 
			   disableUploadTimeout="true"
			   URIEncoding="UTF-8" 
               redirectPort="8444" />
    <Connector port="8010" protocol="AJP/1.3" redirectPort="8444" />
    <Engine name="Catalina" defaultHost="localhost">
      <Realm className="org.apache.catalina.realm.LockOutRealm">
        <Realm className="org.apache.catalina.realm.UserDatabaseRealm"
               resourceName="UserDatabase"/>
      </Realm>
      <Host name="localhost"  appBase="/opt/www/webapps"
            unpackWARs="true" autoDeploy="true">
      </Host>
    </Engine>
  </Service>  
  
  <Service name="Catalina2">
    <Connector port="8082" protocol="HTTP/1.1" 
			   minSpareThreads="100"
			   acceptCount="1000"  
			   connectionTimeout="50000" 
			   maxThreads="3000" 
			   disableUploadTimeout="true"
			   URIEncoding="UTF-8" 
               redirectPort="8445" />
    <Connector port="8011" protocol="AJP/1.3" redirectPort="8445" />
    <Engine name="Catalina" defaultHost="localhost">
      <Realm className="org.apache.catalina.realm.LockOutRealm">
        <Realm className="org.apache.catalina.realm.UserDatabaseRealm"
               resourceName="UserDatabase"/>
      </Realm>
      <Host name="localhost"  appBase="/opt/www/webapps"
            unpackWARs="true" autoDeploy="true">
      </Host>
    </Engine>
  </Service>
  <Service name="Catalina3">
    <Connector port="8083" protocol="HTTP/1.1" 
			   minSpareThreads="100"
			   acceptCount="1000"  
			   connectionTimeout="50000" 
			   maxThreads="3000" 
			   disableUploadTimeout="true"
			   URIEncoding="UTF-8" 
               redirectPort="8446" />
    <Connector port="8011" protocol="AJP/1.3" redirectPort="8446" />
    <Engine name="Catalina" defaultHost="localhost">
      <Realm className="org.apache.catalina.realm.LockOutRealm">
        <Realm className="org.apache.catalina.realm.UserDatabaseRealm"
               resourceName="UserDatabase"/>
      </Realm>
      <Host name="localhost"  appBase="/opt/www/webapps"
            unpackWARs="true" autoDeploy="true">
      </Host>
    </Engine>
  </Service>
</Server>

 

然后可以设置tomcat为Linux的服务，以便可以自动启动，创建权限为755的配置文件：/etc/init.d/tomcat，内容如下：

 

#!/bin/bash
#
# tomcatd      This shell script takes care of starting and stopping
#             standalone tomcat
#
# chkconfig: 345 91 10
# description:  tomcat service
# processname: tomcat
# config file:

# Source function library.
. /etc/rc.d/init.d/functions

# Source networking configuration.
. /etc/sysconfig/network

# Check that networking is up.
[ ${NETWORKING} = "no" ] && exit 0

prog=tomcat

export JAVA_HOME=/opt/jdk
export CATALINA_HOME=/opt/tomcat
export CATALINA_OPTS='-Xms2048m -Xmx2048m'  #初始化JVM内存可以自己根据情况设置

PATH=$PATH:$JAVA_HOME/bin

STARTUP=$CATALINA_HOME/bin/startup.sh
SHUTDOWN=$CATALINA_HOME/bin/shutdown.sh

if [ ! -f $CATALINA_HOME/bin/startup.sh ]
then
        echo "CATALINA_HOME for tomcat not available"
        exit
fi

start() {
        # Start daemons.

        echo -n $"Startting tomcat service: "
        daemon $STARTUP
        RETVAL=$?
        return $RETVAL
}

stop() {
        # Stop daemons.
        echo -n $"Stoping tomcat service: "
        $SHUTDOWN
 RETVAL=$?
        return $RETVAL
}

# See how we were called.
case "$1" in
  start)
        start
        ;;
  stop)
        stop
        ;;
  restart|reload)
        stop
        start
        RETVAL=$?
        ;;
  status)
        status $prog
        RETVAL=$?
        ;;
  *)
        echo $"Usage: $0 {start|stop|restart|status}"
        exit 1
esac

exit $RETVAL

 

添加服务：chkconfig --add tomcat

设置自动启动：chkconfig tomcat on

另外，需要修改tomcat/bin/startup.sh，在#!/bin/sh下面添加：CATALINA_OPTS='-Xms2048m -Xmx2048m'

 

 

4. Tomcat全局filter解决乱码问题：

代码就不写了，说下过程，filter代码网上到处都是，我要说的在tomcat/conf/web.xml中增加filter配置，和在单独应用中增加一样，然后把filter的class打包jar文件放在tomcat/lib目录下即可。

 

评论

1 楼 632408004 2013-01-15  

漂亮