apache和tomcat整合问题? 400 报错

apache和tomcat整合问题? 400 报错

我整合的apache和tomcat 负载出了一个很头疼的问题

我的apache版本是 2.2.15 ，tomcat版本是6.0

我的  worker.properties

# In Unix, we use forward slashes:
ps=/
# list the workers by name
worker.list=tomcat4, loadbalancer
worker.loadbalancer.type=lb
worker.loadbalancer.balance_workers=tomcat4
worker.loadbalancer.sticky_session=true
worker.loadbalancer.sticky_session_force=true

worker.tomcat4.type=ajp13
worker.tomcat4.port=7029
worker.tomcat4.host=127.0.0.1
worker.tomcat4.lbfactor=1
worker.tomcat4.connection_pool_size=500
worker.tomcat4.connection_pool_timeout=60
worker.tomcat4.socket_keepalive=1
worker.tomcat4.socket_timeout=60

我的TOMCAT，AJP端口

<Connector port="7029"
              protocolHandlerClassName="org.apache.jk.server.JkCoyoteHandler"
     maxThreads="800" minSpareThreads="100" maxSpareThreads="200"
      minProcessors="20" maxProcessors="800"
                redirectPort="8443" acceptCount="2000"
               connectionTimeout="200000"
      protocol="AJP/1.3" />

那是我刚整合一两天的时候，有人反映网站打开很慢，到后来就一片空白。

我去看了服务器

首先我用 watch -n 1 -d 'pgrep httpd | wc-l'3

统计并发，平时并发是400左右，那时查了下达到了1300多，我停止apache,再启动还会涨到1300，最后我重启tomcat恢复正常。

我估计问题出在tomcat那里，我就查了下tomcat出问题时候的日志，如下。

==============================================================================================================日志开始
Last packet sent to the server was 1 ms ago.
 at com.mysql.jdbc.Connection.createNewIO(Connection.java:2643)
 at com.mysql.jdbc.Connection.<init>(Connection.java:1485)
 at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266)
 at java.sql.DriverManager.getConnection(DriverManager.java:525)
 at java.sql.DriverManager.getConnection(DriverManager.java:171)
 at com.jb.base.cacheHelpBean.SaleInfoBean.salerinfo_num(SaleInfoBean.java:429)
 at com.jb.base.cacheHelpBean.RevertUserSale.run(RevertUserSale.java:26)
 at java.util.TimerThread.mainLoop(Timer.java:512)
 at java.util.TimerThread.run(Timer.java:462)
com.mysql.jdbc.CommunicationsException: Communications link failure due to underlying exception:

** BEGIN NESTED EXCEPTION **

java.net.SocketException
MESSAGE: java.net.ConnectException: Connection refused

STACKTRACE:

java.net.SocketException: java.net.ConnectException: Connection refused
 at com.mysql.jdbc.StandardSocketFactory.connect(StandardSocketFactory.java:156)
 at com.mysql.jdbc.MysqlIO.<init>(MysqlIO.java:284)
 at com.mysql.jdbc.Connection.createNewIO(Connection.java:2569)
 at com.mysql.jdbc.Connection.<init>(Connection.java:1485)
 at com.mysql.jdbc.NonRegisteringDriver.connect(NonRegisteringDriver.java:266)
 at java.sql.DriverManager.getConnection(DriverManager.java:525)
 at java.sql.DriverManager.getConnection(DriverManager.java:171)
 at com.jb.base.cacheHelpBean.SaleInfoBean.salerinfo_num_cjbs(SaleInfoBean.java:493)
 at com.jb.base.cacheHelpBean.RevertUserSale.run(RevertUserSale.java:27)
 at java.util.TimerThread.mainLoop(Timer.java:512)
 at java.util.TimerThread.run(Timer.java:462)

** END NESTED EXCEPTION **

...............................

..............................

2010-8-8 11:56:34 org.apache.jk.common.ChannelSocket processConnection
警告: processCallbacks status 2
2010-8-8 11:56:34 org.apache.jk.common.ChannelSocket processConnection
警告: processCallbacks status 2
2010-8-8 11:56:34 org.apache.jk.common.ChannelSocket processConnection
警告: processCallbacks status 2
更新成功2010-8-8 11:56:42 org.apache.jk.common.ChannelSocket processConnection
警告: processCallbacks status 2
2010-8-8 11:56:42 org.apache.jk.common.ChannelSocket processConnection
警告: processCallbacks status 2

...................................

....................................

2010-8-8 11:58:22 org.apache.tomcat.util.threads.ThreadPool$ControlRunnable run
严重: Caught exception (java.lang.OutOfMemoryError: Java heap space) executing org.apache.jk.common.ChannelSocket$SocketAcceptor@3c792b, terminating thread
2010-8-8 11:58:25 org.apache.jk.common.ChannelSocket processConnection

======================================================================================================日志结束

再查看JK的日志

=======================================================================================================日志开始

[Sun Aug 08 11:57:58.360 2010] [16103:3085982592] [info] service::jk_lb_worker.c (1388): service failed, worker tomcat4 is in local error state
[Sun Aug 08 11:57:58.360 2010] [16171:3085982592] [info] ajp_connection_tcp_get_message::jk_ajp_common.c (1230): (tomcat4) can't receive the response header message from tomcat, network problems or tomcat (127.0.0.1:7029) is down (errno=11)
[Sun Aug 08 11:57:58.360 2010] [16171:3085982592] [error] ajp_get_reply::jk_ajp_common.c (2055): (tomcat4) Tomcat is down or refused connection. No response has been sent to the client (yet)
[Sun Aug 08 11:57:58.360 2010] [16171:3085982592] [info] ajp_service::jk_ajp_common.c (2540): (tomcat4) sending request to tomcat failed (recoverable),  (attempt=1)
[Sun Aug 08 11:57:58.850 2010] [16125:3085982592] [info] ajp_connection_tcp_get_message::jk_ajp_common.c (1230): (tomcat4) can't receive the

。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。。
[Sun Aug 08 11:58:38.969 2010] [16655:3085982592] [info] ajp_connect_to_endpoint::jk_ajp_common.c (959): Failed opening socket to (127.0.0.1:7029) (errno=115)
[Sun Aug 08 11:58:38.969 2010] [16655:3085982592] [error] ajp_send_request::jk_ajp_common.c (1585): (tomcat4) connecting to backend failed. Tomcat is probably not started or is listening on the wrong port (errno=115)
[Sun Aug 08 11:58:38.969 2010] [16655:3085982592] [info] ajp_service::jk_ajp_common.c (2540): (tomcat4) sending request to tomcat failed (recoverable), because of error during request sending (attempt=1)
[Sun Aug 08 11:58:39.197 2010] [16658:3085982592] [info] jk_open_socket::jk_connect.c (622): connect to 127.0.0.1:7029 failed (errno=115)

=======================================================================================================日志结束

这个问题好像每过几天就会出现一次

问题明显了是tomcat的AJP端口7029出了问题 可能这个端口死掉了，但是怎么死的呢？

我初步估计是不是数据库连接失效造成的，我这里用的是 c3po连接池，因为在发生严重错误前有这个信息

Last packet sent to the server was 1 ms ago.
 at com.mysql.jdbc.Connection.createNewIO(Connection.java:2643)

是不是tomcat一直连接不上数据库，所以没有回应客户端，造成AJP端口线程堆积堵死。

由于小弟技术有限，这个问题不能圆满解决，还希望各位帮忙解决下了，我这里先谢谢了。