JVM 异常退出的问题解决

我公司的J2EE应用程序服务器（Borland Enterprise Server ）有段时间老是会重新启动（间隔时间很断）。开始我以为是JVM的垃圾内存搜集器在工作导致的JVM异常退出。但是最近的一段时间这个现象频繁发生。有时候一天又好几次，后来咨询了Borland的工程师，仔细的分析了一下日志。发现有下列日志输出：

2007-11-27 15:40:17,276 INFO Hub mstore/zjmsapp/standard - Managed object zjmsapp/standard failure cause: Partition Process doesn't exist.
2007-11-27 15:42:58,869 INFO Hub mstore/zjmsapp/standard - Managed object zjmsapp/standard failure cause: Partition Process doesn't exist.
2007-11-27 16:24:12,203 INFO Hub mstore/zjmsapp/standard - Managed object zjmsapp/standard failure cause: Partition Process doesn't exist.
2007-11-27 20:02:44,638 INFO Hub mstore/zjmsapp/standard - Managed object zjmsapp/standard failure cause: Partition Process doesn't exist.

这日志表明这几个时间点上，JVM的进程异常退出了。然后我找到了JVM异常退出的日志

An unexpected exception has been detected in native code outside the VM.
Unexpected Signal : 11 occurred at PC=0x0
Function=[Unknown.]
Library=(N/A)

NOTE: We are unable to locate the function name symbol for the error
just occurred. Please refer to release documentation for possible
reason and solutions.

Current Java thread:
at oracle.jdbc.oci8.OCIDBAccess.do_execute(Native Method)
at oracle.jdbc.oci8.OCIDBAccess.executeFetch(OCIDBAccess.java:1732)
- locked <0x7a4e6098> (a oracle.jdbc.oci8.OCIDBAccess)
at oracle.jdbc.driver.OracleStatement.doExecuteQuery(OracleStatement.java:2520)
at oracle.jdbc.driver.OracleStatement.doExecuteWithTimeout(OracleStatement.java:2672)
at oracle.jdbc.driver.OraclePreparedStatement.executeUpdate(OraclePreparedStatement.java:589)
- locked <0x7ce874b8> (a oracle.jdbc.driver.OraclePreparedStatement)
- locked <0x7a45a688> (a oracle.jdbc.driver.OracleConnection)
at oracle.jdbc.driver.OraclePreparedStatement.executeQuery(OraclePreparedStatement.java:527)
- locked <0x7ce874b8> (a oracle.jdbc.driver.OraclePreparedStatement)
- locked <0x7a45a688> (a oracle.jdbc.driver.OracleConnection)
at com.inprise.visitransact.jdbc2.PreparedStatementProxy.executeQuery(PreparedStatementProxy.java:39)
at com.freely.mstore.util.DBUtil.getCash(DBUtil.java:2361)
at com.freely.mstore.ejb.session.ChargeSessionBean.getCash(ChargeSessionBean.java:2001)
at com.freely.mstore.ejb.session.ChargeSessionBean.charge(ChargeSessionBean.java:456)
at sun.reflect.GeneratedMethodAccessor130.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.inprise.ejb.ConcreteMethod.invoke(ConcreteMethod.java:32)
at com.inprise.ejb.EJBContext.invoke(EJBContext.java:166)
at com.inprise.ejb.Dispatcher.doInvoke(Dispatcher.java:1354)
at com.inprise.ejb.Dispatcher.invokeSecurityCheck(Dispatcher.java:1062)
at com.inprise.ejb.Dispatcher.invoke(Dispatcher.java:824)
at com.inprise.ejb.Dispatcher.invoke(Dispatcher.java:603)
at com.inprise.ejb.EJBHome.dispatcherInvokeBeanMethod(EJBHome.java:60)
at com.inprise.ejb.EJBHome$ComponentInterfaceMethodCache.invokeDispatcherMethod(EJBHome.java:1519)
at com.inprise.ejb.EJBHome.invokeDispatcherMethod(EJBHome.java:38)
at com.inprise.ejb.Dispatcher.invoke(Dispatcher.java:429)
at com.freely.mstore.ejb.session.ChargeSessionLocalPOAInvokeHandler.charge(ChargeSessionLocalPOAInvokeHandler.java:638)
at com.freely.mstore.ejb.session.ChargeSessionLocalPOAInvokeHandler.charge(ChargeSessionLocalPOAInvokeHandler.java:1170)
at com.freely.mstore.ejb.session._ChargeSessionLocal_Stub.charge(_ChargeSessionLocal_Stub.java:862)
at com.freely.mstore.ejb.session.ProcessMesSessionBean.proceCharge(ProcessMesSessionBean.java:430)
at com.freely.mstore.ejb.session.ProcessMesSessionBean.sortkind(ProcessMesSessionBean.java:223)
at sun.reflect.GeneratedMethodAccessor124.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.inprise.ejb.ConcreteMethod.invoke(ConcreteMethod.java:32)
at com.inprise.ejb.EJBContext.invoke(EJBContext.java:166)
at com.inprise.ejb.Dispatcher.doInvoke(Dispatcher.java:1354)
at com.inprise.ejb.Dispatcher.invokeSecurityCheck(Dispatcher.java:1062)
at com.inprise.ejb.Dispatcher.invoke(Dispatcher.java:824)
at com.inprise.ejb.Dispatcher.invoke(Dispatcher.java:603)
at com.inprise.ejb.EJBHome.dispatcherInvokeBeanMethod(EJBHome.java:60)
at com.inprise.ejb.EJBHome$ComponentInterfaceMethodCache.invokeDispatcherMethod(EJBHome.java:1519)
at com.inprise.ejb.EJBHome.invokeDispatcherMethod(EJBHome.java:38)
at com.inprise.ejb.Dispatcher.invoke(Dispatcher.java:429)
at com.freely.mstore.ejb.session.ProcessMesSessionLocalPOAInvokeHandler.sortkind(ProcessMesSessionLocalPOAInvokeHandler.java:166)
at com.freely.mstore.ejb.session.ProcessMesSessionLocalPOAInvokeHandler.sortkind(ProcessMesSessionLocalPOAInvokeHandler.java:473)
at com.freely.mstore.ejb.session._ProcessMesSessionLocal_Stub.sortkind(_ProcessMesSessionLocal_Stub.java:199)
at com.freely.mstore.ejb.messagebean.MstoreMDBMonitorMessageBean.onMessage(MstoreMDBMonitorMessageBean.java:54)
at sun.reflect.GeneratedMethodAccessor17.invoke(Unknown Source)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
at java.lang.reflect.Method.invoke(Method.java:324)
at com.inprise.ejb.InternalMethod.invoke(InternalMethod.java:16)
at com.inprise.ejb.EJBContext.invoke(EJBContext.java:166)
at com.inprise.ejb.Dispatcher.doInvoke(Dispatcher.java:1354)
at com.inprise.ejb.Dispatcher.invokeSecurityCheck(Dispatcher.java:1062)
at com.inprise.ejb.Dispatcher.invoke(Dispatcher.java:824)
at com.inprise.ejb.MDBDispatcher.invokeMDB(MDBDispatcher.java:77)
at com.inprise.ejb.MDBDispatcher.onMessage(MDBDispatcher.java:215)
at com.tibco.tibjms.TibjmsSession._submit(TibjmsSession.java:2726)
at com.tibco.tibjms.TibjmsSession._dispatchAsyncMessage(TibjmsSession.java:1378)
at com.tibco.tibjms.TibjmsSession._run(TibjmsSession.java:2404)
at com.tibco.tibjms.TibjmsSession.run(TibjmsSession.java:3260)
at com.inprise.ejb.MDBListener$MDBServerSessionPool$MDBServerSession$SessionRunner.run(MDBListener.java:369)
at com.inprise.ejb.mdb.MDBThreadPool$1.run(MDBThreadPool.java:48)
at com.inprise.vbroker.orb.ThreadPool$PoolWorker.run(ThreadPool.java:83)

Dynamic libraries:
00480000-00495000 r-xp 00000000 08:07 1933582 /lib/ld-2.3.4.so
00495000-00496000 r-xp 00015000 08:07 1933582 /lib/ld-2.3.4.so
00496000-00497000 rwxp 00016000 08:07 1933582 /lib/ld-2.3.4.so
005ea000-005ec000 r-xp 00000000 08:07 1507400 /lib/libdl-2.3.4.so
005ec000-005ee000 rwxp 00001000 08:07 1507400 /lib/libdl-2.3.4.so
00620000-00632000 r-xp 00000000 08:07 1507355 /lib/libnsl-2.3.4.so
00632000-00634000 rwxp 00011000 08:07 1507355 /lib/libnsl-2.3.4.so
006e4000-006f9000 r-xp 00000000 08:07 1467086 /usr/X11R6/lib/libICE.so.6.3
006f9000-006fa000 rwxp 00014000 08:07 1467086 /usr/X11R6/lib/libICE.so.6.3
007fd000-008d8000 r-xp 00000000 08:07 1466436 /usr/X11R6/lib/libX11.so.6.2
008d8000-008dc000 rwxp 000db000 08:07 1466436 /usr/X11R6/lib/libX11.so.6.2
008de000-008e6000 r-xp 00000000 08:07 1467054 /usr/X11R6/lib/libSM.so.6.0
008e6000-008e7000 rwxp 00007000 08:07 1467054 /usr/X11R6/lib/libSM.so.6.0
00907000-0090b000 r-xp 00000000 08:07 3522654 /usr/X11R6/lib/libXtst.so.6.1
0090b000-0090c000 rwxp 00003000 08:07 3522654 /usr/X11R6/lib/libXtst.so.6.1
00930000-0093d000 r-xp 00000000 08:07 1467060 /usr/X11R6/lib/libXext.so.6.4
0093d000-0093e000 rwxp 0000c000 08:07 1467060 /usr/X11R6/lib/libXext.so.6.4
08048000-08056000 r-xp 00000000 08:03 332268 /opt/bdp/bin/partition
08056000-08059000 rwxp 0000e000 08:03 332268 /opt/bdp/bin/partition
5a529000-5a575000 r-xp 00000000 08:07 1467104 /usr/X11R6/lib/libXt.so.6.0
5a575000-5a579000 rwxp 0004b000 08:07 1467104 /usr/X11R6/lib/libXt.so.6.0
5a579000-5a580000 r-xp 00000000 08:07 1471083 /usr/X11R6/lib/libXp.so.6.2
5a580000-5a581000 rwxp 00006000 08:07 1471083 /usr/X11R6/lib/libXp.so.6.2
5a5a6000-5a5f9000 r-xp 00000000 08:03 364389 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libmlib_image.so
5a5f9000-5a5fa000 rwxp 00052000 08:03 364389 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libmlib_image.so
5a5fa000-5a8c5000 r-xp 00000000 08:03 364354 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libawt.so
5a8c5000-5a8db000 rwxp 002ca000 08:03 364354 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libawt.so
64b22000-64b9c000 r-xs 00000000 08:03 82061 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36701.tmp (deleted)
64b9c000-64bb7000 r-xs 00000000 08:03 82060 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36700.tmp (deleted)
64bb7000-64c00000 r-xs 00000000 08:03 82059 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36699.tmp (deleted)
64d1b000-64d4b000 r-xs 00000000 08:03 82058 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36698.tmp (deleted)
64d4b000-64e9b000 r-xs 00000000 08:03 82057 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36697.tmp (deleted)
64e9b000-64ea3000 r-xs 00000000 08:03 82056 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36696.tmp (deleted)
64ea3000-64f3b000 r-xs 00000000 08:03 82055 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36695.tmp (deleted)
64f3b000-64f53000 r-xs 00000000 08:03 82054 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36694.tmp (deleted)
64f53000-65000000 r-xs 00000000 08:03 82053 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36693.tmp (deleted)
65000000-65010000 r-xs 00000000 08:03 82052 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36692.tmp (deleted)
65010000-65020000 r-xs 00000000 08:03 82051 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36691.tmp (deleted)
65020000-65043000 r-xs 00000000 08:03 82050 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36690.tmp (deleted)
65043000-65068000 r-xs 00000000 08:03 82049 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36689.tmp (deleted)
65068000-6508e000 r-xs 00000000 08:03 82048 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36688.tmp (deleted)
6508e000-65195000 r-xs 00000000 08:03 82047 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36687.tmp (deleted)
65195000-651b2000 r-xs 00000000 08:03 82046 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36686.tmp (deleted)
651b2000-651b8000 r-xs 00000000 08:03 82045 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36685.tmp (deleted)
651b8000-651c4000 r-xs 00000000 08:03 82044 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36684.tmp (deleted)
651c4000-651ed000 r-xs 00000000 08:03 82043 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/jar_cache36683.tmp (deleted)
66ba1000-66bb1000 r-xp 00000000 08:07 1491134 /usr/lib/gconv/libGB.so
66bb1000-66bb3000 rwxp 0000f000 08:07 1491134 /usr/lib/gconv/libGB.so
66c34000-66c36000 r-xp 00000000 08:03 332414 /opt/oracle/ora920/lib32/libwtc9.so
66c36000-66c37000 rwxp 00001000 08:03 332414 /opt/oracle/ora920/lib32/libwtc9.so
66c37000-67532000 r-xp 00000000 08:03 332494 /opt/oracle/ora920/lib32/libclntsh.so.9.0
67532000-675f3000 rwxp 008fa000 08:03 332494 /opt/oracle/ora920/lib32/libclntsh.so.9.0
677aa000-67864000 r-xp 00000000 08:03 364362 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libfontmanager.so
67864000-6787e000 rwxp 000b9000 08:03 364362 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libfontmanager.so
6985b000-69881000 r-xs 00000000 08:03 82042 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36663jdom.jar
69881000-698aa000 r-xs 00000000 08:03 82041 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36662commons-collections.jar
698aa000-698f3000 r-xs 00000000 08:03 82040 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36661jcommon-1.0.0-rc1.jar
698f3000-698fb000 r-xs 00000000 08:03 82039 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36660commons-logging.jar
698fb000-69916000 r-xs 00000000 08:03 82038 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36659commons-digester.jar
69916000-69a66000 r-xs 00000000 08:03 82037 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36658jasperreports-1.2.4.jar
69a66000-69a6c000 r-xs 00000000 08:03 82036 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36657commons-fileupload.jar
69a6c000-69b19000 r-xs 00000000 08:03 82035 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36656jxl.jar
69b19000-69b49000 r-xs 00000000 08:03 82034 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36655jasperreports-1.2.4-applet.jar
69b49000-69be1000 r-xs 00000000 08:03 82033 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36654poi-2.0-final-20040126.jar
69be1000-69bf9000 r-xs 00000000 08:03 82032 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36653commons-javaflow-20060411.jar
69bf9000-69d00000 r-xs 00000000 08:03 82031 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36652jfreechart-1.0.0-rc1.jar
69e07000-69e1c000 r-xp 00000000 08:03 332486 /opt/oracle/ora920/lib32/libocijdbc9.so
69e1c000-69e1e000 rwxp 00014000 08:03 332486 /opt/oracle/ora920/lib32/libocijdbc9.so
69e3b000-69e47000 r-xs 00000000 08:03 82030 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36651commons-validator.jar
69e47000-69ec1000 r-xs 00000000 08:03 82029 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36650struts.jar
69ec1000-69ed3000 r-xs 00000000 08:03 394298 /opt/bdp/lib/tomcat/jasper/jasper-runtime.jar
69ed3000-69f00000 r-xs 00000000 08:03 394297 /opt/bdp/lib/tomcat/jasper/jasper-compiler.jar
6a40b000-6a42e000 r-xs 00000000 08:03 82028 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36649commons-digester-1.7.jar
6a42e000-6a8ae000 r-xs 00000000 08:03 82023 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36642MStoreEJBModule.jar
6b84d000-6b902000 r-xs 00000000 08:03 394301 /opt/bdp/lib/tomcat/server/catalina.jar
6b902000-6b904000 r-xs 00000000 08:03 394310 /opt/bdp/lib/tomcat/server/servlets-invoker.jar
6b904000-6b90e000 r-xs 00000000 08:03 394315 /opt/bdp/lib/tomcat/server/tomcat-http11.jar
6b90e000-6b912000 r-xs 00000000 08:03 394319 /opt/bdp/lib/tomcat/server/tomcat-nio.jar
6b912000-6b92d000 r-xs 00000000 08:03 394303 /opt/bdp/lib/tomcat/server/commons-digester.jar
6b92d000-6b933000 r-xs 00000000 08:03 394304 /opt/bdp/lib/tomcat/server/commons-fileupload.jar
6b933000-6b937000 r-xs 00000000 08:03 394300 /opt/bdp/lib/tomcat/server/catalina-ant.jar
6b937000-6b93c000 r-xs 00000000 08:03 394309 /opt/bdp/lib/tomcat/server/servlets-default.jar
6b93c000-6b952000 r-xs 00000000 08:03 394316 /opt/bdp/lib/tomcat/server/tomcat-iiop2.jar
6b952000-6b958000 r-xs 00000000 08:03 394313 /opt/bdp/lib/tomcat/server/servlets-webdav.jar
6b958000-6b95a000 r-xs 00000000 08:03 394308 /opt/bdp/lib/tomcat/server/servlets-common.jar
6b95a000-6b96a000 r-xs 00000000 08:03 394317 /opt/bdp/lib/tomcat/server/tomcat-jk.jar
6b96a000-6b972000 r-xs 00000000 08:03 394306 /opt/bdp/lib/tomcat/server/jakarta-regexp-1.2.jar
6b972000-6b983000 r-xs 00000000 08:03 394314 /opt/bdp/lib/tomcat/server/tomcat-coyote.jar
6b983000-6b98b000 r-xs 00000000 08:03 394305 /opt/bdp/lib/tomcat/server/commons-logging.jar
6b98b000-6b9b1000 r-xs 00000000 08:03 394320 /opt/bdp/lib/tomcat/server/tomcat-util.jar
6b9b1000-6b9c4000 r-xs 00000000 08:03 394318 /opt/bdp/lib/tomcat/server/tomcat-jk2.jar
6b9c4000-6b9c9000 r-xs 00000000 08:03 394311 /opt/bdp/lib/tomcat/server/servlets-manager.jar
6b9c9000-6b9e6000 r-xs 00000000 08:03 394302 /opt/bdp/lib/tomcat/server/commons-beanutils.jar
6c805000-6c808000 r-xp 00000000 08:07 1490985 /usr/lib/gconv/EUC-CN.so
6c808000-6c80a000 rwxp 00002000 08:07 1490985 /usr/lib/gconv/EUC-CN.so
6c80a000-6c810000 r-xs 00000000 08:07 1491156 /usr/lib/gconv/gconv-modules.cache
6c810000-6c820000 r-xs 00000000 08:03 82027 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36648commons-lang.jar
6c820000-6c830000 r-xs 00000000 08:03 82026 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36647jakarta-oro.jar
6c830000-6c855000 r-xs 00000000 08:03 82025 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36646dwr.jar
6c855000-6c872000 r-xs 00000000 08:03 82024 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/tmp/tmpbes_36645commons-beanutils.jar
6c872000-6c873000 r-xs 00000000 08:03 1261569 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/dars/default-resources.dar
6c873000-6c877000 r-xp 00000000 08:03 364366 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libioser12.so
6c877000-6c878000 rwxp 00003000 08:03 364366 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libioser12.so
6c9fb000-6cb1e000 r-xs 00000000 08:03 332309 /opt/bdp/lib/sanctuary.jar
6ccdf000-6ccef000 r-xp 00000000 08:03 364393 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libnet.so
6ccef000-6ccf0000 rwxp 0000f000 08:03 364393 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libnet.so
6cef4000-6d3d0000 r-xs 00000000 08:03 364919 /opt/bdp/jdk/jdk1.4.2/lib/tools.jar
6d3d0000-6d419000 r-xs 00000000 08:03 411158 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/jcommon-1.0.0-rc1.jar
6d419000-6d569000 r-xs 00000000 08:03 411157 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/jasperreports-1.2.4.jar
6d569000-6d599000 r-xs 00000000 08:03 411156 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/jasperreports-1.2.4-applet.jar
6d599000-6d631000 r-xs 00000000 08:03 411160 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/poi-2.0-final-20040126.jar
6d631000-6d649000 r-xs 00000000 08:03 411155 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/commons-javaflow-20060411.jar
6d649000-6d750000 r-xs 00000000 08:03 411159 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/jfreechart-1.0.0-rc1.jar
6d750000-6d757000 r-xs 00000000 08:03 411746 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/com.jar
6d757000-6d87c000 r-xs 00000000 08:03 411161 /opt/bdp/var/domains/base/configurations/mstore/mos/standard/lib/classes12.jar
6d87c000-6d87d000 r-xs 00000000 08:03 332377 /opt/bdp/lib/tibjmslic.jar
6d87d000-6d884000 r-xs 00000000 08:03 411145 /opt/bdp/jms/tibco/clients/java/jms.jar
6d884000-6d8c4000 r-xs 00000000 08:03 411151 /opt/bdp/jms/tibco/clients/java/tibjms.jar
6d8c4000-6d8e8000 r-xs 00000000 08:03 332353 /opt/bdp/lib/flexlm.jar
6d8e8000-6d8ed000 r-xs 00000000 08:03 332308 /opt/bdp/lib/sanct2.jar
6d8ed000-6d930000 r-xs 00000000 08:03 332352 /opt/bdp/lib/EccpressoAll.jar
6d930000-6d956000 r-xs 00000000 08:03 332305 /opt/bdp/lib/lm.jar
6d956000-6da0a000 r-xs 00000000 08:03 394288 /opt/bdp/lib/tomcat/common/ant.jar
6da0a000-6da10000 r-xs 00000000 08:03 394290 /opt/bdp/lib/tomcat/common/commons-logging-api.jar
6da10000-6da39000 r-xs 00000000 08:03 394289 /opt/bdp/lib/tomcat/common/commons-collections.jar
6da39000-6da3c000 r-xs 00000000 08:03 394294 /opt/bdp/lib/tomcat/common/naming-factory.jar
6da3c000-6da46000 r-xs 00000000 08:03 394295 /opt/bdp/lib/tomcat/common/naming-resources.jar
6da46000-6da4d000 r-xs 00000000 08:03 394293 /opt/bdp/lib/tomcat/common/naming-common.jar
6da4d000-6da60000 r-xs 00000000 08:03 394286 /opt/bdp/lib/tomcat/common/servlet.jar
6da60000-6db48000 r-xs 00000000 08:03 332346 /opt/bdp/lib/visiconnect.jar
6db48000-6dc4d000 r-xs 00000000 08:03 332299 /opt/bdp/lib/jdsserver.jar
6dc4d000-6dc4f000 r-xs 00000000 08:03 332378 /opt/bdp/lib/tomcat4.jar
6dc4f000-6dc9c000 r-xs 00000000 08:03 332333 /opt/bdp/lib/vbejb.jar
6dc9c000-6dced000 r-xs 00000000 08:03 332310 /opt/bdp/lib/vbdev.jar
6dced000-6dd0f000 r-xs 00000000 08:03 332311 /opt/bdp/lib/vbjdev.jar
6dd0f000-6dd28000 r-xs 00000000 08:03 332357 /opt/bdp/lib/jmxtools.jar
6dd28000-6dd7f000 r-xs 00000000 08:03 332356 /opt/bdp/lib/jmxri.jar
6dd7f000-6ddd6000 r-xs 00000000 08:03 332306 /opt/bdp/lib/log4j.jar
6ddd6000-6deb9000 r-xs 00000000 08:03 332314 /opt/bdp/lib/xercesImpl.jar
6deb9000-6ded8000 r-xs 00000000 08:03 332315 /opt/bdp/lib/xmlParserAPIs.jar
6ded8000-6df1d000 r-xs 00000000 08:03 332307 /opt/bdp/lib/mail.jar
6df1d000-6df94000 r-xs 00000000 08:03 332287 /opt/bdp/lib/dom4j.jar
6df94000-6e019000 r-xs 00000000 08:03 332316 /opt/bdp/lib/xmlrt.jar
6e019000-6e01a000 r-xs 00000000 08:03 332328 /opt/bdp/lib/US_export_policy.jar
6e01a000-6e03a000 r-xs 00000000 08:03 332327 /opt/bdp/lib/sunjce_provider.jar
6e03a000-6e03b000 r-xs 00000000 08:03 332321 /opt/bdp/lib/local_policy.jar
6e03b000-6e04d000 r-xs 00000000 08:03 332318 /opt/bdp/lib/jce1_2_1.jar
6e04d000-6e04e000 r-xs 00000000 08:03 332300 /opt/bdp/lib/jnet.jar
6e04e000-6e050000 r-xs 00000000 08:03 332295 /opt/bdp/lib/jcert.jar
6e050000-6e06a000 r-xs 00000000 08:03 332292 /opt/bdp/lib/jaas.jar
6e06a000-6e0dc000 r-xs 00000000 08:03 332302 /opt/bdp/lib/jsse.jar
6e0dc000-6e192000 r-xs 00000000 08:03 332313 /opt/bdp/lib/vbsec.jar
6e192000-6e590000 r-xs 00000000 08:03 332312 /opt/bdp/lib/vbjorb.jar
6e590000-6e5bc000 r-xs 00000000 08:03 332372 /opt/bdp/lib/orgomg.jar
6e5bc000-6e7e8000 r-xs 00000000 08:03 332317 /opt/bdp/lib/asrt.jar
6e7e8000-6e836000 r-xs 00000000 08:03 332322 /opt/bdp/lib/partition.jar
6e836000-6e839000 r-xs 00000000 08:03 426245 /opt/bdp/lib/patches/bes601_p7.jar
6e839000-6e855000 r-xs 00000000 08:03 364306 /opt/bdp/jdk/jdk1.4.2/jre/lib/ext/sunjce_provider.jar
6e855000-6e862000 r-xs 00000000 08:03 364304 /opt/bdp/jdk/jdk1.4.2/jre/lib/ext/ldapsec.jar
6e862000-6e865000 r-xs 00000000 08:03 364303 /opt/bdp/jdk/jdk1.4.2/jre/lib/ext/dnsns.jar
6e865000-6e921000 r-xs 00000000 08:03 364305 /opt/bdp/jdk/jdk1.4.2/jre/lib/ext/localedata.jar
6eaa4000-6eb39000 r-xp 01dde000 08:07 1461644 /usr/lib/locale/locale-archive
6eb39000-6ed39000 r-xp 00000000 08:07 1461644 /usr/lib/locale/locale-archive
f36b5000-f36b6000 r-xp 00000000 08:03 332304 /opt/bdp/lib/libuserid.so
f36b6000-f36b7000 rwxp 00001000 08:03 332304 /opt/bdp/lib/libuserid.so
f575f000-f5cb8000 r-xs 00000000 08:03 364294 /opt/bdp/jdk/jdk1.4.2/jre/lib/charsets.jar
f5cb8000-f5cc9000 r-xs 00000000 08:03 364425 /opt/bdp/jdk/jdk1.4.2/jre/lib/jce.jar
f5cc9000-f5da4000 r-xs 00000000 08:03 364426 /opt/bdp/jdk/jdk1.4.2/jre/lib/jsse.jar
f5da4000-f5dba000 r-xs 00000000 08:03 364478 /opt/bdp/jdk/jdk1.4.2/jre/lib/sunrsasign.jar
f5e04000-f779c000 r-xs 00000000 08:03 364471 /opt/bdp/jdk/jdk1.4.2/jre/lib/rt.jar
f779c000-f77b0000 r-xp 00000000 08:03 364401 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libzip.so
f77b0000-f77b3000 rwxp 00013000 08:03 364401 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libzip.so
f77b3000-f77d3000 r-xp 00000000 08:03 364370 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libjava.so
f77d3000-f77d5000 rwxp 0001f000 08:03 364370 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libjava.so
f77d5000-f77de000 r-xp 00000000 08:07 1507377 /lib/libnss_files-2.3.4.so
f77de000-f77e0000 rwxp 00008000 08:07 1507377 /lib/libnss_files-2.3.4.so
f77ef000-f77ff000 r-xp 00000000 08:03 364399 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libverify.so
f77ff000-f7801000 rwxp 0000f000 08:03 364399 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/libverify.so
f7801000-f7805000 rwxs 00000000 08:07 3293226 /tmp/hsperfdata_bes/18420
f7805000-f780d000 r-xp 00000000 08:03 364404 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/native_threads/libhpi.so
f780d000-f780e000 rwxp 00007000 08:03 364404 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/native_threads/libhpi.so
f7a0e000-f7a2f000 r-xp 00000000 08:07 1507336 /lib/i686/libm-2.3.4.so
f7a2f000-f7a31000 rwxp 00020000 08:07 1507336 /lib/i686/libm-2.3.4.so
f7a32000-f7b55000 r-xp 00000000 08:07 1507334 /lib/i686/libc-2.3.4.so
f7b55000-f7b56000 r-xp 00123000 08:07 1507334 /lib/i686/libc-2.3.4.so
f7b56000-f7b59000 rwxp 00124000 08:07 1507334 /lib/i686/libc-2.3.4.so
f7b5b000-f7b69000 r-xp 00000000 08:07 1507338 /lib/i686/libpthread-0.10.so
f7b69000-f7b6b000 rwxp 0000d000 08:07 1507338 /lib/i686/libpthread-0.10.so
f7bd2000-f7bd3000 r-xp 00000000 08:07 3178500 /stub/lib/libcwait.so
f7bd3000-f7bd4000 rwxp 00000000 08:07 3178500 /stub/lib/libcwait.so
f7bd5000-f7fcf000 r-xp 00000000 08:03 364350 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/client/libjvm.so
f7fcf000-f7feb000 rwxp 003f9000 08:03 364350 /opt/bdp/jdk/jdk1.4.2/jre/lib/i386/client/libjvm.so

Heap at VM Abort:
Heap
def new generation total 108992K, used 77202K [0x6f6b0000, 0x76cf0000, 0x79430000)
eden space 96896K, 73% used [0x6f6b0000, 0x73c1a408, 0x75550000)
from space 12096K, 50% used [0x76120000, 0x7671a6b8, 0x76cf0000)
to space 12096K, 0% used [0x75550000, 0x75550000, 0x76120000)
tenured generation total 1451904K, used 240767K [0x79430000, 0xd1e10000, 0xef6b0000)
the space 1451904K, 16% used [0x79430000, 0x87f4ff40, 0x87f50000, 0xd1e10000)
compacting perm gen total 42240K, used 42165K [0xef6b0000, 0xf1ff0000, 0xf36b0000)
the space 42240K, 99% used [0xef6b0000, 0xf1fdd688, 0xf1fdd800, 0xf1ff0000)

Local Time = Tue Nov 27 20:02:41 2007
Elapsed Time = 13109
#
# The exception above was detected in native code outside the VM
#
# Java VM: Java HotSpot(TM) Client VM (1.4.2_03-b01 mixed mode)
#从JVM异常退出的日志上来看是OCI驱动出了问题。后来我在网上搜索了一下。发现JDBC的OCI驱动，因为是 Native 类型 所以导致很不问题。都建议用thin 驱动（纯JAVA）。

后来换了JDBC 换了thin 驱动后，跑了2个多星期了再也没有异常退出了。

通过这个案例，我发现搞技术不能想当然，任何问题一定有原因只是你没有发现而已。