Hi all,
W2k3, TS 6.7.2, OD 6.2.1 + DD
When using DD-ing, the OD service crashes sometimes with the below error.
We increased the Xmx & Xms values to 1024m & 512m, but with the same result. Anyone come accross this one or has any idea in which direction to look? There is a hs_err_pid.log created when the service crashes:
(below this log the iwdd.log).
#
# An unexpected error has been detected by HotSpot Virtual Machine:
#
# EXCEPTION_ACCESS_VIOLATION (0xc0000005) at pc=0x7c82c6e4, pid=756, tid=7728
#
# Java VM: Java HotSpot(TM) Server VM (1.5.0_14-b03 mixed mode)
# Problematic frame:
# C [ntdll.dll+0x2c6e4]
#
--------------- T H R E A D ---------------
Current thread (0x1a4278d0): JavaThread "Thread-10" [_thread_in_native, id=7728]
siginfo: ExceptionCode=0xc0000005, reading address 0x00000000
Registers:
EAX=0x00000000, EBX=0x00d30000, ECX=0x21810fe0, EDX=0x00d30178
ESP=0x1d80f414, EBP=0x1d80f630, ESI=0x21810fd8, EDI=0x00000000
EIP=0x7c82c6e4, EFLAGS=0x00010216
Top of Stack: (sp=0x1d80f414)
0x1d80f414: 1a4278d0 0000000c 04a92d08 00000000
0x1d80f424: 00000000 00000000 00000000 00000000
0x1d80f434: 00000000 00000000 00000000 00000000
0x1d80f444: 00000000 00000000 00000000 00000000
0x1d80f454: 00000000 00000000 00000000 00000000
0x1d80f464: 00000000 00000000 00000000 21810ff0
0x1d80f474: 00000000 00000000 00000000 0000000c
0x1d80f484: 00000000 00000000 00000000 00000000
Instructions: (pc=0x7c82c6e4)
0x7c82c6d4: 39 89 bd 28 ff ff ff 8b 46 0c 89 85 6c ff ff ff
0x7c82c6e4: 8b 10 3b 57 04 0f 85 1d 4e 01 00 3b d1 0f 85 15
Stack: [0x1d610000,0x1d810000), sp=0x1d80f414, free space=2045k
Native frames: (J=compiled Java code, j=interpreted, Vv=VM code, C=native code)
C [ntdll.dll+0x2c6e4]
C [iwdeploy_hopi.dll+0x200d8d]
C [iwdeploy_hopi.dll+0x200daf]
j com.interwoven.sj100.sciface.objid.()V+5
j com.interwoven.sj100.sciface.submitentry.()V+20
j com.interwoven.ju100.util.TSubmitEvents.NextSubmitEntry()I+5
j com.interwoven.ju100.util.TSubmitEvents.FindSubmitEventByID(Ljava/lang/String
I+112
j com.interwoven.dd100.syncdb.DDUtil.GetIWEvents(Ljava/lang/String;Ljava/lang/String
Lcom/interwoven/ju100/util/TSubmitEvents;+15
j com.interwoven.dd100.syncdb.TUpdateBaseTables.UpdateBaseTables(Ljava/lang/String;Ljava/lang/String
V+67
j com.interwoven.dd100.syncdb.TUpdateBaseTables.ProcessEvent(Ljavax/jms/Message
V+68
j com.interwoven.dd100.syncdb.TEventProcessor.HandleEvent(Ljavax/jms/Message
V+139
j com.interwoven.dd100.syncdb.TEventSubscriber$EventListener.onMessage(Ljavax/jms/Message
V+50
j org.exolab.jms.client.JmsMessageConsumer.onMessage(Ljavax/jms/Message
V+42
j org.exolab.jms.client.JmsSession.execute(Ljava/lang/Object
V+81
j org.exolab.jms.client.JmsSession.onMessage(Ljavax/jms/Message
V+18
j org.exolab.jms.client.mipc.IpcJmsMessageListener.onMessage(Ljava/lang/String;Ljavax/jms/Message
V+20
j org.exolab.jms.client.mipc.IpcJmsMessageListener.run()V+48
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
V [jvm.dll+0xf9950]
Java frames: (J=compiled Java code, j=interpreted, Vv=VM code)
j com.interwoven.sj100.sciface.objid.Construct()V+0
j com.interwoven.sj100.sciface.objid.()V+5
j com.interwoven.sj100.sciface.submitentry.()V+20
j com.interwoven.ju100.util.TSubmitEvents.NextSubmitEntry()I+5
j com.interwoven.ju100.util.TSubmitEvents.FindSubmitEventByID(Ljava/lang/String
I+112
j com.interwoven.dd100.syncdb.DDUtil.GetIWEvents(Ljava/lang/String;Ljava/lang/String
Lcom/interwoven/ju100/util/TSubmitEvents;+15
j com.interwoven.dd100.syncdb.TUpdateBaseTables.UpdateBaseTables(Ljava/lang/String;Ljava/lang/String
V+67
j com.interwoven.dd100.syncdb.TUpdateBaseTables.ProcessEvent(Ljavax/jms/Message
V+68
j com.interwoven.dd100.syncdb.TEventProcessor.HandleEvent(Ljavax/jms/Message
V+139
j com.interwoven.dd100.syncdb.TEventSubscriber$EventListener.onMessage(Ljavax/jms/Message
V+50
j org.exolab.jms.client.JmsMessageConsumer.onMessage(Ljavax/jms/Message
V+42
j org.exolab.jms.client.JmsSession.execute(Ljava/lang/Object
V+81
j org.exolab.jms.client.JmsSession.onMessage(Ljavax/jms/Message
V+18
j org.exolab.jms.client.mipc.IpcJmsMessageListener.onMessage(Ljava/lang/String;Ljavax/jms/Message
V+20
j org.exolab.jms.client.mipc.IpcJmsMessageListener.run()V+48
j java.lang.Thread.run()V+11
v ~StubRoutines::call_stub
--------------- P R O C E S S ---------------
Java Threads: ( => current thread )
0x1dd6e618 JavaThread "Thread-32" [_thread_blocked, id=6256]
0x1a666ee0 JavaThread "Thread-31" [_thread_blocked, id=5116]
0x1f0df9e0 JavaThread "Thread-21" [_thread_blocked, id=932]
0x1b913008 JavaThread "HelperCacheManager" [_thread_blocked, id=3620]
0x188afd58 JavaThread "Thread-20" [_thread_blocked, id=7752]
0x1b7d3e50 JavaThread "Thread-19" [_thread_in_native, id=2320]
0x1dfec978 JavaThread "RMI LeaseChecker" daemon [_thread_blocked, id=2096]
0x199df008 JavaThread "RMI RenewClean-[GEO-TEAMSITE01:24071]" daemon [_thread_blocked, id=4656]
0x1b4abe20 JavaThread "GC Daemon" daemon [_thread_blocked, id=3048]
0x1ee90190 JavaThread "RMI Reaper" [_thread_blocked, id=1052]
0x1ee90008 JavaThread "RMI TCP Accept-24071" daemon [_thread_in_native, id=5516]
0x1ed57c28 JavaThread "SocketListener-4" [_thread_blocked, id=7136]
0x1eeb04a8 JavaThread "SocketListener-3" [_thread_blocked, id=5472]
0x1be39d40 JavaThread "SocketListener-2" [_thread_in_native, id=256]
0x1ed21258 JavaThread "SocketListener-1" [_thread_blocked, id=4052]
0x1bbcf590 JavaThread "SocketListener-0" [_thread_blocked, id=8008]
0x1bc55700 JavaThread "PreloadingThreads-1" daemon [_thread_blocked, id=3940]
0x1b1d5d00 JavaThread "Timer-2" daemon [_thread_blocked, id=7992]
0x1b1d5b78 JavaThread "Timer-1" daemon [_thread_blocked, id=7052]
0x1b105cf8 JavaThread "JmsPublisher" [_thread_blocked, id=6820]
=>0x1a4278d0 JavaThread "Thread-10" [_thread_in_native, id=7728]
0x1b040680 JavaThread "EventManagerThread" [_thread_blocked, id=4092]
0x1b08f920 JavaThread "MessageCopier-0" daemon [_thread_blocked, id=6452]
0x1a098188 JavaThread "MultiplexConnection-geo-teamsite01.ads.mckinsey.com:11237" daemon [_thread_in_native, id=4892]
0x1a7f5da8 JavaThread "Clock Daemon" daemon [_thread_blocked, id=732]
0x1b343148 JavaThread "DDThread" [_thread_in_native, id=6588]
0x1b08b328 JavaThread "Thread-2" [_thread_blocked, id=3168]
0x1a7a1b88 JavaThread "Thread-8" [_thread_blocked, id=5520]
0x1b343d38 JavaThread "Thread-7" [_thread_blocked, id=3200]
0x1b3a6008 JavaThread "Thread-6" [_thread_in_native, id=6260]
0x1989f2b8 JavaThread "Thread-5" [_thread_blocked, id=3116]
0x197a29c8 JavaThread "Thread-4" [_thread_blocked, id=3884]
0x1a253008 JavaThread "RMI TCP Accept-9173" daemon [_thread_in_native, id=6360]
0x19854008 JavaThread "Timer-0" daemon [_thread_blocked, id=5440]
0x1877d858 JavaThread "Low Memory Detector" daemon [_thread_blocked, id=7412]
0x1877c4a8 JavaThread "CompilerThread1" daemon [_thread_blocked, id=3480]
0x1877b598 JavaThread "CompilerThread0" daemon [_thread_blocked, id=6424]
0x1877a958 JavaThread "AdapterThread" daemon [_thread_blocked, id=5288]
0x00e3f960 JavaThread "Finalizer" daemon [_thread_blocked, id=5748]
0x00e3f598 JavaThread "Reference Handler" daemon [_thread_blocked, id=3912]
0x00be6088 JavaThread "main" [_thread_in_native, id=1376]
Other Threads:
0x00e3d358 VMThread [id=416]
0x1877f0f8 WatcherThread [id=8076]
VM state:not at safepoint (normal execution)
VM Mutex/Monitor currently owned by a thread: None
Heap
PSYoungGen total 17280K, used 12143K [0x161d0000, 0x17590000, 0x17e40000)
eden space 14464K, 83% used [0x161d0000,0x16d9fc20,0x16ff0000)
from space 2816K, 1% used [0x16ff0000,0x16ffc000,0x172b0000)
to space 2624K, 0% used [0x17300000,0x17300000,0x17590000)
PSOldGen total 152512K, used 5747K [0x07e40000, 0x11330000, 0x161d0000)
object space 152512K, 3% used [0x07e40000,0x083dcf80,0x11330000)
PSPermGen total 17536K, used 17342K [0x03e40000, 0x04f60000, 0x07e40000)
object space 17536K, 98% used [0x03e40000,0x04f2f888,0x04f60000)
Dynamic libraries:
0x00400000 - 0x00412000
\INTERW~1\OPENDE~1\bin\IWODSE~1.EXE
0x7c800000 - 0x7c8c3000 C:\WINDOWS\system32\ntdll.dll
0x77e40000 - 0x77f42000 C:\WINDOWS\system32\kernel32.dll
0x77380000 - 0x77411000 C:\WINDOWS\system32\USER32.dll
0x77c00000 - 0x77c49000 C:\WINDOWS\system32\GDI32.dll
0x7d1e0000 - 0x7d27c000 C:\WINDOWS\system32\ADVAPI32.dll
0x77c50000 - 0x77cf0000 C:\WINDOWS\system32\RPCRT4.dll
0x76f50000 - 0x76f63000 C:\WINDOWS\system32\Secur32.dll
0x76290000 - 0x762ad000 C:\WINDOWS\system32\IMM32.DLL
0x6d8e0000 - 0x6dc87000
\interwoven\OpenDeployNG\jre\bin\server\jvm.dll
0x76aa0000 - 0x76acd000 C:\WINDOWS\system32\WINMM.dll
0x77ba0000 - 0x77bfa000 C:\WINDOWS\system32\MSVCRT.dll
0x6d300000 - 0x6d308000
\interwoven\OpenDeployNG\jre\bin\hpi.dll
0x76b70000 - 0x76b7b000 C:\WINDOWS\system32\PSAPI.DLL
0x6d710000 - 0x6d71c000
\interwoven\OpenDeployNG\jre\bin\verify.dll
0x6d380000 - 0x6d39d000
\interwoven\OpenDeployNG\jre\bin\java.dll
0x6d730000 - 0x6d73f000
\interwoven\OpenDeployNG\jre\bin\zip.dll
0x19b70000 - 0x19e77000
\interwoven\OpenDeployNG\jre\bin\iwdeploy_hopi.dll
0x00d00000 - 0x00d27000
\INTERW~1\OPENDE~1\bin\SSLEAY32.dll
0x19e80000 - 0x19f4d000
\INTERW~1\OPENDE~1\bin\LIBEAY32.dll
0x71bb0000 - 0x71bb9000 C:\WINDOWS\system32\WSOCK32.dll
0x71c00000 - 0x71c17000 C:\WINDOWS\system32\WS2_32.dll
0x71bf0000 - 0x71bf8000 C:\WINDOWS\system32\WS2HELP.dll
0x71c40000 - 0x71c97000 C:\WINDOWS\system32\NETAPI32.dll
0x6d540000 - 0x6d553000
\interwoven\OpenDeployNG\jre\bin\net.dll
0x71b20000 - 0x71b61000 C:\WINDOWS\System32\mswsock.dll
0x76ed0000 - 0x76efa000 C:\WINDOWS\system32\DNSAPI.dll
0x76f70000 - 0x76f77000 C:\WINDOWS\System32\winrnr.dll
0x76f10000 - 0x76f3e000 C:\WINDOWS\system32\WLDAP32.dll
0x76f80000 - 0x76f85000 C:\WINDOWS\system32\rasadhlp.dll
0x68000000 - 0x68035000 C:\WINDOWS\system32\rsaenh.dll
0x7c8d0000 - 0x7d0cf000 C:\WINDOWS\system32\SHELL32.dll
0x7d180000 - 0x7d1d2000 C:\WINDOWS\system32\SHLWAPI.dll
0x77420000 - 0x77523000 C:\WINDOWS\WinSxS\x86_Microsoft.Windows.Common-Controls_6595b64144ccf1df_6.0.3790.4770_x-ww_05FDF087\comctl32.dll
0x5f270000 - 0x5f2ca000 C:\WINDOWS\system32\hnetcfg.dll
0x71ae0000 - 0x71ae8000 C:\WINDOWS\System32\wshtcpip.dll
0x6d680000 - 0x6d686000
\interwoven\OpenDeployNG\jre\bin\rmi.dll
VM Arguments:
jvm_args: -Xrs -Xss2m -Xms32m -Xmx256m -Djava.rmi.server.codebase=file:/D:\interwoven\OpenDeployNG\lib\odapi_cl100.jar file:/D:\interwoven\OpenDeployNG\openjms\lib\openjms-client-0.7.6.1.jar -Djava.rmi.server.useCodebaseOnly=true -Djava.security.manager -Djava.security.policy=D:\interwoven\OpenDeployNG\lib\deployapi.policy -Dod.home=D:\interwoven\OpenDeployNG -Dod.inst.name=initial exit
java_command:
Launcher Type: generic
Environment Variables:
JAVA_HOME=C:\Program Files\Java\jdk1.6.0_25
PATH=D:\interwoven\OpenDeployNG\jre\bin;D:\oracle\product\10.2.0\client_1\bin;C:\Program Files\Support Tools\;C:\WINDOWS\system32;C:\WINDOWS;C:\WINDOWS\System32\Wbem;C:\WINDOWS\system32\WindowsPowerShell\v1.0;C:\WINDOWS\system32\WindowsPowerShell\v1.0;C:\Program Files\Common Files\Interwoven\lib;d:\Interwoven\TeamSite\bin;C:\Program Files\Zend\ZendServer\bin;C:\Program Files\Zend\ZendServer\share\ZendFramework\bin
OS=Windows_NT
PROCESSOR_IDENTIFIER=x86 Family 15 Model 65 Stepping 3, AuthenticAMD
--------------- S Y S T E M ---------------
OS: Windows Server 2003 family Build 3790 Service Pack 2
CPU:total 2 (cores per cpu 2, threads per core 1) family 15 model 65 stepping 3, cmov, cx8, fxsr, mmx, sse, sse2, sse3, mmxext, 3dnowext, 3dnow
Memory: 4k page, physical 2097151k(2097151k free), swap 4194303k(4194303k free)
vm_info: Java HotSpot(TM) Server VM (1.5.0_14-b03) for windows-x86, built on Oct 5 2007 01:01:51 by "java_re" with MS VC++ 6.0
The iwdd_... log says:
DBD: ERROR
eployment not found
DBD: ERROR:ERROR: Unable to determine operation mode
DBD: ERROR
eployment not found
DBD: ERROR:ERROR: Unable to determine operation mode
DBD: ERROR:Exception occured while executing deployment [basearea]: com.interwoven.ju100.util.TFileSystemElement is in error state - unable to initialize session with null (Unable to establish connection with server)
DBD: ERROR:
java.lang.IllegalArgumentException: com.interwoven.ju100.util.TFileSystemElement is in error state - unable to initialize session with null (Unable to establish connection with server)
at com.interwoven.ju100.util.TSCIUser.Validate(TSCIUser.java:117)
at com.interwoven.ju100.util.TFileSystemElement.GetRelativePath(TFileSystemElement.java:153)
at com.interwoven.dd100.dd.TDCRTupleProducer.AddFSE(TDCRTupleProducer.java:397)
at com.interwoven.dd100.dd.TDCRTupleProducer.EnumerateFiles(TDCRTupleProducer.java:234)
at com.interwoven.dd100.dd.TDCRTupleProducer.(TDCRTupleProducer.java:181)
at com.interwoven.dd100.dd.TAgentClient.DoOneTeamSiteSource(TAgentClient.java:772)
at com.interwoven.dd100.dd.TAgentClient.DoTeamSiteSources(TAgentClient.java:517)
at com.interwoven.dd100.dd.TAgentClient.DoOneDeployment(TAgentClient.java:289)
at com.interwoven.dd100.dd.TAgentClient.Go(TAgentClient.java:178)
at com.interwoven.dd100.dd.IWDataDeploy.Go(IWDataDeploy.java:582)
at com.interwoven.dd100.dd.TDASThread.ProcessItem(TDASThread.java:203)
at com.interwoven.dd100.dd.TDASThread.run(TDASThread.java:128)
