TS 7.3.1, Solaris.
We have narrowed it down to when a specific WFT finishes, (we get the job complete email) a specific command is running in iwserver.sol.
This runs for 1000 seconds or so and queues up everything behind it.
iwstat output (when it starts):
2832: Thu Dec 4 14:49:17 2014
Store Status
default Running
iwadmin Running
workflow Running
ID Thread User Duration Store Operation
0x7c96b 0x44 root 0.000 - GetServerStatus
0x7c96a 0x7d4 username 0.823 default GetParentAssociations 0x000010085480e4d16000225a
The server becomes responsive and iwserver.sol is CPU bound. We have to kill it an umount everything.
I am confused as to what is happening.