[#CONTINUUM-2241] Continuum constantly re-starting itself - jira.codehaus.org

Details

Type: Bug
Status: Open
Priority: Critical
Resolution: Unresolved
Affects Version/s: 1.3.3 (Beta)
Fix Version/s: 1.4.2 (Beta)
Component/s: None
Labels:
None
Environment:
1.3.3-SNAPSHOT, r776815 and r777534
1.3.4-SNAPSHOT, r781487

Complexity:
Intermediate
Number of attachments :
0

Description

While monitoring vmbuild after upgrading it, I noticed another error 503 as the page refreshed. When I checked the log, I can see it's been re-starting fairly regularly:

imbrium:Downloads wsmoak$ grep started vmbuild-continuum-20090520.log 
2009-05-22 00:33:35,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 01:32:49,367 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 02:23:05,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 03:02:45,942 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 04:11:22,112 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 05:08:31,257 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 06:06:17,363 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 06:53:23,922 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 08:50:13,021 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
2009-05-22 09:18:34,881 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >

Only one of those is an intentional re-start after the upgrade.

Issue Links

This issue is related to:
CONTINUUM-2204	Continuum occasionally failing with "too many open files" after upgrade

Activity

Ascending order - Click to sort in descending order

Hide

Permalink

Wendy Smoak added a comment - 22/May/09 11:40 AM

Here is the same log, showing 10 lines prior to each re-start:

imbrium:Downloads wsmoak$ grep -B10 started vmbuild-continuum-20090520.log 
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 00:33:35,234 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/incubator/sling/trunk
2009-05-22 00:33:35,255 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 00:33:35,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 00:33:35,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 00:33:35,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,320 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,320 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 01:32:49,348 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/incubator/sling/trunk
2009-05-22 01:32:49,365 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 01:32:49,367 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 01:32:49,367 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 01:32:49,367 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,507 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,507 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 02:23:05,535 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 02:23:05,536 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 02:23:05,536 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 02:23:05,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 03:02:45,940 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 03:02:45,942 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 03:02:45,942 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 03:02:45,942 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 04:11:20,566 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/cocoon/trunk
2009-05-22 04:11:22,110 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 04:11:22,111 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 04:11:22,111 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 04:11:22,112 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 05:08:31,154 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/archiva/trunk
2009-05-22 05:08:31,254 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 05:08:31,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 05:08:31,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 05:08:31,257 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 06:06:17,279 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/archiva/trunk
2009-05-22 06:06:17,361 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 06:06:17,362 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:06:17,362 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:06:17,363 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,893 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,893 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,893 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 06:53:23,919 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 06:53:23,921 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:53:23,921 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:53:23,922 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 08:50:13,020 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 08:50:13,021 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 08:50:13,021 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 08:50:13,021 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 09:18:34,858 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/cocoon/trunk
2009-05-22 09:18:34,879 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 09:18:34,880 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 09:18:34,881 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 09:18:34,881 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >

I don't see the normal messages when the wrapper detects a hung jvm and re-starts it. Any idea what's doing this?

Show

Wendy Smoak added a comment - 22/May/09 11:40 AM Here is the same log, showing 10 lines prior to each re-start:

imbrium:Downloads wsmoak$ grep -B10 started vmbuild-continuum-20090520.log 
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 00:33:35,191 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 00:33:35,234 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/incubator/sling/trunk
2009-05-22 00:33:35,255 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 00:33:35,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 00:33:35,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 00:33:35,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,319 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,320 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 01:32:49,320 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 01:32:49,348 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/incubator/sling/trunk
2009-05-22 01:32:49,365 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 01:32:49,367 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 01:32:49,367 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 01:32:49,367 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,506 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,507 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 02:23:05,507 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 02:23:05,535 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 02:23:05,536 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 02:23:05,536 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 02:23:05,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 03:02:45,908 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 03:02:45,940 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 03:02:45,942 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 03:02:45,942 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 03:02:45,942 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 04:11:20,537 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 04:11:20,566 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/cocoon/trunk
2009-05-22 04:11:22,110 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 04:11:22,111 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 04:11:22,111 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 04:11:22,112 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 05:08:31,118 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 05:08:31,154 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/archiva/trunk
2009-05-22 05:08:31,254 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 05:08:31,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 05:08:31,256 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 05:08:31,257 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:06:17,245 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 06:06:17,279 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/archiva/trunk
2009-05-22 06:06:17,361 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 06:06:17,362 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:06:17,362 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:06:17,363 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,892 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,893 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,893 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 06:53:23,893 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 06:53:23,919 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 06:53:23,921 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:53:23,921 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 06:53:23,922 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2202:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 08:50:12,991 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 08:50:13,020 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 08:50:13,021 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 08:50:13,021 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 08:50:13,021 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >
--
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1787:jUDDI Core:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2205:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1790:jUDDI Tomcat Packaging:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  2199:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  1784:jUDDI_v3 Parent:3.0.0.SNAPSHOT:maven2
2009-05-22 09:18:34,825 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  -  106:jstk:2.1:ant
2009-05-22 09:18:34,858 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Fix state for projectScmRoot scm:svn:http://svn.apache.org/repos/asf/cocoon/trunk
2009-05-22 09:18:34,879 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - Starting Continuum.
2009-05-22 09:18:34,880 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 09:18:34,881 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - 
2009-05-22 09:18:34,881 [WrapperSimpleAppMain] INFO  org.apache.maven.continuum.DefaultContinuum  - < Continuum 1.3.3-SNAPSHOT started! >

I don't see the normal messages when the wrapper detects a hung jvm and re-starts it. Any idea what's doing this?

Hide

Permalink

Wendy Smoak added a comment - 22/May/09 11:55 AM

> I don't see the normal messages when the wrapper detects a hung jvm and re-starts it.

That's because the wrapper log is separate now:

from wrapper.log

ERROR  | wrapper  | 2009/05/22 00:31:11 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 00:31:11 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 00:31:12 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 00:31:12 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 00:31:12 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 00:31:42 | Launching a JVM...
INFO   | jvm 43   | 2009/05/22 00:31:43 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 43   | 2009/05/22 00:31:43 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 43   | 2009/05/22 00:31:43 | 
INFO   | jvm 43   | 2009/05/22 00:31:45 | 3 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 43   | 2009/05/22 00:31:47 | 1662 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 43   | 2009/05/22 00:31:47 | 1939 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 01:30:42 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 01:30:42 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 01:30:43 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 01:30:43 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 01:30:43 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 01:31:12 | Launching a JVM...
INFO   | jvm 44   | 2009/05/22 01:31:13 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 44   | 2009/05/22 01:31:13 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 44   | 2009/05/22 01:31:13 | 
INFO   | jvm 44   | 2009/05/22 01:31:14 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 44   | 2009/05/22 01:31:14 | 363 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 44   | 2009/05/22 01:31:14 | 664 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 02:21:09 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 02:21:09 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 02:21:11 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 02:21:11 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 02:21:11 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 02:21:40 | Launching a JVM...
INFO   | jvm 45   | 2009/05/22 02:21:40 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 45   | 2009/05/22 02:21:40 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 45   | 2009/05/22 02:21:40 | 
INFO   | jvm 45   | 2009/05/22 02:21:41 | 1 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 45   | 2009/05/22 02:21:41 | 265 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 45   | 2009/05/22 02:21:41 | 390 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
...
ERROR  | wrapper  | 2009/05/22 03:00:39 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 03:00:39 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 03:00:40 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 03:00:40 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 03:00:40 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 03:01:10 | Launching a JVM...
INFO   | jvm 46   | 2009/05/22 03:01:10 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 46   | 2009/05/22 03:01:10 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 46   | 2009/05/22 03:01:10 | 
INFO   | jvm 46   | 2009/05/22 03:01:11 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 46   | 2009/05/22 03:01:11 | 383 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 46   | 2009/05/22 03:01:11 | 715 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 04:08:52 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 04:08:53 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 04:08:54 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 04:08:54 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 04:08:54 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 04:09:23 | Launching a JVM...
INFO   | jvm 47   | 2009/05/22 04:09:37 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 47   | 2009/05/22 04:09:37 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 47   | 2009/05/22 04:09:37 | 
INFO   | jvm 47   | 2009/05/22 04:09:39 | 3 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 47   | 2009/05/22 04:09:39 | 400 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 47   | 2009/05/22 04:09:40 | 952 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 05:06:35 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 05:06:36 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 05:06:37 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 05:06:37 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 05:06:37 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 05:07:06 | Launching a JVM...
INFO   | jvm 48   | 2009/05/22 05:07:07 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 48   | 2009/05/22 05:07:07 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 48   | 2009/05/22 05:07:07 | 
INFO   | jvm 48   | 2009/05/22 05:07:07 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 48   | 2009/05/22 05:07:07 | 348 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 48   | 2009/05/22 05:07:07 | 535 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 06:04:23 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 06:04:23 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 06:04:24 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 06:04:24 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 06:04:24 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 06:04:54 | Launching a JVM...
INFO   | jvm 49   | 2009/05/22 06:04:55 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 49   | 2009/05/22 06:04:55 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 49   | 2009/05/22 06:04:55 | 
INFO   | jvm 49   | 2009/05/22 06:04:55 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 49   | 2009/05/22 06:04:55 | 380 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 49   | 2009/05/22 06:04:55 | 548 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 06:51:16 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 06:51:16 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 06:51:17 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 06:51:17 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 06:51:17 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 06:51:47 | Launching a JVM...
INFO   | jvm 50   | 2009/05/22 06:51:47 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 50   | 2009/05/22 06:51:47 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 50   | 2009/05/22 06:51:47 | 
INFO   | jvm 50   | 2009/05/22 06:51:48 | 1 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 50   | 2009/05/22 06:51:48 | 565 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 50   | 2009/05/22 06:51:49 | 943 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
STATUS | wrapper  | 2009/05/22 08:48:26 | TERM trapped.  Shutting down.
STATUS | wrapper  | 2009/05/22 08:48:31 | <-- Wrapper Stopped
STATUS | wrapper  | 2009/05/22 08:48:40 | --> Wrapper Started as Daemon
STATUS | wrapper  | 2009/05/22 08:48:40 | Launching a JVM...
INFO   | jvm 1    | 2009/05/22 08:48:42 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 1    | 2009/05/22 08:48:42 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 1    | 2009/05/22 08:48:42 | 
INFO   | jvm 1    | 2009/05/22 08:48:43 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 1    | 2009/05/22 08:48:44 | 939 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 1    | 2009/05/22 08:48:45 | 1727 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 09:16:06 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 09:16:07 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 09:16:08 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 09:16:08 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 09:16:08 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 09:16:38 | Launching a JVM...
INFO   | jvm 2    | 2009/05/22 09:16:39 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 2    | 2009/05/22 09:16:39 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 2    | 2009/05/22 09:16:39 | 
INFO   | jvm 2    | 2009/05/22 09:16:40 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 2    | 2009/05/22 09:16:41 | 607 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 2    | 2009/05/22 09:16:41 | 866 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 09:34:52 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 09:34:53 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 09:34:54 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 09:34:54 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 09:34:54 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 09:35:23 | Launching a JVM...
INFO   | jvm 3    | 2009/05/22 09:35:24 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 3    | 2009/05/22 09:35:24 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 3    | 2009/05/22 09:35:24 | 
INFO   | jvm 3    | 2009/05/22 09:35:24 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 3    | 2009/05/22 09:35:25 | 514 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 3    | 2009/05/22 09:35:25 | 675 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log

Show

Wendy Smoak added a comment - 22/May/09 11:55 AM > I don't see the normal messages when the wrapper detects a hung jvm and re-starts it. That's because the wrapper log is separate now: from wrapper.log

ERROR  | wrapper  | 2009/05/22 00:31:11 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 00:31:11 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 00:31:12 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 00:31:12 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 00:31:12 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 00:31:42 | Launching a JVM...
INFO   | jvm 43   | 2009/05/22 00:31:43 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 43   | 2009/05/22 00:31:43 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 43   | 2009/05/22 00:31:43 | 
INFO   | jvm 43   | 2009/05/22 00:31:45 | 3 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 43   | 2009/05/22 00:31:47 | 1662 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 43   | 2009/05/22 00:31:47 | 1939 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 01:30:42 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 01:30:42 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 01:30:43 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 01:30:43 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 01:30:43 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 01:31:12 | Launching a JVM...
INFO   | jvm 44   | 2009/05/22 01:31:13 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 44   | 2009/05/22 01:31:13 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 44   | 2009/05/22 01:31:13 | 
INFO   | jvm 44   | 2009/05/22 01:31:14 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 44   | 2009/05/22 01:31:14 | 363 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 44   | 2009/05/22 01:31:14 | 664 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 02:21:09 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 02:21:09 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 02:21:11 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 02:21:11 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 02:21:11 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 02:21:40 | Launching a JVM...
INFO   | jvm 45   | 2009/05/22 02:21:40 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 45   | 2009/05/22 02:21:40 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 45   | 2009/05/22 02:21:40 | 
INFO   | jvm 45   | 2009/05/22 02:21:41 | 1 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 45   | 2009/05/22 02:21:41 | 265 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 45   | 2009/05/22 02:21:41 | 390 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
...
ERROR  | wrapper  | 2009/05/22 03:00:39 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 03:00:39 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 03:00:40 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 03:00:40 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 03:00:40 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 03:01:10 | Launching a JVM...
INFO   | jvm 46   | 2009/05/22 03:01:10 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 46   | 2009/05/22 03:01:10 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 46   | 2009/05/22 03:01:10 | 
INFO   | jvm 46   | 2009/05/22 03:01:11 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 46   | 2009/05/22 03:01:11 | 383 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 46   | 2009/05/22 03:01:11 | 715 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 04:08:52 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 04:08:53 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 04:08:54 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 04:08:54 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 04:08:54 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 04:09:23 | Launching a JVM...
INFO   | jvm 47   | 2009/05/22 04:09:37 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 47   | 2009/05/22 04:09:37 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 47   | 2009/05/22 04:09:37 | 
INFO   | jvm 47   | 2009/05/22 04:09:39 | 3 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 47   | 2009/05/22 04:09:39 | 400 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 47   | 2009/05/22 04:09:40 | 952 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 05:06:35 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 05:06:36 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 05:06:37 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 05:06:37 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 05:06:37 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 05:07:06 | Launching a JVM...
INFO   | jvm 48   | 2009/05/22 05:07:07 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 48   | 2009/05/22 05:07:07 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 48   | 2009/05/22 05:07:07 | 
INFO   | jvm 48   | 2009/05/22 05:07:07 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 48   | 2009/05/22 05:07:07 | 348 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 48   | 2009/05/22 05:07:07 | 535 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 06:04:23 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 06:04:23 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 06:04:24 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 06:04:24 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 06:04:24 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 06:04:54 | Launching a JVM...
INFO   | jvm 49   | 2009/05/22 06:04:55 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 49   | 2009/05/22 06:04:55 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 49   | 2009/05/22 06:04:55 | 
INFO   | jvm 49   | 2009/05/22 06:04:55 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 49   | 2009/05/22 06:04:55 | 380 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 49   | 2009/05/22 06:04:55 | 548 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 06:51:16 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 06:51:16 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 06:51:17 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 06:51:17 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 06:51:17 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 06:51:47 | Launching a JVM...
INFO   | jvm 50   | 2009/05/22 06:51:47 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 50   | 2009/05/22 06:51:47 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 50   | 2009/05/22 06:51:47 | 
INFO   | jvm 50   | 2009/05/22 06:51:48 | 1 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 50   | 2009/05/22 06:51:48 | 565 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 50   | 2009/05/22 06:51:49 | 943 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
STATUS | wrapper  | 2009/05/22 08:48:26 | TERM trapped.  Shutting down.
STATUS | wrapper  | 2009/05/22 08:48:31 | <-- Wrapper Stopped
STATUS | wrapper  | 2009/05/22 08:48:40 | --> Wrapper Started as Daemon
STATUS | wrapper  | 2009/05/22 08:48:40 | Launching a JVM...
INFO   | jvm 1    | 2009/05/22 08:48:42 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 1    | 2009/05/22 08:48:42 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 1    | 2009/05/22 08:48:42 | 
INFO   | jvm 1    | 2009/05/22 08:48:43 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 1    | 2009/05/22 08:48:44 | 939 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 1    | 2009/05/22 08:48:45 | 1727 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 09:16:06 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 09:16:07 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 09:16:08 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 09:16:08 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 09:16:08 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 09:16:38 | Launching a JVM...
INFO   | jvm 2    | 2009/05/22 09:16:39 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 2    | 2009/05/22 09:16:39 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 2    | 2009/05/22 09:16:39 | 
INFO   | jvm 2    | 2009/05/22 09:16:40 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 2    | 2009/05/22 09:16:41 | 607 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 2    | 2009/05/22 09:16:41 | 866 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log
ERROR  | wrapper  | 2009/05/22 09:34:52 | JVM appears hung: Timed out waiting for signal from JVM.
ERROR  | wrapper  | 2009/05/22 09:34:53 | JVM did not exit on request, terminated
STATUS | wrapper  | 2009/05/22 09:34:54 | JVM exited in response to signal SIGKILL (9).
ERROR  | wrapper  | 2009/05/22 09:34:54 | Unable to start a JVM
STATUS | wrapper  | 2009/05/22 09:34:54 | on_exit trigger matched.  Restarting the JVM.  (Exit code: 1)
STATUS | wrapper  | 2009/05/22 09:35:23 | Launching a JVM...
INFO   | jvm 3    | 2009/05/22 09:35:24 | Wrapper (Version 3.2.3) http://wrapper.tanukisoftware.org
INFO   | jvm 3    | 2009/05/22 09:35:24 |   Copyright 1999-2006 Tanuki Software, Inc.  All Rights Reserved.
INFO   | jvm 3    | 2009/05/22 09:35:24 | 
INFO   | jvm 3    | 2009/05/22 09:35:24 | 2 [WrapperSimpleAppMain] INFO org.mortbay.log - Logging to org.slf4j.impl.SimpleLogger(org.mortbay.log) via org.mortbay.log.Slf4jLog
INFO   | jvm 3    | 2009/05/22 09:35:25 | 514 [WrapperSimpleAppMain] WARN org.mortbay.log - Deprecated configuration used for ./apps
INFO   | jvm 3    | 2009/05/22 09:35:25 | 675 [WrapperSimpleAppMain] INFO org.mortbay.log - Redirecting stderr/stdout to /home/continuum/services/continuum/logs/2009_05_22.stderrout.log

Hide

Permalink

Wendy Smoak added a comment - 22/May/09 4:34 PM - edited

Continuum on vmbuild has re-started 17 times so far today, and when it re-starts, the build queue is empty. This means projects aren't building, because they're not making it through the queue before it goes down again.

Info on previous restarts by day:

$ grep started! continuum.log.2009-05-21 | wc -l
31
$ grep started! continuum.log.2009-05-20 | wc -l
26
$ grep started! continuum.log.2009-05-19 | wc -l
24
$ grep started! continuum.log.2009-05-18 | wc -l
25
$ grep started! continuum.log.2009-05-17 | wc -l
23
$ grep started! continuum.log.2009-05-16 | wc -l
24
$ grep started! continuum.log.2009-05-15 | wc -l
24
$ grep started! continuum.log.2009-05-14 | wc -l
24
$ grep started! continuum.log.2009-05-13 | wc -l
15
$ grep started! continuum.log.2009-05-12 | wc -l
7
$ grep started! continuum.log.2009-05-11 | wc -l
7
$ grep started! continuum.log.2009-05-10 | wc -l
4
$ grep started! continuum.log.2009-05-09 | wc -l
6
$ grep started! continuum.log.2009-05-08 | wc -l
8
$ grep started! continuum.log.2009-05-07 | wc -l
5
$ grep started! continuum.log.2009-05-06 | wc -l
7
$ grep started! continuum.log.2009-05-05 | wc -l
7
$ grep started! continuum.log.2009-05-04 | wc -l
6
$ grep started! continuum.log.2009-05-03 | wc -l
5
$ grep started! continuum.log.2009-05-02 | wc -l
3
$ grep started! continuum.log.2009-05-01 | wc -l
5
$ grep started! continuum.log.2009-04-30 | wc -l
5
$ grep started! continuum.log.2009-04-29| wc -l
9
$ grep started! continuum.log.2009-04-28 | wc -l
7
$ grep started! continuum.log.2009-04-27 | wc -l
7
$ grep started! continuum.log.2009-04-26 | wc -l
8
$ grep started! continuum.log.2009-04-25 | wc -l
7
$ grep started! continuum.log.2009-04-24 | wc -ll
8
$ grep started! continuum.log.2009-04-23 | wc -l
20
$ grep started! continuum.log.2009-04-22 | wc -l
22

Looks like something bad happened when I upgraded on May 13th, it was [relatively] better before that.

Show

Wendy Smoak added a comment - 22/May/09 4:34 PM - edited Continuum on vmbuild has re-started 17 times so far today, and when it re-starts, the build queue is empty. This means projects aren't building, because they're not making it through the queue before it goes down again. Info on previous restarts by day:

$ grep started! continuum.log.2009-05-21 | wc -l
31
$ grep started! continuum.log.2009-05-20 | wc -l
26
$ grep started! continuum.log.2009-05-19 | wc -l
24
$ grep started! continuum.log.2009-05-18 | wc -l
25
$ grep started! continuum.log.2009-05-17 | wc -l
23
$ grep started! continuum.log.2009-05-16 | wc -l
24
$ grep started! continuum.log.2009-05-15 | wc -l
24
$ grep started! continuum.log.2009-05-14 | wc -l
24
$ grep started! continuum.log.2009-05-13 | wc -l
15
$ grep started! continuum.log.2009-05-12 | wc -l
7
$ grep started! continuum.log.2009-05-11 | wc -l
7
$ grep started! continuum.log.2009-05-10 | wc -l
4
$ grep started! continuum.log.2009-05-09 | wc -l
6
$ grep started! continuum.log.2009-05-08 | wc -l
8
$ grep started! continuum.log.2009-05-07 | wc -l
5
$ grep started! continuum.log.2009-05-06 | wc -l
7
$ grep started! continuum.log.2009-05-05 | wc -l
7
$ grep started! continuum.log.2009-05-04 | wc -l
6
$ grep started! continuum.log.2009-05-03 | wc -l
5
$ grep started! continuum.log.2009-05-02 | wc -l
3
$ grep started! continuum.log.2009-05-01 | wc -l
5
$ grep started! continuum.log.2009-04-30 | wc -l
5
$ grep started! continuum.log.2009-04-29| wc -l
9
$ grep started! continuum.log.2009-04-28 | wc -l
7
$ grep started! continuum.log.2009-04-27 | wc -l
7
$ grep started! continuum.log.2009-04-26 | wc -l
8
$ grep started! continuum.log.2009-04-25 | wc -l
7
$ grep started! continuum.log.2009-04-24 | wc -ll
8
$ grep started! continuum.log.2009-04-23 | wc -l
20
$ grep started! continuum.log.2009-04-22 | wc -l
22

Looks like something bad happened when I upgraded on May 13th, it was [relatively] better before that.

Hide

Permalink

Wendy Smoak added a comment - 03/Jun/09 3:37 PM

Related thread: http://www.nabble.com/stability-problems-on-vmbuild-td23736253.html

vmbuild was upgraded to 1.3.4-SNAPSHOT r781487 on June 3

Show

Wendy Smoak added a comment - 03/Jun/09 3:37 PM Related thread: http://www.nabble.com/stability-problems-on-vmbuild-td23736253.html vmbuild was upgraded to 1.3.4-SNAPSHOT r781487 on June 3

Hide

Permalink

Wendy Smoak added a comment - 05/Jun/09 4:53 PM

The wrapper log shows "JVM appears hung":
27 times on June 3
29 times on June 4
16 times so far today on June 5

This is with 1.3.4-SNAPSHOT r781487 from the June 3 upgrade.

Show

Wendy Smoak added a comment - 05/Jun/09 4:53 PM The wrapper log shows "JVM appears hung": 27 times on June 3 29 times on June 4 16 times so far today on June 5 This is with 1.3.4-SNAPSHOT r781487 from the June 3 upgrade.

Hide

Permalink

Wendy Smoak added a comment - 12/Jun/09 6:01 PM

On dev@ Emmanuel mentioned reducing the JVM memory to 1024m.

I'm still seeing it re-start constantly... 26 times so far today.

similarly,
wsmoak@vmbuild:/home/continuum/services/continuum/logs$ grep started! continuum.log | wc -l
28

Show

Hide

Permalink

Brett Porter added a comment - 21/Aug/09 2:33 PM

need to check how this is with 1.3.4 now

Show

Brett Porter added a comment - 21/Aug/09 2:33 PM need to check how this is with 1.3.4 now

People

Assignee:

Unassigned

Reporter:

Wendy Smoak

Vote (0)

Watch (0)

Dates

Created:

22/May/09 11:34 AM

Updated:

16/Jul/11 7:47 PM