FNRCG0014E: GCD_DATABASE_UNAVAILABLE

 A020D310 ENG  FNRCG0014E - ERROR method name: getInstance principal name: Administrator Global Transaction: true User Transaction: false Exception Info: The GCD database is currently not available. A file-based, read-only image of the GCD will be used in its place. All update operations will be disallowed until database availability has been restored.

com.filenet.api.exception.EngineRuntimeException: FNRCG0014E: GCD_DATABASE_UNAVAILABLE: The GCD database is currently not available. A file-based, read-only image of the GCD will be used in its place. All update operations will be disallowed until database availability has been restored.

solved: there are two duplicated datasource name.

FNRCS0005E: SECURITY_INVALID_CREDENTIALS: Access to the Content Engine was not allowed...

com.ibm.ecm.struts.actions.p8.P8LogonAction.createP8Connection()
com.filenet.api.exception.EngineRuntimeException: FNRCS0005E: SECURITY_INVALID_CREDENTIALS: Access to the Content Engine was not allowed because the Content Engine API library or the Web Service Interface (WSI) Listener could not find the required security context information. Expected credentials were not found in the security context.

Solution:

• On the client side WAS instance, set a Java property: -DFileNet.WSI.AutoDetectLTPAToken=true
• On the server side WAS instance, set a Java property: -Dcom.filenet.authentication.token.userid=sso:ltpa

FileUploadException during starting ContentEngine on Websphere

Exception during starting ContentEngine:

[9/16/15 14:35:34:899 CDT] 0000004b WarBasedAxisC E org.apache.axis2.deployment.WarBasedAxisConfigurator <init> org.apache.commons.fileupload.FileUploadException
                                 org.apache.axis2.deployment.DeploymentException: org.apache.commons.fileupload.FileUploadException
        at org.apache.axis2.deployment.AxisConfigBuilder.processMessageBuilders(AxisConfigBuilder.java:774)
        at org.apache.axis2.deployment.AxisConfigBuilder.populateConfig(AxisConfigBuilder.java:234)
        at org.apache.axis2.deployment.DeploymentEngine.populateAxisConfiguration(DeploymentEngine.java:859)
        at org.apache.axis2.deployment.WarBasedAxisConfigurator.<init>(WarBasedAxisConfigurator.java:156)
        at org.apache.axis2.transport.http.AxisServlet.initConfigContext(AxisServlet.java:569)
        at org.apache.axis2.transport.http.AxisServlet.init(AxisServlet.java:457)
        at com.ibm.ws.webcontainer.servlet.ServletWrapper.init(ServletWrapper.java:342)
        at com.ibm.ws.webcontainer.servlet.ServletWrapperImpl.init(ServletWrapperImpl.java:168)
        at com.ibm.ws.webcontainer.servlet.ServletWrapper.loadOnStartupCheck(ServletWrapper.java:1366)
        at com.ibm.ws.webcontainer.webapp.WebApp.doLoadOnStartupActions(WebApp.java:627)
        at com.ibm.ws.webcontainer.webapp.WebApp.commonInitializationFinally(WebApp.java:593)
        at com.ibm.ws.webcontainer.webapp.WebAppImpl.initialize(WebAppImpl.java:422)
        at com.ibm.ws.webcontainer.webapp.WebGroupImpl.addWebApplication(WebGroupImpl.java:88)
        at com.ibm.ws.webcontainer.VirtualHostImpl.addWebApplication(VirtualHostImpl.java:169)
        at com.ibm.ws.webcontainer.WSWebContainer.addWebApp(WSWebContainer.java:749)
        at com.ibm.ws.webcontainer.WSWebContainer.addWebApplication(WSWebContainer.java:634)
        at com.ibm.ws.webcontainer.component.WebContainerImpl.install(WebContainerImpl.java:426)
        at com.ibm.ws.webcontainer.component.WebContainerImpl.start(WebContainerImpl.java:718)
        at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:1177)
        at com.ibm.ws.runtime.component.DeployedApplicationImpl.fireDeployedObjectStart(DeployedApplicationImpl.java:1370)
        at com.ibm.ws.runtime.component.DeployedModuleImpl.start(DeployedModuleImpl.java:639)
        at com.ibm.ws.runtime.component.DeployedApplicationImpl.start(DeployedApplicationImpl.java:968)
        at com.ibm.ws.runtime.component.ApplicationMgrImpl.startApplication(ApplicationMgrImpl.java:776)
        at com.ibm.ws.runtime.component.ApplicationMgrImpl$5.run(ApplicationMgrImpl.java:2195)
        at com.ibm.ws.security.auth.ContextManagerImpl.runAs(ContextManagerImpl.java:5477)
        at com.ibm.ws.security.auth.ContextManagerImpl.runAsSystem(ContextManagerImpl.java:5603)
        at com.ibm.ws.security.core.SecurityContext.runAsSystem(SecurityContext.java:255)
        at com.ibm.ws.runtime.component.ApplicationMgrImpl.start(ApplicationMgrImpl.java:2200)
        at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:435)
        at com.ibm.ws.runtime.component.CompositionUnitImpl.start(CompositionUnitImpl.java:123)
        at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.start(CompositionUnitMgrImpl.java:378)
        at com.ibm.ws.runtime.component.CompositionUnitMgrImpl.access$500(CompositionUnitMgrImpl.java:126)
        at com.ibm.ws.runtime.component.CompositionUnitMgrImpl$CUInitializer.run(CompositionUnitMgrImpl.java:984)
        at com.ibm.wsspi.runtime.component.WsComponentImpl$_AsynchInitializer.run(WsComponentImpl.java:502)
        at com.ibm.ws.util.ThreadPool$Worker.run(ThreadPool.java:1881)
Caused by: java.lang.NoClassDefFoundError: org.apache.commons.fileupload.FileUploadException
        at java.lang.J9VMInternals.verifyImpl(Native Method)
        at java.lang.J9VMInternals.verify(J9VMInternals.java:93)
        at java.lang.J9VMInternals.initialize(J9VMInternals.java:170)
        at java.lang.J9VMInternals.newInstanceImpl(Native Method)
        at java.lang.Class.newInstance(Class.java:1600)
        at org.apache.axis2.deployment.DescriptionBuilder.processMessageBuilders(DescriptionBuilder.java:230)
        at org.apache.axis2.deployment.AxisConfigBuilder.processMessageBuilders(AxisConfigBuilder.java:771)
        ... 34 more
Caused by: java.lang.ClassNotFoundException: org.apache.commons.fileupload.FileUploadException
        at org.eclipse.osgi.internal.loader.BundleLoader.findClassInternal(BundleLoader.java:506)
        at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:422)
        at org.eclipse.osgi.internal.loader.BundleLoader.findClass(BundleLoader.java:410)
        at org.eclipse.osgi.internal.baseadaptor.DefaultClassLoader.loadClass(DefaultClassLoader.java:107)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:690)

Solution is to change class load order:  applications>><appname>> " Class loading and update detection "

dead lock in CPE

 6C7A764B ASYN FNRCE0019E - ERROR Failed updating next retry date {5827F21B-B08B-4205-99FB-D607333DA467}

com.filenet.api.exception.EngineRuntimeException: FNRCE0019E: E_DEADLOCK_ERROR: The operation could not be completed due to a deadlock error. A retry might be appropriate. ObjectStore: "OS1", SQL: ""UPDATE dbo.QueueItem SET epoch_id = epoch_id + 1, modify_date = ?, next_retry_date = GetUTCDate() + DateAdd(s,30,0), lease_expiry_date = NULL WHERE object_id = ?" In-bindings: (2015-04-02,{5827F21B-B08B-4205-99FB-D607333DA467})"

at com.filenet.engine.dbpersist.DBMSSQLContext.throwEngineException(DBMSSQLContext.java:355)

at 

ICN Sync duplicated key exception

Caused by: org.springframework.dao.DataIntegrityViolationException: StatementCallback; SQL [MERGE INTO navigator.wPIo0ATdivsta1h_MANIFEST AS TS USING (VALUES('EC18F932-7155-CE06-8760-4C7E89100000')) AS DAT(OBJECTID) ON TS.OBJECTID = DAT.OBJECTID WHEN NOT MATCHED THEN INSERT (OBJECTID, SUBSCRIPTIONID, ISCONTAINER) VALUES (DAT.OBJECTID, '106295c1-3e59-4124-9074-52fe7dd9517d', 0);]; Violation of UNIQUE KEY constraint 'M_wPIo0ATdivsta1h_I2'. Cannot insert duplicate key in object 'navigator.wPIo0ATdivsta1h_MANIFEST'. The duplicate key value is (EC18F932-7155-CE06-8760-4C7E89100000).; nested exception is com.ibm.websphere.ce.cm.DuplicateKeyException: Violation of UNIQUE KEY constraint 'M_wPIo0ATdivsta1h_I2'. Cannot insert duplicate key in object 'navigator.wPIo0ATdivsta1h_MANIFEST'. The duplicate key value is (EC18F932-7155-CE06-8760-4C7E89100000).

at org.springframework.jdbc.support.SQLErrorCodeSQLExceptionTranslator.doTranslate(SQLErrorCodeSQLExceptionTranslator.java:228)

at org.springframework.jdbc.support.AbstractFallbackSQLExceptionTranslator.translate(AbstractFallbackSQLExceptionTranslator.java:72)

at org.springframework.jdbc.core.JdbcTemplate.execute(JdbcTemplate.java:407)

at org.springframework.jdbc.core.JdbcTemplate.update(JdbcTemplate.java:522)

at com.ibm.ecm.sync.core.db.spring.BaseSpringDAO.createRepositoryObjectWithCallerTransaction(BaseSpringDAO.java:108)

at com.ibm.ecm.sync.core.db.spring.RepositorySpringDAO.registerRepositoryObjectWithSameRegistrationsAsParent(RepositorySpringDAO.java:530)

at com.ibm.ecm.sync.api.RepositoryController.procesNotification(RepositoryController.java:333)

... 31 more

Caused by: com.ibm.websphere.ce.cm.DuplicateKeyException: Violation of UNIQUE KEY constraint 'M_wPIo0ATdivsta1h_I2'. Cannot insert duplicate key in object 'navigator.wPIo0ATdivsta1h_MANIFEST'. The duplicate key value is (EC18F932-7155-CE06-8760-4C7E89100000).

at sun.reflect.GeneratedConstructorAccessor37.newInstance(Unknown Source) 

ICN Sync time out

TH0002        [ERROR] Exception occurred during sync object registration. java.lang.RuntimeException: java.net.SocketTimeoutException: Read timed out

java.lang.RuntimeException: Exception occurred during sync object registration. java.lang.RuntimeException: java.net.SocketTimeoutException: Read timed out

Manually update CPE engine url for ICN

Run below sql on ICN db:

update SYNCREPOSMAPPINGset CONNECTIONINFO='iiop://CPE_IP:CPE_PORT/FileNet/Engine' where id=<realID>