I started my Tools and Frameworks service but XM won’t load.. At times it gets stuck at “Workbench is starting up (107 of 107 bundles activated, 136 of 164 components ready)…” while at other times, it simply loads a blank screen. And following is the error I see in IFCR logs –

I see this in ifcr.log –
17.12.2020 14:09:54.888 *ERROR* [Repository Pinger] org.apache.sling.jcr.jackrabbit.server acquireRepository: Repository problem starting repository from file: /endeca/ToolsAndFrameworks/11.0.0/server/workspace/state/sling/_ifcr/jackrabbit/repository.xml in /endeca/ToolsAndFrameworks/11.0.0/server/workspace/state/sling/_ifcr/jackrabbit (javax.jcr.RepositoryException: internal error: failed to read custom node type definitions stored in /nodetypes/custom_nodetypes.xml) javax.jcr.RepositoryException: internal error: failed to read custom node type definitions stored in /nodetypes/custom_nodetypes.xml         at org.apache.jackrabbit.core.nodetype.NodeTypeRegistry.loadCustomNodeTypeDefs(NodeTypeRegistry.java:879)         at org.apache.jackrabbit.core.nodetype.NodeTypeRegistry.<init>(NodeTypeRegistry.java:791)         at org.apache.jackrabbit.core.RepositoryImpl.createNodeTypeRegistry(RepositoryImpl.java:408)         at org.apache.jackrabbit.core.RepositoryImpl.<init>(RepositoryImpl.java:272)         at org.apache.jackrabbit.core.RepositoryImpl.create(RepositoryImpl.java:589)         at org.apache.sling.jcr.jackrabbit.server.impl.SlingServerRepository.acquireRepository(SlingServerRepository.java:141)         at org.apache.sling.jcr.base.AbstractSlingRepository.startRepository(AbstractSlingRepository.java:795)         at org.apache.sling.jcr.base.AbstractSlingRepository.run(AbstractSlingRepository.java:925)         at java.lang.Thread.run(Thread.java:724) Caused by: java.io.IOException: XML document structures must start and end within the same entity.         at org.apache.jackrabbit.core.util.DOMWalker.<init>(DOMWalker.java:65)         at org.apache.jackrabbit.core.nodetype.xml.NodeTypeReader.<init>(NodeTypeReader.java:108)         at org.apache.jackrabbit.core.nodetype.xml.NodeTypeReader.read(NodeTypeReader.java:77)         at org.apache.jackrabbit.core.nodetype.NodeTypeDefStore.load(NodeTypeDefStore.java:63)         at org.apache.jackrabbit.core.nodetype.NodeTypeRegistry.loadCustomNodeTypeDefs(NodeTypeRegistry.java:873)         … 8 more
And also something like this –
17.12.2020 15:24:41.697 *ERROR* [jackrabbit-pool-46965] org.apache.sling.extensions.threaddump.internal.Activator Uncaught exception in Thread Thread[jackrabbit-pool-46965,5,main] java.lang.OutOfMemoryError: unable to create new native thread
Just to clarify the issue is not related to server CPU memory so don’t waste time on that,
Fix –
  1. Stop endeca ToolsAndFramework service
  2. Take backup of sling directory – /endeca/ToolsAndFrameworks/11.0.0/server/workspace/state/sling/
  3. Delete content of sling directory
    rm -rf /endeca/ToolsAndFrameworks/11.0.0/server/workspace/state/sling/*
  4. Start endeca ToolsAndFramework service

This should fix ..

Bonus – if you are on Linux and not able to stop ToolsAndFramework, kill the service –

Use ps -ef | grep java to list the services, pick the processId for T&F service
Run this – kill <pid>

Cheers,
Mayank Batra

Leave a Reply