Untitled
unknown
plain_text
2 years ago
6.5 kB
11
Indexable
Cache groups with earliest reserved checkpoint and a reason why a previous checkpoint was inapplicable: [[[grpId=-1593224599, grpName=contact_history_purgatory_index_v2, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1160374730, grpName=FCT_CHANNELID, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1517833338, grpName=contact_history_v2, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=984472552, grpName=DIM_RECENCY_MATRIX__0, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-240445812, grpName=DIM_ACTIVE_CORE_SERVICE_V3__1, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-561714900, grpName=DIM_SUBSCRIBER_D__0, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-738908196, grpName=contact_history_purgatory_v2, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=1419663415, grpName=DIM_SOUNDFILE_IVR__1, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1308210806, grpName=DIM_SERVICES_STATS_V2__0, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1069375090, grpName=DIM_CONTENT__0, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1739125052, grpName=FCT_CONTACT_POLICY_WITH_STRING, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-436475384, grpName=DIM_SUBSCRIBER_S_V3__1, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1409129516, grpName=DIM_COMMUNICATION_TYPE_ATTRS__1, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-774890809, grpName=DIM_INACTIVE_CORE_SERVICE_V3__1, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-306458644, grpName=campaign-subscriber-cache-group, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1607797101, grpName=contact_history_index_v2, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1541810396, grpName=DIM_DEVICE__1, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], [grpId=-1165972642, grpName=DIM_SUBS_LIST__1, cp=(706e8a7a-db4e-47f1-b4f9-900b54c0ac0c, 04/13/2023 03:27:40)], reason=Reserved checkpoint is the oldest in history]]
[2023-04-13 04:31:32,373][INFO][exchange-worker-#351][GridDhtPartitionsExchangeFuture]{} Finish exchange future [startVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], err=null, rebalanced=true, wasRebalanced=true]
[2023-04-13 04:31:32,404][INFO][exchange-worker-#351][GridDhtPartitionsExchangeFuture]{} Completed partition exchange [localNode=a6898653-d5b0-4e0b-adf6-6325bd20d4c9, exchange=GridDhtPartitionsExchangeFuture [topVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], evt=NODE_FAILED, evtNode=TcpDiscoveryNode [id=806d7043-8982-4f4c-bc02-f2a7e3f8edef, consistentId=aa7c5df0-c8e1-485c-8c64-ca18f7dcb96f, addrs=ArrayList [10.12.86.13, 127.0.0.1], sockAddrs=HashSet [/10.12.86.13:47500, /127.0.0.1:47500], discPort=47500, order=13, intOrder=13, lastExchangeTime=1681349463573, loc=false, ver=2.14.0#20220929-sha1:951e8deb, isClient=false], rebalanced=true, done=true, newCrdFut=null], topVer=AffinityTopologyVersion [topVer=15, minorTopVer=0]]
[2023-04-13 04:31:32,404][INFO][exchange-worker-#351][GridDhtPartitionsExchangeFuture]{} Exchange timings [startVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], stage="Waiting in exchange queue" (0 ms), stage="Exchange parameters initialization" (0 ms), stage="Determine exchange type" (42 ms), stage="Preloading notification" (0 ms), stage="After states restored callback" (2 ms), stage="WAL history reservation" (108 ms), stage="Finalize update counters" (21 ms), stage="Detect lost partitions" (23 ms), stage="Exchange done" (20 ms), stage="Total time" (216 ms)]
[2023-04-13 04:31:32,405][INFO][exchange-worker-#351][GridDhtPartitionsExchangeFuture]{} Exchange longest local stages [startVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], resVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=default-volatile-ds-group]" (40 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=FCT_CHANNELID]" (38 ms) (parent=Determine exchange type), stage="Affinity initialization (exchange-free switch on fully-rebalanced topology) [grp=DIM_CONTENT__1]" (38 ms) (parent=Determine exchange type)]
[2023-04-13 04:31:32,405][INFO][exchange-worker-#351][time]{} Finished exchange init [topVer=AffinityTopologyVersion [topVer=15, minorTopVer=0], crd=false]
[2023-04-13 04:31:32,424][INFO][exchange-worker-#351][GridCachePartitionExchangeManager]{} Skipping rebalancing (nothing scheduled) [top=AffinityTopologyVersion [topVer=15, minorTopVer=0], force=false, evt=NODE_FAILED, node=806d7043-8982-4f4c-bc02-f2a7e3f8edef]
[2023-04-13 04:31:32,882][ERROR][ttl-cleanup-worker-#263][ROOT]{} Critical system error detected. Will be handled accordingly to configured handler [hnd=StopNodeOrHaltFailureHandler [tryStop=false, timeout=0, super=AbstractFailureHandler [ignoredFailureTypes=UnmodifiableSet [SYSTEM_WORKER_BLOCKED, SYSTEM_CRITICAL_OPERATION_TIMEOUT]]], failureCtx=FailureContext [type=CRITICAL_ERROR, err=class o.a.i.i.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [groupId=-738908196, pageIds=[], msg=Runtime failure on bounds: [lower=null, upper=PendingRow []]]]]
org.apache.ignite.internal.processors.cache.persistence.tree.CorruptedTreeException: B+Tree is corrupted [groupId=-738908196, pageIds=[], msg=Runtime failure on bounds: [lower=null, upper=PendingRow []]]
at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.corruptedTreeException(BPlusTree.java:6434)
at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1294)
at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1249)
at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1237)
at org.apache.ignite.internal.processors.cache.persistence.tree.BPlusTree.find(BPlusTree.java:1232)
at org.apache.ignite.internal.processors.cache.persistence.GridCacheOffheapManager$GridCacheDataStore.purgeExpiredInternal(GridCacheOffheapManager.java:3061)Editor is loading...