Sitecore.XDB.ReshardingTool

KO | EN

gitlite — search

#javascript #hacktoberfest #go #rust #nodejs #windows #awesome #cli #kubernetes #vue #awesome-list #ios #openai #open-source

Sitecore.XDB.ReshardingTool

(★ 9)

No description available.

Sitecore.XDB.ReshardingTool 최신버젼 다운로드

최종 버전 다운로드 (.zip)

// repository documentation

Was this content helpful?

★ 0 (0 ratings)

# Sitecore.XDB.ReshardingTool
This is the simple resharding tool for moving Sitecore XDB data from 'n' shards to 'm' shards. Tested on **Sitecore 9.1** version.
## Configurations
In the `appsettings.json` file: 
- Add connections strings for source and target shard map managers
- Change batch size
- Change shard map names
- Configure from what date need to move interactions (format:`yyyy-MM-dd`)
- For `RESUME` mode need to configure `resharding.log` connection string

**NOTE:** For create log database for `RESUME` mode use [Sitecore.XDB.ReshardingLog.sql](https://github.com/pblrok/Sitecore.XDB.ReshardingTool/blob/master/Sitecore.XDB.ReshardingLog.sql) file.
```
{
  "AppSettings": {
    "RetryCount": 3,
    "RetryDelay": 1000,
    "BatchSize": 100000,
    "ConnectionTimeout": 300,
    "ContactIdShardMap": "ContactIdShardMap",
    "DeviceProfileIdShardMap": "DeviceProfileIdShardMap",
    "ContactIdentifiersIndexShardMap": "ContactIdentifiersIndexShardMap",
    "InteractionsFromDate": "2019-09-01",
    "InteractionsFilterByEventDefinitions": [ "2a65acc5-9851-40dd-851b-23f7a6c53092", "0fd3ef44-6c4a-40ce-8f97-6197bd9c61f2" ]
  },
  "ConnectionStrings": {
    "collection.source": "user id=sa;password=Password1!;data source=.\\SQLENTERPRISE;Initial Catalog=test1_Xdb.Collection.ShardMapManager",
    "collection.target": "user id=sa;password=Password1!;data source=.\\SQLENTERPRISE;Initial Catalog=test2_Xdb.Collection.ShardMapManager",
    "resharding.log": "user id=sa;password=Password1!;data source=.\\SQLENTERPRISE;Initial Catalog=Sitecore.XDB.ReshardingLog"
  }
}
```
**NOTE:** `collectionuser` that is used by default in `collection` connection string doesn't have read/wright access to entity tables, so need to use `sa` or create a new user that has permissions

## How to use
**1.** When the `appsettings.json` file is configured just run `...\ToolReleases\win-x64> .\Sitecore.XDB.ReshardingTool.exe` and choose a command that you want.
![alt text](https://github.com/pblrok/Sitecore.XDB.ReshardingTool/blob/master/Sitecore.XDB.ReshardingTool_use.png)

**NOTE:** for see details open `log{date}.txt` log file.

**2.** When the resharding process will be done start reindexing but need to **clean up index cores** before or you will get `IncompatibleSyncTokensException` exceptions.
```
[Error] Failed indexing next set of changes. There will be an attempt to recover from the failure.
Sitecore.Xdb.Collection.Failures.IncompatibleSyncTokensException: Tokens are incompatible, they have different set of shards.
   at Sitecore.Xdb.Collection.Data.SqlServer.Managers.ChangeTracking.SyncToken.IsUpToDate(ISyncToken syncToken)
   at Sitecore.Xdb.Collection.Data.SqlServer.SqlDataProvider.<GetChanges>d__16.MoveNext()
--- End of stack trace from previous location where exception was thrown ---
```

## How to install `m` shards
Download [Installation files](https://github.com/pblrok/Sitecore.XDB.ReshardingTool/tree/master/Shards.Install). Update installation params in `CreateXDB.ps1`.

**NOTE:** Files were tested on `SIF 2.1.0`.

`CreateXDB.json` is configured for 4 shards, you only need to update the `CreateXDB.json` file if you want to add more shards.
![alt text](https://github.com/pblrok/Sitecore.XDB.ReshardingTool/blob/master/shards_variables.png)
![alt text](https://github.com/pblrok/Sitecore.XDB.ReshardingTool/blob/master/shards_db_user.png)
![alt text](https://github.com/pblrok/Sitecore.XDB.ReshardingTool/blob/master/shard_remove_dbs.png)

## Updates 10/21/2019
 - fixed the issue with shard mapping (Added partition key generator)

Sitecore.XDB.ReshardingTool

Sitecore.XDB.ReshardingTool 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Sitecore.XDB.ReshardingTool

Sitecore.XDB.ReshardingTool 최신버젼 다운로드

오늘의 추천 프로젝트

Was this content helpful?

Recent Feedback

Download README