DynamoDB Streams CDC
Hook into DynamoDB Streams for real-time change data capture. Every Put, Update, and Delete event flows to the SQL target with low latency.
Streams-nativeSchema Inference
DynamoDB tables have no fixed schema per item. NoSQLSync samples items across partitions to infer the union schema, detecting all attributes and types.
Smart inferenceGSI & LSI Support
Global and Local Secondary Indexes are analyzed and mapped to SQL indexes. Partition keys become primary keys; sort keys become composite keys.
Index mappingType Mapping
DynamoDB's S/N/B/BOOL/L/M/NULL types auto-map to SQL: String → TEXT, Number → NUMERIC, Binary → BYTEA, Lists → JSONB, Maps → JSONB.
Full type coverageThroughput Management
Configurable RCU/WCU limits prevent source throttling. Pause and resume migration to stay within provisioned capacity.
RCU-awareZero Downtime Cutover
Dual-write keeps DynamoDB and SQL in sync. Validate data integrity, then cut over with instant rollback.
Safe cutoverThree steps to ClickHouse
Type mapping: DynamoDB → ClickHouse
Frequently asked questions
NoSQLSync infers a union schema. Attributes present in only some items become nullable columns. You control whether missing values become NULL or a default value.
CDC via DynamoDB Streams guarantees ordered, at-least-once delivery. NoSQLSync deduplicates events and ensures consistency by comparing checksums after every batch.
Yes. Filter by partition key prefix, sort key range, or with a scan filter expression. Only matching items are migrated.
A typical 100 GB dataset migrates in under 2 hours with bulk mode. With CDC enabled, ongoing writes sync in real time. Total time depends on data volume and network throughput.
Yes. All data is encrypted in transit (TLS 1.3) and at rest (AES-256). Database credentials use short-lived tokens. Migration workers run in an isolated environment and never store data after the job completes.
Yes. Dual-write mode keeps both databases in sync. If you detect issues after cutover, just reverse to the source in one click. Your original data is never modified.
Other migration paths from DynamoDB
Ready to migrate to ClickHouse?
Connect your DynamoDB and ClickHouse instances. No credit card required.