What's Changed

• DMS: Added option ignore_ddl to ignore DDL events
• DMS: Added direct column mapping
• DMS: Started using direct column mapping by default
• DMS: Started using the mapping value OBJECT when defining column types

Details

• DMS: Add option ignore_ddl to ignore DDL events by @amotl in #119
• DMS: Add direct column mapping by @amotl in #120

Full Changelog: v0.0.23...v0.0.24

What's Changed

• Dependencies: Migrated from zyp to tikray. It's effectively the
  same, but provided using a dedicated package now
• CI: Added support for Python 3.13
• DMS: Fixed handling of primary keys
• DMS: Added support for the previously missing drop-table operation
• DMS: Fixed primary key / where clause rendering

Details

• Chore(deps): Update pyproject-fmt requirement from <2.5 to <2.6 by @dependabot in #80
• Chore(deps): Update poethepoet requirement from <0.30 to <0.31 by @dependabot in #82
• Chore(deps): Update pytest-cov requirement from <6 to <7 by @dependabot in #81
• Chore(deps): Bump codecov/codecov-action from 4 to 5 by @dependabot in #86
• Dependency updates 2024-12 by @amotl in #88
• Chore(deps): Update mypy requirement from <1.14 to <1.15 by @dependabot in #89
• Chore: Update to poethepoet<1 by @amotl in #93
• Chore(deps): Update attrs requirement from <25 to <26 by @dependabot in #92
• Chore(deps): Update ruff requirement from <0.9 to <0.10 by @dependabot in #91
• Chore(deps): Update pymongo requirement from <4.11 to <4.12 by @dependabot in #94
• Chore(deps): Update mypy requirement from <1.15 to <1.16 by @dependabot in #95
• Chore(deps): Update ruff requirement from <0.10 to <0.12 by @dependabot in #97
• Chore(deps): Update pymongo requirement from <4.12 to <4.13 by @dependabot in #98
• Chore(deps): Update mypy requirement from <1.16 to <1.17 by @dependabot in #99
• Chore(deps): Update cattrs requirement from <25 to <26 by @dependabot in #100
• Dependencies: Migrate from zyp to tikray by @amotl in #105
• CI: Add support for Python 3.13 by @amotl in #106
• Chore(deps): Update pymongo requirement from <4.13 to <4.14 by @dependabot in #108
• DMS: Fix handling of primary keys by @amotl in #104
• DMS: Add handling of the previously missing drop-table operation by @amotl in #107
• DMS: Fix primary key / where clause rendering by @amotl in #114
• Chore(deps): Update ruff requirement from <0.12 to <0.13 by @dependabot in #115

Full Changelog: v0.0.22...v0.0.23

What's Changed

• DynamoDB/Testing: Use CrateDB nightly again
• DynamoDB: Use ON CONFLICT DO NOTHING clause on CDC operations
  of type INSERT, to mitigate errors when events are relayed
  redundantly from retries after partially failed batches on the
  Lambda processor.

Details

• Chore(deps): Update pyproject-fmt requirement from <2.3 to <2.4 by @dependabot in #70
• Chore(deps): Update sphinxcontrib-mermaid requirement from <1 to <2 by @dependabot in #71
• Chore(deps): Update mypy requirement from <1.12 to <1.13 by @dependabot in #72
• Chore(deps): Update ruff requirement from <0.7 to <0.8 by @dependabot in #74
• Chore(deps): Update pyproject-fmt requirement from <2.4 to <2.5 by @dependabot in #73
• Chore(deps): Update validate-pyproject requirement from <0.21 to <0.22 by @dependabot in #75
• DynamoDB/Testing: Use CrateDB nightly again by @amotl in #76
• Chore(deps): Update validate-pyproject requirement from <0.22 to <0.23 by @dependabot in #78
• Chore(deps): Update mypy requirement from <1.13 to <1.14 by @dependabot in #79
• DynamoDB: Use ON CONFLICT DO NOTHING clause on INSERT CDC operations by @amotl in #77

Full Changelog: v0.0.21...v0.0.22

What's Changed

• MongoDB: Fixed BSON decoding of {"$date": 1180690093000} timestamps
• DynamoDB: Use CrateDB 5.8.3 for testing because 5.8.4 can no longer
  store ARRAYs with varying inner types into OBJECT(IGNORED) columns.

Details

• Chore(deps): Update toolz requirement from <0.13 to <1.1 by @dependabot in #66
• Chore(deps): Update pymongo requirement from <4.10 to <4.11 by @dependabot in #68
• DynamoDB and MongoDB: Fix CI and improve decoding by @amotl in #69

Full Changelog: v0.0.20...v0.0.21

What's Changed

• DynamoDB: Change CrateDB data model to use (pk, data, aux) columns
  Attention: This is a breaking change.
• MongoDB: Handle too large $date.$numberLong values gracefully
• Zyp/Moksha: Improve error reporting when rule evaluation fails

Details

• Chore(deps): Update poethepoet requirement from <0.29 to <0.30 by @dependabot in #62
• Chore(deps): Update validate-pyproject requirement from <0.20 to <0.21 by @dependabot in #63
• DynamoDB: Change CrateDB data model to use (pk, data, aux) columns by @amotl in #64
• Improvements for Zyp/Moksha error reporting and MongoDB $date.$numberLong values by @amotl in #65

Full Changelog: v0.0.19...v0.0.20

What's Changed

• DynamoDB CDC: Fix MODIFY operation by propagating NewImage fully by @amotl in #60
• Zyp/Moksha: Improve error reporting when rule evaluation fails by @amotl in #61

Full Changelog: v0.0.18...v0.0.19

What's Changed

• MongoDB: Improved MongoDBCrateDBConverter.decode_canonical to also
  decode non-UUID binary values
• Zyp/Moksha/jq: to_object function now respects a zap option, that
  removes the element altogether if it's empty
• Zyp/Moksha/jq: Improve error reporting at MokshaTransformation.apply
• MongoDB: Improved MongoDBCrateDBConverter.decode_extended_json

Details

• Chore(deps): Update pymongo requirement from <4.9 to <4.10 by @dependabot in #55
• Zyp and MongoDB: A few adjustments and refinements by @amotl in #57
• MongoDB: Fix BSON decoder by @amotl in #59

Full Changelog: v0.0.17...v0.0.18

What's Changed

• MongoDB: Fix edge case when decoding MongoDB Extended JSON elements by @amotl in #52
• Zyp: This and that: Mostly documentation and software tests by @amotl in #53
• Zyp: Export main symbols via zyp namespace by @amotl in #54

Full Changelog: v0.0.16...v0.0.17

What's Changed

• MongoDB: Added MongoDBFullLoadTranslator and MongoDBCrateDBConverter
• Zyp: Fixed execution of collection transformation
• Zyp: Added software test and documentation about flattening lists
• MongoDB: Use bson package to parse BSON CANONICAL representation
• MongoDB: Complete and verify BSON data type mapping end-to-end
• MongoDB: Use improved decoding machinery also for MongoDBCDCTranslator
• Dependencies: Make MongoDB subsystem not strictly depend on Zyp
• Zyp: Translate a few special treatments to jq-based MokshaTransformation again
• Zyp: Improve documentation
• Packaging: Add missing MANIFEST.in

Details

• MongoDB: Code refactoring and generalization by @amotl in #49
• Zyp: Improve jq-based Moksha transformations and general documentation by @amotl in #50

Full Changelog: v0.0.15...v0.0.16

What's Changed

• Zyp Treatments: A slightly tailored transformation subsystem by @amotl in #46

Full Changelog: v0.0.14...v0.0.15