Epic: Dataset Transformation System

[deepakduggirala]

Support transformations like compression, renaming, format conversion.

Tasks:

• push-transform-framework

  • Define transformation DSL and execution engine

• push-transform-rename-impl

  • Implement renaming transformation support

• push-transform-compression-impl

  • Implement tar.gz/zip compression support

• push-transform-format-convert-impl

  • Support CSV → Parquet or other basic conversions

• push-transform-side-effect-checks

  • Ensure transformations operate only on scratch copy

• push-transform-logging

  • Record all transformation rules + results in metadata