Skip to content

Releases: DataKitchen/dataops-testgen

4.39.2

08 Jan 20:45

Choose a tag to compare

Features

  • notifications: Adding Test Run notifications (52382e8)
  • notifications: Adding Score drop notifications (e1dc227)
  • notifications: Miscellaneous fixes (7be4abc)
  • notifications: Adding Profiling Run notifications (57d697e)
  • notifications: Miscellaneous fixes and unit tests (c543bc1)

Bug Fixes

  • emails: update score drop template styles (43e71c9)
  • emails: update test run template to avoid flex styles (3de9098)
  • emails: update profiling run template (9a612fb)
  • emails: normalize test definition id in results diff (c2c2577)
  • table freshness: bugs in calculating historical thresholds (61bbf7c)
  • misc ui improvements (a98d0b5)
  • emails: add empty state message when smtp server not configured (91ff18b)

Miscellaneous

Docker Image

datakitchen/dataops-testgen:v4.39.2

PyPI Package

dataops-testgen==4.39.2

4.38.7

16 Dec 20:54

Choose a tag to compare

Bug Fixes

  • test definitions: add dialog error (fdb3ce9)

Docker Image

datakitchen/dataops-testgen:v4.38.7

PyPI Package

dataops-testgen==4.38.7

4.38.6

15 Dec 18:39

Choose a tag to compare

Bug Fixes

  • pass signal (275e16a)
  • typing for filter options (62de7ba)
  • score-breakdown: prevent infinite looping and make defaulting logic consistent (81a63af)
  • temporarily disable Schema Drift test (a8d6549)

Docker Image

datakitchen/dataops-testgen:v4.38.6

PyPI Package

dataops-testgen==4.38.6

4.38.3

02 Dec 21:34

Choose a tag to compare

Features

  • profiling: add progress, approx row counts and error handling (f5f0673)
  • sampling: Apply sampling to subqueries (da60a0d)
  • test-execution: add progress and error handling (1d1f68f)
  • notifications: Adding basic email sending functionality (2842a4c)
  • test-definitions: add sort dropdown (5be70ce)
  • connections: connect to azure mssql using managed identities (b2ce30d)

Bug Fixes

  • Updating services images to point to bitnamis legacy repo (809d25a)
  • db-data-type: handle null values (e9c196d)
  • runs: empty state css (10e0d86)
  • address pr feedback (2e0bc64)
  • scores: profiling rollup queries retrieval (056024a)
  • schedules: migrate test run schedules to use id (bebfae5)
  • test-generation: handle pipes and newlines in LOV Match test (94526a0)
  • lookup: add templated limit counts to lookup queries (1c1096e)
  • grid: initial selection not working (c93d08b)
  • test: improve table freshness test to avoid overflow (d173535)
  • address review comments (433177b)
  • update default max query chars (4c4fe4f)
  • ui: profiling dialog error (458d77d)
  • test-results: error on refresh score (b1cb525)
  • error on download dialog (a38786f)
  • profiling-runs: error on cancel and improve display (57c8447)
  • test-runs: improve display for canceled runs (6a17e3f)
  • quality-dashboard: scorecard display and sorting (808542f)
  • test-execution: improve progress tooltip (9b54583)

Miscellaneous

Docker Image

datakitchen/dataops-testgen:v4.38.3

PyPI Package

dataops-testgen==4.38.3

4.32.5

13 Oct 18:13

Choose a tag to compare

Features

  • bigquery: Adding BigQuery to the connections pages (76ad544)
  • bigquery: Support BigQuery for Profiling (b9ef2b4)
  • bigquery: Support BigQuery for Test Generation (74a9569)
  • add support for redshift spectrum (6fcca5e)
  • pagination: paginate grid component (53bfb66)
  • project-dashboard: display data point counts (1f58efb)
  • schedules: support pausing/resuming job schedules (4b57cd7)
  • hygiene-issues: add summary counts component (d060b0e)
  • monitor: add data structure log (f07de29)
  • data-type: track database data type for columns (a38046d)

Bug Fixes

  • connection: save button not enabled correctly when switching flavors (cab8b61)
  • sorting selector: selected items not sorted correctly (c60a840)
  • sql: quote snowflake identifiers correctly (35ccbef)
  • tests: don't quote columns in Timeframe Combo Match (cc50412)
  • redshift: profiling error for timestamps with time zone (4d1e261)
  • postgres: profiling bugs on money and time data types (32517ab)
  • Applying sampling to the secondary profiling query (3c7f5ea)
  • pagination: handle invalid page in query (2f86195)
  • Updating services images to point to bitnamis legacy repo (56ec66d)
  • source-data: fix lookup queries for Valid_US_Zip3 test (2c35f44)
  • source-data: set max height for sql query (919eb3e)
  • table freshness: arithmetic overflow in mssql (ca67e56)
  • test-results: add details text to bottom section (b67008d)
  • project-dashboard: improve css responsiveness (fc71112)
  • connection-form: validation on file fields, clear db fields (8cd4849)
  • test-validation: detect missing columns in Dupe_Rows test (2fe741a)
  • logs: suppress noisy logs during setup and upgrade (62252a9)
  • mssql: arithmetic overflow error in Incr_Avg_Shift test (a1500cd)
  • add QUOTE to test and lookup queries to support non-standard identifiers (5edee1e)
  • hygiene-issues: numeric value out of range error (d4076a1)
  • test-validation: handle commas in column names (b5af463)
  • miscellaneous qa fixes (af22198)
  • sampling: trim quotes in estimate query (007a17a)
  • profiling-results: make filters consistent with hygiene issues (8fd8cc8)
  • grid: remove unpaginated filter and sort (5d0f4d0)
  • connection: unnecessary rerender of file input (1f540de)
  • hygiene-issues: include potential pii in possible count (7b4d688)
  • clear cache on page refresh (d2e2246)

Refactors

  • run-pages: move filters and pagination to vanjs (c83787d)

Miscellaneous

  • Addressing code review feedback (730c1b6)

Docker Image

datakitchen/dataops-testgen:v4.32.5

PyPI Package

dataops-testgen==4.32.5

testgen-services-0.1.1

07 Oct 01:50
e9c7bb2

Choose a tag to compare

A Helm chart for Kubernetes

4.26.1

17 Sep 05:40

Choose a tag to compare

Features

  • schedules: add cron expression editor component (7859cb5)
  • connections: add warehouse field to snowflake form (68b0dc2)
  • display sql query in source data dialogs (6b004cb)
  • tests: generate a monitor suite for new table groups (97fb07a)
  • ui: allow filtering timezone dropdown (e41338a)

Bug Fixes

  • analytics: error in username (18a0d63)
  • test suites: allow spaces in name (f3d40cb)
  • exports: add schema header detail and remove column (7bd44ef)
  • apply case insensitive sorting (c05c344)
  • application logs: make search case insensitive (f2fbce6)
  • connections: set snowflake account in connection url (3712b8b)
  • connections: enforce required url and private key (ce5122c)
  • incorrect test counts in generate tests warning (94b67ab)
  • Fixing LOV_All input (af7dd51)
  • append snowflake computing domain when missing (9cb87e8)
  • table freshness: filter general type in fingerprint (646f38f)
  • prevent STDEV overflow error (a893d2c)
  • general types: update schema ddf queries (0ffba6d)
  • profiling: increase char limit when calculating pattern (9c78277)
  • mssql: update is_date function (f44230c)
  • copy tests: bugs when copying multiple and table tests (b3f1c90)
  • hygiene issues: sort by likelihood first (4dff068)

Refactors

  • validate required fields for connections (1702008)
  • connections: stop creating an initial connection (8661083)

Miscellaneous

  • Allow re-using the existing users and roles (b30bc62)

Docker Image

datakitchen/dataops-testgen:v4.26.1

PyPI Package

dataops-testgen==4.26.1

4.22.2

25 Aug 16:34

Choose a tag to compare

Features

  • add partial name filter to table group list (603828c)
  • forms: improve field validation (d4d198f)
  • radio-group: support vertical layout (ab190bd)
  • add history related fields to test definitions (2cdffe6)
  • tests: add log severity (614747e)
  • tests: customize visualization for stale table test type (bc83dcc)

Bug Fixes

  • test definitions: bugs in validate test query (bad261e)
  • display a show/hide icon for password fields (3620af0)
  • runs: duration display incorrect when > 24 hours (6a54f2e)
  • styles: misc css improvements (a5e2a06)
  • tests: add missing result_signal column (3b3d3f3)
  • tests: add flavor specific stale table test generation (80c644b)
  • test definitions: id missing for user-defined tests (b76bc22)
  • test types: rename "stale table" to "table freshness" (49ac837)
  • test definitions: remove unnecessary validation (f9e7476)
  • test results: make binary bars wider (cddaf91)
  • quick-start: adjust dates to 30 days ago (1783886)

Refactors

  • ui: extend input component to support hidding password suggestions (0923d65)
  • auth: implement as plugin class (b5757d4)
  • remove dead code (1a55681)
  • database service and param replace for process execution (35120c4)

Miscellaneous

  • connection: trim leading and trailing whitespaces (7208e8a)
  • Consolidate demo into a single quick-start call. (f2dfe40)

Docker Image

datakitchen/dataops-testgen:v4.22.2

PyPI Package

dataops-testgen==4.22.2

4.20.4

13 Aug 04:04

Choose a tag to compare

Features

  • table groups: verify access to tables (a2e5f39)
  • allow dismissing items from sorting selector (378be3b)
  • test results: add action filter (1002c09)
  • profiling: use native sampling (2cdc51a)

Bug Fixes

  • upgrade command (f45cb80)
  • sql: handle None when replacing params (dc29dd2)
  • analytics: update query fetch (bc01a5e)
  • sql: remove unnecessary str conversion for params (66fce8a)
  • profiling: copy error when any query fails (3857d14)
  • don't log full queries when upgrading system version (5a4b43e)
  • profiling: sampling bugs in some flavors (3de8e8d)
  • empty states in table groups and test suites pages (819c45c)
  • test suites: remove unnecessary fields, disable export option when not configured (a35eb84)
  • sql: incorrect parentheses in row_ct_pct test for mssql (0187c84)
  • empty states in profiling runs and test runs pages (2a8bf49)
  • empty state in profiling runs (f5c06be)
  • empty state in project dashboard (cec1822)
  • empty state in quality dashboard (cdc4e1d)
  • empty state in score issues (21992e2)
  • issue report: sample data not loading in score issues test reports (e92c114)
  • data catalog: broken table create script (c06fbd7)
  • data catalog: bugs in column history dialog (bbc45ba)
  • data catalog: don't apple searchOptions when search is empty (960f67d)
  • hygiene issues: error on exporting all issues (66d106a)
  • test definitions: fix condition for disabling disposition buttons (9cee2ad)
  • nav: validate query parameters (fdea797)
  • queries: handle None results gracefully (900025a)
  • profiling: error when running in background (d720d5a)
  • cli: generate-tests command broken (ee8845f)
  • redshift: remove unnecessary pre connection query (f8d48fb)
  • data catalog: numbers are rounding unnecessarily (6649939)
  • analytics: login usage event (877ede5)

Refactors

  • database service and param replace for process execution (59a5c68)
  • use bind parameters in app database sql for process execution (2902516)
  • add sqlalchemy models for entities (9825592)
  • use sqlalchemy models and bind params on all ui pages (6446a49)
  • remove dead code (b6fb08d)
  • Improving how pipeline parameters are obtained (e6c0675)

Miscellaneous

  • Add example Aggregate Balance Test to Demo Data and Quickstart (a865c61)

Docker Image

datakitchen/dataops-testgen:v4.20.4

PyPI Package

dataops-testgen==4.20.4

4.16.3

29 Jul 01:51

Choose a tag to compare

Features

  • Add Run Tests button to Test Definitions page (bc24c5c)
  • add test_name filtering to test definitions page (fba3247)
  • table groups: enforce verification before saving (4976bf6)
  • data-catalog: add table create script dialog (1028580)
  • table group: add checkbox for including in project dashboard (0bedec1)
  • table group: allow explicit table list to be split by newlines (3c58b85)

Bug Fixes

  • miscellaneous bug fixes and style improvements (1768565)
  • hygiene issue: update criteria for Unexpected US States (1ebd004)
  • issue report: prevent infinite loop (3aee19e)
  • analytics: username missing in background processes (8208112)
  • wizards: disable checkbox on last step (285691b)
  • copy test: typo in query (ebca49d)
  • table group: strip whitespace from explicit table list for preview (dfd9c2f)
  • hygiene issues: remove icons in action filter before query (0a7354d)
  • data catalog: error in table create script (e1ee311)
  • connections: decode private key when previewing table group (e91e414)
  • connections: url not saving as entered (e0da82e)

Refactors

  • remove unused files (18b8e04)
  • connections: have individual forms for each flavor (fee6e6d)

Docker Image

datakitchen/dataops-testgen:v4.16.3

PyPI Package

dataops-testgen==4.16.3