Releases: Marklogic-retired/marklogic-data-hub
v2.0.4
v2.0.4 (2018-02-13)
Implemented enhancements:
- Need ability to specify cluster hostnames in configuration, override automatic host detection #662
Fixed bugs:
- Collector throws null pointer exception when there is nothing to process #735
- SSL not working with collector #734
- Browse Data Entities Only Error #726
- Setting up QuickStart UI takes me to the update screen, then vicious cycle #698
- Performance example gradle hubinit task throws a directory error on windows #674
- DataMovementServices is holdover from DHF 1.0 #613
- Quickstart runs in 2.0 mode only for version 9, not > 9.x #591
Closed issues:
- Put min ML version in docs and error message #229
Merged pull requests:
v2.0.3
2.0.3 Breaking Changes
MarkLogic 8 support dropped
As of this release (2.0.3) and all future releases, MarkLogic 8 is no longer supported. You must upgrade to ML9.01-1 (or later) to use this version of the DataHub.
hubConfig now requires hubConfigBuilder
The previous method of creating a hubConfig:
import com.marklogic.hub.HubConfig;
HubConfig dataHubConfig = hubConfig.hubFromEnvironment("/path/to/your/project", "local");is now built using the hubConfigBuilder object:
import com.marklogic.hub.HubConfig;
import com.marklogic.hub.HubConfigBuilder;
HubConfig dataHubConfig = HubConfigBuilder.newHubConfigBuilder("/path/to/your/project")
.withPropertiesFromEnvironment("local")
.build();2.0.3 Important Performance & Feature Changes
Client thread utilization - major (200%+) performance increase
If you are using ML9 and any prior version of DHF - UPGRADE NOW. This release contains the java client api hot-fix version that allows DHF to make full use of client resources (and therefore your cluster) for harmonize flows.
Stream based collector
Now the collector uses a stream based method to obtain large lists. If you obtain a large list of anything (uris, values, etc) upgrade now as this change moves away from using a multipart response and instead switches to streaming to better handle massive lists.
SSL Support
You can now set the context and hostname verifiers in DHF to make full use of TLS.
Java Client API Host whitelist now supported
DHF now supports the whitelist method that the Java API Client uses.
v2.0.3 (2018-01-30)
Implemented enhancements:
- Deprecate ML8 support #618
- MLCP options: Add ability to select individual files #413
- MarkLogic Java Client API update to 4.0.3.1 to address client thread under utilization issue
- Streaming collector results #633
- Can now set custom SSL Context and Hostname verifiers #647
- Whitelist support for configuration #662
Fixed bugs:
- Long collection names wrap (ugly) #409
- double parent XML elements created when serializing complex type #619
- setting sourceDB in custom task extending RunFlowTaks in v2.0.2 fails #608
- Fixed property indexes on entities being wiped when a property is deleted #627 (aebadirad)
Closed issues:
v2.0.2
v2.0.2 (2017-12-01)
Implemented enhancements:
- Delete old jobs #534
Fixed bugs:
- Main is executed in staging db even when setting -PsourceDB=Final #565
- Blank harmonization page #558
Merged pull requests:
- Feature/bug 558 #598 (dmcassel)
- fixed #565 #596 (paxtonhare)
- adding the userOrg property #586 (dmcassel)
- fixed #547 #568 (paxtonhare)
- Feature/delete old jobs #566 (dmcassel)
v2.0.1
Implemented enhancements:
- Harmonize Writer could benefit from more context like $type #564
- Update 2.x version checker to omit pre-release version #485
Fixed bugs:
- Error running sample product-catalog example #560
- Entity definition partially written, everything hosed #435
Closed issues:
- REST search options deployed to wrong location in modules db #567
- Getting MISSING_FLOW error when invoking from DMSDK #552
- Add support for mlcp -input_file_pattern #550
- Browse Data: not obvious that I needed to click Search #530
- Add detailed documentation on traces #527
- incorrect scaffolding #525
- Issue upgrade from rc1 to rc2 #511
- Create Performance Sample #492
- MLCP fails if no "jobId" parameter specified even with trace off #426
- Test deploy against ssl enabled server #417
- Epic - error handling #289
Merged pull requests:
- Issue413 #559 (tcfenstermaker)
- adds performance sample #556 (joemfb)
v2.0.0
Upgrading from a previous version
You have 2 choices for upgrading from a previous version.
- Run the Quick Start UI and let it upgrade for you
- Run the gradle command
gradlew hubUpdate
Breaking Changes
Parameters changed
Parameters to the underlying REST extensions have changed. See here for the current reference: https://github.com/marklogic-community/marklogic-data-hub/wiki/Advanced-Hub-Usage
Gradle Minimun Version
Gradle Minimun Version is now 3.4. You will need to update your gradle version or your gradlewrapper version if you have < 3.4.
To update gradle wrapper:
gradle wrapper --gradle-version 3.4
v2.0.0
Fixed bugs:
- mlWatch is deploying Flow XMLs on every iteration #522
- Can't login to quickstart with data-hub-user #519
- Error when settings gradle properties from task definition #518
- Basic auth not working #517
- Debug of run-flow transform breaks multipart requests and can't be turned off #516
- Bug in deploying Flows to MarkLogic #512
- Writer trace is firing twice #510
- Error loading XSD schemas #509
Closed issues:
v2.0.0-rc.2
Breaking changes!!
This version merges the 1.0 and 2.0 branches into one, unified branch. Hub users of 1.1.3+ should upgrade to this version. Hub users of 2.0.0-rc.1 should update to this version.
This version introduces the main.xqy or main.sjs module. This is a breaking change. Before updating please ensure that your existing code is properly version controlled.
You can update via the QuickStart app or via gradle gradle hubUpate.
The update process will create a main.(sjs|xqy) file for you.
Change Log
v2.0.0-rc.2 (2017-09-12)
Implemented enhancements:
- Add Fastload support for MLCP #490
- Refactor to use main.xqy #484
- Refactor classes that break openjdk #482
Fixed bugs:
- Next button not working when browsing to new hub project directory #502
- Quickstart gets stuck in Loading... with js error #501
- scaffolded flow from empty ES model has errors #495
- Need to properly escape the path for RegEx #494
- Files are being locked on Windows #450
Closed issues:
- Increase gradleVersion to 3.4 for the wrapper task #499
- MLCP 9.0.2 isn't backwards compatible #498
- Example: Make a barebones example for cmd line ninjas #497
- ML behind Firewall + different ports #489
- Ports 8010 and 8011 conflicting with Ops-Director #447
Merged pull requests:
- Support MLCP fastload #500 (RobertSzkutak)
v1.1.5
Important Changes
You now must specify the sourceDB and destDB name when specifying databases via gradle.
./gradlew hubRunFlow \
-PentityName=yourEntityName \
-PflowName=yourFlowName \
-PflowType=harmonize
-PsourceDB=data-hub-STAGING \
-PdestDB=data-hub-FINAL
v1.1.5
Implemented enhancements:
Fixed bugs:
- Providing different source/dest DB for the hubRunFlow does not work #488
- Path to code has wrong slash on Windows #467
- Job status stuck on STARTED for Input Flows #466
- File not saving properly from quickstart to fix a bug #430
- Error on initial run of QuickStart GUI #394
- Error saving entity - collation not legal #337
Closed issues:
- collection name is hard coded in online store example #474
- add (rest-extension-user,read) to XML documents in modules-db #470
- column-width, or tooltip with full "Identifier" in traces table #469
- Initializing DHF Project against existing DB is dropping indexes #468
- Saving the changes in a flow code never finishes *sometimes* #462
- Sometimes a trace for a failed Harmonize job is not available/not existing #461
- Unable to ingest image (.png) documents using DHF Quick-Start application #420
- Load files into the data hub schemas database #288
- Ability to override uri for input flows #182
- Create concept of a domain #82
Merged pull requests:
- Feature/473 msb example #480 (sastafford)
- Some typos and suggestions #475 (patrickmcelwee)
v1.1.4
Change Log
v1.1.4
Fixed bugs:
- File not saving properly from quickstart to fix a bug #430
Closed issues:
- Saving the changes in a flow code never finishes *sometimes* #462
Implemented enhancements:
- Cannot specify default permissions for data-hub-modules db #434
Fixed bugs:
- MlcpRunner is being started improperly #452
- Code deploy fails when An entity is deleted #451
- error during data hub workshop #437
- when scaffolding code for an array, have it be empty list [] rather than null #432
- gradlew is generated without execute permission #428
- RunFlowTask using dyslexic string for hub key #419
Closed issues:
- Upgrade quick-start to mlcp 9.0.2 #465
- QuickStart app doesn't work on Internet Explorer 11 #463
- Redeploy modules removes trace and debugging settings #460
- Quickstart Application not working on Internet Explorer #456
- Envelope instance created does not include "info" #455
- Error when creating a harmonize flow based on entity definition #454
- tutorial link is 404: https://marklogic.github.io/marklogic-data-hub/ #449
- Changes to $options not persisting if set in headers or triples in Harmonization flow #448
- Input flow job (load-acme-tech) failing on 2.0.0-beta.1 #446
- Fix AppVeyor CI #445
- consider using windows compatible line breaks #444
- RFE: support setting log level #442
- Setting replica forest data path #441
- Replica forests not created from quick-start #439
- Error in documentation for the REST transform #433
- Harmonization hits maximum document size in collector output #427
- Create a checklist for making DHF releases #424
- Expose the ability to set the writer plugin's target database in gradle #423
- Document all gradle hub tasks #402
- Document query-only mode for plugins #368
- Generated code template from Entity for nested item hides vars (v2/Entities) #353
- Control what runs in update mode to minimize locking #300
- Library Modules not being autodeployed #299
- Uninstall doesn't always finish on the UI #266
- Consider name and description for data hub framework and tooling #175
v2.0.0-rc.1
Change Log
v2.0.0-rc.1 (2017-07-24)
Implemented enhancements:
- Cannot specify default permissions for data-hub-modules db #434
Fixed bugs:
- MlcpRunner is being started improperly #452
- Code deploy fails when An entity is deleted #451
- error during data hub workshop #437
- when scaffolding code for an array, have it be empty list [] rather than null #432
- gradlew is generated without execute permission #428
- RunFlowTask using dyslexic string for hub key #419
Closed issues:
- Upgrade quick-start to mlcp 9.0.2 #465
- QuickStart app doesn't work on Internet Explorer 11 #463
- Redeploy modules removes trace and debugging settings #460
- Quickstart Application not working on Internet Explorer #456
- Envelope instance created does not include "info" #455
- Error when creating a harmonize flow based on entity definition #454
- tutorial link is 404: https://marklogic.github.io/marklogic-data-hub/ #449
- Changes to $options not persisting if set in headers or triples in Harmonization flow #448
- Input flow job (load-acme-tech) failing on 2.0.0-beta.1 #446
- Fix AppVeyor CI #445
- consider using windows compatible line breaks #444
- RFE: support setting log level #442
- Setting replica forest data path #441
- Replica forests not created from quick-start #439
- Error in documentation for the REST transform #433
- Harmonization hits maximum document size in collector output #427
- Create a checklist for making DHF releases #424
- Expose the ability to set the writer plugin's target database in gradle #423
- Document all gradle hub tasks #402
- Document query-only mode for plugins #368
- Generated code template from Entity for nested item hides vars (v2/Entities) #353
- Control what runs in update mode to minimize locking #300
- Library Modules not being autodeployed #299
- Uninstall doesn't always finish on the UI #266
- Consider name and description for data hub framework and tooling #175
v2.0.0-beta.1
v2.0.0-beta.2
Implemented enhancements:
- Add a code editor #418
Fixed bugs:
- Entity properties starting with a capital generate templates with a preceding dash in var names #350