Skip to content

[Backport 0.7] Adding _source and schema merging to index_mappings #1155

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
merged 1 commit into from
May 14, 2025

Conversation

opensearch-trigger-bot[bot]
Copy link

Backport 76d35e2 from #1101.

* Fix antlr4 parser issues (#1094)

* Fix antlr4 parser issues

Signed-off-by: Lantao Jin <ltjin@amazon.com>

* Case insensitive lexer

Signed-off-by: Lantao Jin <ltjin@amazon.com>

* revert useless change

Signed-off-by: Lantao Jin <ltjin@amazon.com>

* remove tokens file

Signed-off-by: Lantao Jin <ltjin@amazon.com>

---------

Signed-off-by: Lantao Jin <ltjin@amazon.com>
Signed-off-by: Kai Huang <ahkcs@amazon.com>

* adding _source to index_mappings

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* syntax fix

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Apply scalafmt

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Added index_mapping as an option in index.md, applied scalafmtAll

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* improve readability

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Removed index_mappings from FlintMetaData.scala, Modified index.md

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* removed indexMappingsSourceEnabled from FlintMetadata.scala

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* removed indexMappingsSourceEnabled from FlintMetadata.scala

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* removed indexMappingsSourceEnabled from FlintMetadata.scala

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Removed indexMappingsSourceEnabled from FlintMetadata.scala and removed unnecessary code

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Added some test cases to test serialzie() and fixed some formatting issues

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Added some test cases for FlintOpenSearchIndexMetadataServiceSuite.scala

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Added schema merging to index_mappings, added some test cases

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* updated test cases

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* Minor format fix

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* minor fixes

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* added nested schema merging logic, moved mergeSchema to serialize, updated test cases,  fixed some minor issues

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* updated some comments

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* fixed some formatting issues based on the comments

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* fixed syntax issue

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* syntax issue

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* syntax issue

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* fixed the FlintSparkSkippingIndexITSuite

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* fixing schema merging limitation

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* less scala/java conversion

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* style fix

Signed-off-by: Kai Huang <ahkcs@amazon.com>

* fix unnecessary casting

Signed-off-by: Kai Huang <ahkcs@amazon.com>

---------

Signed-off-by: Lantao Jin <ltjin@amazon.com>
Signed-off-by: Kai Huang <ahkcs@amazon.com>
Co-authored-by: Lantao Jin <ltjin@amazon.com>
(cherry picked from commit 76d35e2)
Signed-off-by: github-actions[bot] <github-actions[bot]@users.noreply.github.com>
@noCharger noCharger merged commit 0e3bb7b into 0.7 May 14, 2025
5 of 7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants