Add HoodieSparkLanceReader for reading lance files to internal row

[rahil-c]

Describe the issue this Pull Request addresses

Feature: #14127
Discussion: #14128

Note (this is the prior writer side pr #14131, would recommend viewing that first before viewing this pr)

Goal: We should be able to construct a reader that takes in a Lance file and returns an iterator of InternalRows. This reader should also be able to filter down to a required set of columns for efficiently parsing the row keys from the file
Interface:
 
Exit criteria: We should be able to read back the files written by the HoodieFileWriter implementation. We should be able to efficiently read back the set of keys in that file as well.

Summary and Changelog

• Add HoodieSparkLanceReader which implements the HoodieSparkFileReader interface
• Use Lance and Arrow related APIs to assist in schema conversion, and reading data from lance file back to an interator of InternalRow
• Add tests which test round trip the HoodieSparkLanceWriter and HoodieSparkLanceReader

Impact

None

Risk Level

Low

Documentation Update

None

Contributor's checklist

• Read through contributor's guide
• Enough context is provided in the sections above
• Adequate tests were added if applicable

[rahil-c]

cc @the-other-tim-brown @vinothchandar @nsivabalan @yihua

[rahil-c]

cc @the-other-tim-brown @yihua if you can take a look when you guys get a chance.

[hudi-bot]

CI report:

• 8f230ca Azure: FAILURE

Bot commands

@hudi-bot supports the following commands:

• @hudi-bot run azure re-run the last Azure build