Skip to content

Commit 9b8395e

Browse files
committed
Update documentation
1 parent 49b93a7 commit 9b8395e

File tree

1 file changed

+2
-1
lines changed

1 file changed

+2
-1
lines changed

hudi-spark-datasource/hudi-spark-common/src/main/scala/org/apache/hudi/DataSourceOptions.scala

Lines changed: 2 additions & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -236,7 +236,8 @@ object DataSourceReadOptions {
236236
" This is mainly necessary when the metadata table is not enabled or corrupted and the job " +
237237
" is doing recursive calls to fetch the partition paths and the dataset has multiple versions" +
238238
" of the same file in the same partition and it could lead to Out of Memory on the driver if" +
239-
" the dataset is too large.")
239+
" the dataset is too large. Another important limitation is that this config should not be" +
240+
" used if there are bootstrap files present in the file system")
240241

241242
val INCREMENTAL_FALLBACK_TO_FULL_TABLE_SCAN: ConfigProperty[String] = ConfigProperty
242243
.key("hoodie.datasource.read.incr.fallback.fulltablescan.enable")

0 commit comments

Comments
 (0)