Skip to content

Commit f9c9198

Browse files
committed
Set HDFS replication factor 1 in dev and tests
Only one datanode runs in spark local development and tests, therefore, set the replication factor to 1 to avoid the namenode from complaining about under-replicated blocks.
1 parent fb4df69 commit f9c9198

File tree

1 file changed

+4
-0
lines changed

1 file changed

+4
-0
lines changed

docker/spark-cluster-config/test/hdfs-site.xml

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -25,4 +25,8 @@
2525
<name>dfs.datanode.data.dir</name>
2626
<value>file:///hdfs/datanode</value>
2727
</property>
28+
<property>
29+
<name>dfs.replication</name>
30+
<value>1</value>
31+
</property>>
2832
</configuration>

0 commit comments

Comments
 (0)