Skip to content

v3.5.0

Latest
Compare
Choose a tag to compare
@auxten auxten released this 28 Jul 04:39
· 6 commits to main since this release
2d4f024

What's Changed

# Example of Using PyArrow RecordBatchReader with `deltalake.write_deltalake`
import pyarrow as pa
from deltalake import write_deltalake
from chdb import session as chs

sess = chs.Session()
# Get streaming result in arrow format
stream_result = sess.send_query("SELECT * FROM numbers(100000)", "Arrow")

# Create RecordBatchReader with custom batch size (default rows_per_batch=1000000)
batch_reader = stream_result.record_batch(rows_per_batch=10000)

# Use RecordBatchReader with external libraries like Delta Lake
write_deltalake(
    table_or_uri="./my_delta_table",
    data=batch_reader,
    mode="overwrite"
)

stream_result.close()

sess.close()

Full Changelog: v3.4.1...v3.5.0