Skip to content

[R] Preserve row order in write_dataset() #49340

@marberts

Description

@marberts

Describe the enhancement requested

write_dataset(df) need not preserve the row-ordering of df across partitions. The arrow C++ library was recently updated (since 21.0.0) so that row ordering can be preserved when writing across partitions, and this can be done with, e.g., pyarrow's dataset.write_dataset() function by setting preserve_order=True.

It would be quite useful if the R package could expose this feature in write_dataset(). It appears to be related to #31601.

#26818
#44470

Component(s)

R

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions