运行fsmp_merge.R时文件读取不完整的error
在/mnt/eternity/FSMP目录下运行./fsmp_merge.R -r result/pq/run00001801/merge.pq -i result/pq/run00001801/merge.pqf -o result/charge/run00001801/merge.parquet时发生如下报错
Attaching package: ‘dplyr’
The following objects are masked from ‘package:stats’:
filter, lag
The following objects are masked from ‘package:base’:
intersect, setdiff, setequal, union
Loading required package: DBI
Some features are not enabled in this build of Arrow. Run `arrow_info()` for more information.
Attaching package: ‘arrow’
The following object is masked from ‘package:utils’:
timestamp
Error: rapi_prepare: Failed to prepare query CREATE VIEW pe AS SELECT * FROM read_parquet('result/pq/run00001801/merge.pqf')
Error: IO Error: Could not read all bytes from file "result/pq/run00001801/merge.pqf": wanted=3764251065 read=2147479552
Execution halted
Warning messages:
1: Connection is garbage-collected, use dbDisconnect() to avoid this.
2: Database is garbage-collected, use dbDisconnect(con, shutdown=TRUE) or duckdb::duckdb_shutdown(drv) to avoid this.