Forward-sync to HDFS? (OR continue an incomplete hdfs upload?)
Solution 1:
If you're running a new enough Hadoop, you could mount hdfs using FUSE and just use rsync.
Might also be possible to build a local-only hdfs and then use distcp.
Forward-sync to HDFS? (OR continue an incomplete hdfs upload?)
Solution 1:
If you're running a new enough Hadoop, you could mount hdfs using FUSE and just use rsync.
Might also be possible to build a local-only hdfs and then use distcp.