Check downloaded Dryad files against the file system — .dryad_verify

Mirrors .dataverse_verify_downloads(): confirms every file the download planned to save is present, is the size Dryad reported, and (when Dryad published an MD5 or SHA-256 digest) matches the checksum.

Usage

.dryad_verify_downloads(files, download_to)

Arguments

files: the file table being built, with path, size, checksum, checksum_type, and downloaded columns, and optionally extracted
download_to: the folder the dataset was saved in

Value

files with downloaded corrected against the file system, plus size_on_disk and checksum_ok columns

Details

A row whose extracted count is set is exempt from both checks, for the same reason as the Dataverse case: Dryad's size and digest describe the zip as published, and that zip was deliberately never downloaded – only chosen members were, each verified against the CRC32 in the archive's own central directory as it is extracted.