Dev Stack Source

Answer : Also one can use the --recursive option, as described in the documentation for cp command. It will copy all objects under a specified prefix recursively. Example: aws s3 cp s3://folder1/folder2/folder3 . --recursive will grab all files under folder1/folder2/folder3 and copy them to local directory. There is a bash script which can read all the filenames from a file filename.txt . #!/bin/bash set -e while read line do aws s3 cp s3://bucket-name/$line dest-path/ done <filename.txt You might want to use "sync" instead of "cp". The following will download/sync only the files with the ".txt" extension in your local folder: aws s3 sync --exclude="*" --include="*.txt" s3://mybucket/mysubbucket .

Answer : aws s3 cp s3://my-bucket/ <local directory path> --recursive --exclude "*" --include "<prefix>*" This will copy only files with given prefix The aws s3 cp command will not accept a wildcard as part of the filename (key). Instead, you must use the --include and --exclude parameters to define filenames. From: Use of Exclude and Include Filters Currently, there is no support for the use of UNIX style wildcards in a command's path arguments. However, most commands have --exclude "<value>" and --include "<value>" parameters that can achieve the desired result. These parameters perform pattern matching to either exclude or include a particular file or object. The following pattern symbols are supported. So, you would use something like: aws s3 cp s3://my-bucket-name/ . --include "RAW_TIMESTAMP_0506*" The above answers to not work properly... for example I have many thousands of files in a directo...