The Command Line Uploader is a general method used to transfer local files into the Enable Cloud. The main use cases for this uploader includes raw data transfer or miscellaneous metadata uploads. For standard transfers of stitched TIF images for data processing and analysis, please use our Experiment Image Data Uploader. If you have further questions, please contact [email protected].
<aside> 💡 NOTE: Generated Command Line Uploader credentials are rotated every 6 months. If you are no longer able to upload with the Command Line Uploader, try to regenerate your credentials by following the instructions below!
</aside>
AWS_ACCESS_KEY
AWS_SECRET_ACCESS_KEY
Command Line File Uploader
page in the Enable Portal, you should also see the AWS Bucket Path displayed. You will need this path later on in these instructions. Substitute this bucket path wherever you see [BUCKET_PATH]
in the following steps.aws configure
in the command line.
Determine the file path where your files are located.
Mac:
Copy "folder" as Pathname
experiment1
, the path could look like /Users/machina/Workspace/experiment1
.An example showing how to find the pathname of a specific file on Mac.
Windows:
Copy as Path
.experiment1
, the path could look like C:\\Users\\path\\to\\images\\experiment1
.An example showing how to find the pathname of a specific file on Windows.
Now that we have our command line ready, we can and run the following command to begin uploading files to AWS.
aws s3 sync "[YOUR_PATHNAME]" "s3://[BUCKET_PATH]/[FOLDER_NAME]"
[YOUR_PATHNAME]
was /Users/path/to/experiment1
, the final command will look something like:
aws s3 sync "/Users/path/to/experiment1" "s3://[BUCKET_PATH]/experiment1"
dataset1
and dataset2
you would run two commands:
aws s3 sync "/Users/path/to/dataset1" "s3://[BUCKET_PATH]/dataset1"
aws s3 sync "/Users/path/to/dataset2" "s3://[BUCKET_PATH]/dataset2"
While your folder is syncing, please ensure your computer does not fall asleep or disconnect from the internet. This should not be a problem as long as you are still using your computer; however, if you are planning on transferring large datasets or stepping away from your computer please see the following links:
While syncing, a list of files will be displayed as they upload. Please wait for your command prompt to return when the upload is completed.
Upload in progress
Completed upload - command prompt has returned
You can cancel an upload at any time by pressing Control + C
If an upload is aborted midway, rerun the same command. Only files that have not already been transferred will be uploaded.
Return to Home Directory