Title |
Data Transfer |
Abstract |
Transferring data and code between your workstation and a remote computer is a common part of scientific workflows. Sometimes this data can be quite large, and sometimes you wish to transmit your data securely. And recently, data transfers between cloud storage and computing facilities are becoming increasingly common. There are a number of utilities available to help you accomplish these essential tasks. Your choice of data transfer utility will depend on how much data you are transferring, how you prefer to perform the transfer, and your priorities (including transfer speed, ease of use, security and validation). This topic presents several data transfer options and their pros and cons, as well as ways to make these transfers faster. While the file transfer techniques presented here are useful in many situations, the included examples will use TACC's Stampede2 and Frontera as the remote computers. |
Authors |
['Ben Trumbore, Adam Brazier, Linda Woodard (original author)'] |
Expertise Level |
None |
Learning Outcome |
None |
Learning Resource Type |
asynchronous online training |
Target Group |
['Researchers', 'Research groups', 'Student'] |
Keywords |
['data transfer', 'security', 'SCP', 'performance', 'strategies', 'data syncing', 'data compression'] |
Cost |
None |
Duration |
240 |
Language |
en |
License |
None |
Resource URL Type |
URL |
Start Datetime |
None |
URL |
https://cvw.cac.cornell.edu/datatransfer |
Version Date |
2020-11 |
Provider ID |
urn:ogf.org:glue2:access-ci.org:resource:cider:infrastructure.organizations:898 |
Rating |
None |