Transferring data

Transferring Data: Overview

This is an overview of how to transfer data to or from the Savio high performance computing (HPC) cluster at the University of California, Berkeley.

• When transferring data, you should connect only to Savio's Data Transfer Node: dtn.brc.berkeley.edu

• You can use any of the file transfer methods that Savio supports. Among these (with links to tutorials, where available):

  • Bigger transfers (a large number of files and/or large-sized files):
    • Globus Connect (formerly Globus Online) (Tutorial: [Using Globus Online with Savio](Using Globus Online with Savio)). This method allows you to make unattended transfers which are fast and reliable.
    • You can also use GridFTP or BBCP for this purpose ...
  • Smaller transfers (a modest number of smaller-sized files):
    • SFTP (Tutorial: [Using SFTP with Savio via FileZilla](Using SFTP with Savio via FileZilla))
    • SCP (Tutorial: [Using SCP with Savio](Using SCP with Savio))
    • You can also use Rsync and other data transfer tools for this purpose ...
  • Transfers to/from specific systems
    • Box (Tutorial: [Transferring Data Between Savio and Your UC Berkeley Box account](Transferring Data Between Savio and Your UC Berkeley Box account))

Additional tutorials for transferring files to/from Google Drive, Amazon Web Services (AWS) S3, and other popular data storage sites are in planning or development. If you have any interest in working on or testing one of these, or have suggestions for other data transfer tutorials, please contact us at [email protected].