wiki:DataSharing/DataStorage

DataSharing/DataStorage

  1. Via SFTP using a graphical user interface
  2. Via SFTP on the command line

1. Via SFTP using a graphical user interface

Step 1: Download and install FileZilla

Download and install FileZilla:  http://filezilla-project.org/download.php?type=client

Step 2: Disable remote directory tree

Please disable the remote directory tree

Step 3: setting up server connection in Filezilla

Open FileZilla and go to File -> Site Manager

Step2.1

Click on New Site

Step2.2

Fill in what is below:

Host: sftp.gcc.rug.nl
Protocol: SFTP- SSH File Transfer Protocol
Logon-type: normal
User: yourusername
password: yourpassword

Then push connect

It can happen that the following is popping up:

Select 'always trust this host'.

Finally you will see the same what is shown below

Depending in which groups you are, you can open the directories. It is now very easy to drag and drop files into the directory.

2. Via SFTP on the commandline

You can use the standard ftp commandline tool to connect to  sftp://sftp.gcc.rug.nl, but this one can be a hassle to use as it does not support tab completion of path names and does not make folders automatically when you want to move data recursively. On the Millipede and GCC cluster you may want to try lftp instead.

Step 1: start a session

$ :~> lftp -p 22 -u your_account_name sftp://sftp.gcc.rug.nl

Note you have to specify both the port number 22 with -p and make sure the server address is prefixed with sftp://

Step 2: transfer data

Use the get and put commands to download or upload data, respectively. Lftp does not support the -r switch with get and put for recursive data transfers, but it provides the mirror command instead. By default mirror will download directories. To upload with the mirror command you'll need to use mirror -R for reverse mirror. Hence to download to the current dir (where you started lftp):

lftp :~> mirror folder_on_remote_server

To upload to the current destination_folder_on_remote_server:

lftp :~> cd destination_folder_on_remote_server
lftp :~> mirror -R folder_on_local_server

Step 3: logout once you are done

lftp :~> exit

Attachments