Difference between revisions of "HD Human Neuroscience Institute (HD-HNI) Computing"

From CAC Documentation wiki
Jump to navigation Jump to search
Line 2: Line 2:
  
 
==The HD-HNI file server consists of:==
 
==The HD-HNI file server consists of:==
  1  file server - hd-hni-fs.cac.cornell.edu - serving 180TB capacity
+
:*  1  file server - hd-hni-fs.cac.cornell.edu - serving 180TB capacity
 +
:*  1 head node - hdhni.cac.cornell.edu (access via ssh)
 +
:*  1 interactive node - interactive1.cac.cornell.edu (access via ssh)
 +
:*  1 batch node - access via the hdhni head node
  
 
==Who can access the HD-HNI file server?==
 
==Who can access the HD-HNI file server?==

Revision as of 11:55, 3 December 2020

Documentation for the HD Human Neuroscience Institute Storage

The HD-HNI file server consists of:

  • 1 file server - hd-hni-fs.cac.cornell.edu - serving 180TB capacity
  • 1 head node - hdhni.cac.cornell.edu (access via ssh)
  • 1 interactive node - interactive1.cac.cornell.edu (access via ssh)
  • 1 batch node - access via the hdhni head node

Who can access the HD-HNI file server?

  • Users in Eve DeRosa and Adam Anderson's labs (ktb1_0005 CAC group).
  • New users will receive a welcome letter with their username and initial CAC HD-HNI password.
  • Users should change, reset, query CAC password at https://www.cac.cornell.edu/services/myacct.aspx

HD-HNI File Server - Moving data from your workstation to the shared file server

A central file server, hd-hni-fs.cac.cornell.edu, serves all HD-HNI user home directories. Users can not ssh to this server but can connect and access files in a variety of other ways outlined below.

Note: by default, your home directory and its contents will be readable and executable by all other users of the HD-HNI systems. If this is not what you want, you can change the permissions of the home directory and its files and subdirectories via the standard Linux or Windows mechanisms. However, be aware that this may lead to conflicts for cross-platform applications, as Windows and Linux permissions are not 100% compatible.

Attach your home directory to your local computer

You can "mount" your home directory from computers on the Cornell network or if off campus, computers connected to Cornell VPN. Once your home directory is mounted, you can drag and drop files to it.

Windows Users - how to mount HD-HNI directories

NOTE: WE RECOMMEND THAT YOU DO NOT SAVE YOUR PASSWORD ON PUBLIC COMPUTERS, DOING SO MAY CAUSE CONNECTION TROUBLES

  • Open My Computer
  • Click on Tools -> Map Network Drive
  • Drive H: (if you are already using this drive letter, use another letter)
  • Folder: \\hd-hni-fs.cac.cornell.edu\<userid>
  • or
  • Folder: \\hd-hni-fs.cac.cornell.edu\reyna-fmri
  • Then:
    • Select "Connect using a different user name:". This will allow you to enter the CAC domain and your HD-HNI userid at CAC, rather than those associated with your own machine.
    • User name: CTC_ITH\your_userid
    • Password: your CAC HD-HNI password
  • Troubleshooting: If you have already mapped the drive and subsequently have problems, disconnect the drive and remap it.

MacOS X Users - how to mount HD-HNI directories

NOTE: WE RECOMMEND THAT YOU DO NOT SAVE YOUR PASSWORD ON PUBLIC COMPUTERS, DOING SO MAY CAUSE CONNECTION TROUBLES

  1. In the Finder, select Connect to Server... from the Go menu.

    FileAccess1.jpg
  2. Enter smb://hd-hni-fs.cac.cornell.edu/<user name> in the Server Address field. You may need to use smb://<username>@hd-hni-fs.cac.cornell.edu/<username>.
  3. Enter your CAC user name and password to log in.

Linux Users - how to mount HD-HNI directories

You cannot mount the HD-HNI directories vis NFS for security reasons. To mount it as a CIFS drive, you need to be root, which often means using the sudo command. Then execute

 mount -t cifs //hd-hni-fs.cac.cornell.edu/<user name> /mnt/test -o user=<user name>,workgroup=ctc_ith,vers=3.0

where <username> is your username, and /mount/point is the name of a directory you have already created on your local filesystem. Enter the password for your CAC project when prompted. See man mount.cifs for available options for the mount command

If you see errors, such as "missing codepage or helper program," then you have not installed the mount and umount packages for CIFS on your local machine. If problems persist, send your initial command and the results of dmesg | tail.

File Transfers To The HD-HNI file server

Users can transfer data to the HD-HNI-FS file server without mounting the file systems locally.

File Transfers between File Server and your Linux or MAC workstation

Secure Copy

Secure copy is a standard tool to copy files to and from remote hosts.

This example copies a file named "localfile.dat" on your local workstation to a file named remoteinput.dat on the remote file server:
localhost$ scp localfile.dat username@hd-hni-fs.cac.cornell.edu:remoteinput.dat

This example copies the file named results.dat on the remote server to a file named localresults.dat on your local workstation.
localhost$ scp username@hd-hni-fs.cac.cornell.edu:results.dat localresults.dat 

Secure FTP

FTP is disabled for security reasons, but sftp's interface is nearly identical.

localhost$sftp username@hd-hni-fs.cac.cornell.edu
    <enter your username's password when prompted>
sftp> put localresults.dat results.dat
sftp> quit

Samba Client

Type

smbclient //hd-hni-fs.cac.cornell.edu/<user name> -U <user name> -W ctc_ith -m SMB3

Enter the password for your HD-HNI account when prompted You will see the smb:\> prompt. You can now start transferring files between your local machine and your HD-HNI home directory similar to ftp client. Type help for more instructions.

-sh-3.2$ smbclient //hd-hni-fs.cac.cornell.edu/<user name> -U <user name> -W ctc_ith -m SMB3
    Password: 
    Domain=[CTC_ITH] OS=[Unix] Server=[Samba 3.0.28-1.el5_2.1]
    smb: \> help

File Transfers between the File Server and your Windows Workstation

Secure Copy

The people who make Putty provide a secure copy client called pscp.

 This example copies local workstation file to the remote file server:
  cmd> pscp localfile.dat username@hd-hni-fs.cac.cornell.edu:remoteinput.dat
     <enter your username's password when prompted>

 This example copies a file on the remote file server to the local workstation:
  cmd> pscp username@hd-hni-fs.cac.cornell.edu:results.dat localresults.dat

Secure FTP

FTP is disabled for security reasons, but psftp's interface is nearly identical. From the command prompt, type:

cmd> psftp username@hd-hni-fs.cac.cornell.edu
    <enter your username's password when prompted>
psftp> put localresults.dat results.dat
psftp> quit

XNAT

  1. Select Login via LDAP
  2. Enter you CAC user name and password
  3. After authentication is successful, you will receive a separate email that your account has been approved.

NEED HELP?

Password resets can be requested at: password reset
Cluster technical questions should be addressed to: CAC HelpDesk
Human Ecology related questions should be addressed to: Human Ecology HelpDesk