CAC Fileservers Upgrade
CAC is in the process of replacing the current fileservers (ctcfsrv6 through ctcfsrv13) with new hardware.
July 1, 2008 the previously listed fileservers will be marked read-only.
You are encouraged to move your files off of the old fileservers as soon as possible. Users will have 30 days after their new accounts are created to retrieve their files.
If you continue to need the data on the fileservers, the data will need to be copied to storage in your home department or, if you applied for a CAC project, you may copy the data to the new fileservers (keeping in mind the amount of disk space requested when you applied for an ID).
When copying files from the current fileservers to the new fileserver we encourage you to use command line tools so file information (timestamps, etc.) is maintained.
If your old and new CAC LoginID are the same
(typically your new CAC LoginID is the same as your Cornell netid)
Use a Windows Login node to copy from the old CAC fileserver to the new CAC fileserver:
In this case you have received an e-mail with your old DFS link. It will be something like:
\\ctcfsrv6.tc.cornell.edu\tc_m\Users\netid
We recommend using Robocopy (Robust File Copy Utility). The recommended version is XP026 which is located in H:\CTC Tools. To view all options available with Robocopy type robocopy /? at the command prompt on a login node (this will also show what version is in use). Some details you should be aware of: if folders/files to copy is not specified the default is *.*, the default number of retries is 1 million and the default time between retries is 30 seconds.
This command will allow you to see what would be copied for the “Documentation in Progress” folder – no files are actually copied:
H:\Users\netid>robocopy "\\ctcfsrv6\tc_o\Users\netid\Documentation in Progress" "Documentation in Progress" /S /L
The command below will copy the contents of the “Documentation in Progress” folder as well as the contents of any subfolders. Quotes are not necessary if there are no spaces in the path. It will also maintain file attributes timestamps and security settings. It retries copying a file 3 times with 15 seconds between attempts (overriding the defaults of 1 million retries with 30 between attempts). Finally it will create a log of the folders/files copied your new user folder.
H:\Users\netid>robocopy "\\ctcfsrv8\tc_o\Users\netid\Documentation in Progress" "Documentation in Progress" /S /COPY:DATS /DCOPY:T /R:3 /W:15 /LOG:files_copied.txt
Log File : H:\Users\netid\files_copied.txt
Use a Linux login node to copy from the old CAC fileserver to the new CAC fileserver:
In this case you have received an e-mail with your old DFS link. It will be something like:
/home/nfs/ctcfsrv8/o/netid
To view all options available with the copy command type cp --help. If the target folder (where you plan to copy data to) does not exist, you need to create it before issuing the copy command or use the –r option to copy directories recursively.
To copy a directory to the new fileserver:
cp -arv /home/nfs/ctcfsrv8/o/netid/Batch_Files /home/gfs01/netid
Folder names with spaces pose a bit of a challenge. For example, “Documentation in Progress”, need slash space added to the path where a space normally would be.
cp -arv /home/nfs/ctcfsrv8/o/netid/Documentation\ in\ Progress /home/gfs01/netid
To copy files to a new directory on the new fileserver:
mkdir /home/gfs01/netid/new_directory
cp -arv Batch\ Files/* /home/gfs01/netid/new_directory
If your new CAC LoginID has changed
(typically your new CAC LoginID is the same as your Cornell netid)
Use a Windows Login node to copy from the old CAC fileserver to the new CAC fileserver:
If you do not know what fileserver your OLD user folder is located on, from a Windows login node use Windows Explorer to navigate to H:\users\. Once you see your user folder right-click on it and select Properties. Click on the DFS tab and your fileserver will be listed, e.g.
\\ctcfsrv6.tc.cornell.edu\tc_m\Users\ old_user_name
We recommend using Robocopy (Robust File Copy Utility). The recommended version is XP026 which is
located in H:\CTC Tools. To view all options available with Robocopy type robocopy /? at the command
prompt on a login node (this will also show what version is in use). Some details you should be
aware of: if folders/files to copy is not specified the default is *.*, the default number of
retries is 1 million and the default time between retries is 30 seconds.
This command will allow you to see what would be copied for the “Documentation in Progress” folder – no files are actually copied:
H:\Users\netid>robocopy "\\ctcfsrv8\tc_o\Users\ old_user_name \Documentation in Progress" "Documentation in Progress" /S /L
This command below will copy the contents of the “Documentation in Progress” folder as well as the contents
of any subfolders. Quotes are not necessary if there are no spaces in the path. It will also maintain file
attributes timestamps and security settings. It retries copying a file 3 times with 15 seconds between
attempts (overriding the defaults of 1 million retries with 30 between attempts). Finally it will create
a log of the folders/files copied your new user folder.
H:\Users\netid>robocopy "\\ctcfsrv8\tc_o\Users\ old_user_name \Documentation in Progress" "Documentation in Progress" /S /COPY:DATS /DCOPY:T /R:3 /W:15 /LOG:files_copied.txt
Log File : H:\Users\netid\files_copied.txt
Use a Linux login node to copy from the old CAC fileserver to the new CAC fileserver:
If you do not know what fileserver your OLD user folder is located from a linuxlogin node
issue this command:
ls –ld /home/nfs/ctcfsrv*/*/old_user_name
The path will look something like
/home/nfs/ctcfsrv8/o/old_user_name
To view all options available with the copy command type cp --help. If the target folder (where you plan to copy data to) does not exist, you need to create it before issuing the copy command or use the –r option to copy directories recursively.
To copy a directory to the new fileserver:
cp -arv /home/nfs/ctcfsrv8/o/old_user_name/Batch_Files /home/gfs01/netid
Folder names with spaces pose a bit of a challenge. For example, “Documentation in Progress”, need slash space added to the path where a space normally would be.
cp -arv /home/nfs/ctcfsrv8/o/lapp/Documentation\ in\ Progress /home/gfs01/bll3
To copy files to a new directory on the new fileserver:
mkdir /home/gfs01/netid/new_directory
cp -arv Batch\ Files/* /home/gfs01/netid/new_directory
Additional Information on Copy
Some sites that provide additional information about the copy command are:
http://www.tuxfiles.org/linuxhelp/fileman.html
http://www.computerhope.com/unix/ucp.htm#03
If you want to copy files from a CAC fileserver to a remote computer:
We support scp and sftp to connect to the login nodes to transfer data. There are many tools for data transfer that use these protocols. Tools that have successfully been used with our infrastructure are PuTTY (Windows), WinSCP (Windows) and FileZilla (Windows, Mac, Linux).
http://www.putty.org/
http://winscp.net/eng/index.php
http://filezilla-project.org
The remote directory is /ftproot. It has been our experience that those using FileZilla need to add ftproot after the / in the remote site field.
