Difference between revisions of "File Transfer using Globus"
Jump to navigation
Jump to search
(27 intermediate revisions by 3 users not shown) | |||
Line 2: | Line 2: | ||
==Introduction to Globus== | ==Introduction to Globus== | ||
− | Many CAC resources are on [ | + | Many CAC resources are on [//globus.org Globus] for high speed file transfers. Globus uses multiple parallel TCP streams to achieve high throughput. Globus also monitors file transfers and automatically retries when errors are encountered. It provides a fast and reliable method for transferring research data to and from CAC. |
− | == | + | == Log into Globus == |
− | |||
− | |||
− | |||
− | |||
− | ==CAC Globus | + | When logging into [https://globus.org Globus], |
− | The following CAC resources are on Globus via these | + | # Cornell users should select '''Cornell University''' under '''Use your existing organizational login''', or |
+ | # Weill Cornell Medicine users should select '''Weill Cornell Medical College''', | ||
+ | |||
+ | [[File:GlobusLogin.png | 600px | center ]] | ||
+ | |||
+ | and then click on the '''Continue''' button. You will get forwarded to the [https://it.cornell.edu/cuweblogin CUWebLogin (Cornell users)] or WCM Web Login (Weill Cornell users) page. Login using your NetID or CWID and password. | ||
+ | |||
+ | == First-Time Use == | ||
+ | # Log into Globus | ||
+ | # If you need to transfer files to and from your local laptop or desktop, download and install [//globus.org/globus-connect-personal Globus Connect Personal] on your host. | ||
+ | # To use [//globus.org Globus web interface], log into your Globus account and [https://docs.globus.org/how-to/get-started/ start transfer files]. | ||
+ | # To use Globus command line interface (CLI) or script your file transfers, read the [https://docs.globus.org/cli/ Command Line Interface documentation] for more information. | ||
+ | |||
+ | == Additional Documentation == | ||
+ | More Globus documentation can be found at [https://docs.globus.org https://docs.globus.org]. | ||
+ | |||
+ | ==CAC Globus Collections== | ||
+ | The following CAC resources are on Globus via these collections: | ||
{| class="wikitable" | {| class="wikitable" | ||
− | ! style="text-align:left;" | | + | ! style="text-align:left;" | Collection |
! style="text-align:left;" | CAC Resource | ! style="text-align:left;" | CAC Resource | ||
|- | |- | ||
− | | '''cac#home''' | + | | '''[https://app.globus.org/file-manager?origin_id=ccab9a26-c46c-46fb-9c87-44985fc8aaae cac#home]''' |
| CAC home directories | | CAC home directories | ||
|- | |- | ||
− | | ''' | + | | '''[https://app.globus.org/file-manager?origin_id=dc94169c-30f3-4866-a305-f112408bcf8f CAC Archive 2/DTN]''' |
| CAC [[Archival Storage]] | | CAC [[Archival Storage]] | ||
|- | |- | ||
− | | ''' | + | | '''[https://app.globus.org/file-manager?origin_id=0ea78cbb-3fbe-4456-8047-3f3db6f0baef Altas Cluster]''' |
− | | [[ | + | | [[ALTAS Cluster]] |
|- | |- | ||
− | | '''cac#marvin''' | + | | '''[https://app.globus.org/file-manager?origin_id=7911b712-7ac1-11eb-b1f7-1d44b21258da cac#HeritageWatch]''' |
+ | | [[HeritageWatch]] | ||
+ | |- | ||
+ | | '''[https://app.globus.org/file-manager?origin_id=34efa512-0991-11ec-ae2a-6b098c7117de Hopper Cluster]''' | ||
+ | | [[Hopper Cluster]] | ||
+ | |- | ||
+ | | '''[https://app.globus.org/file-manager?origin_id=b22cb4ce-aef8-4df2-9270-71afba074229 cac#marvin]''' | ||
| [[MARVIN Cluster]] | | [[MARVIN Cluster]] | ||
|- | |- | ||
− | | '''cac#thecube''' | + | | '''[https://app.globus.org/file-manager?origin_id=3891a778-5d44-11eb-a46a-0e095b4c2e55 cac#marx1]''' |
+ | | [[Marx1 Cluster]] | ||
+ | |- | ||
+ | | '''[https://app.globus.org/file-manager?origin_id=3efd6c40-c35e-11e9-98df-0a63aa6b37da Pool Cluster icsefs01 File Server]''' | ||
+ | | [[Pool Cluster]] icsefs01 File Server | ||
+ | |- | ||
+ | | '''[https://app.globus.org/file-manager?origin_id=bf4c4e9c-c364-11e9-939a-02ff96a5aa76 Pool Cluster icsefs02 File Server]''' | ||
+ | | [[Pool Cluster]] icsefs02 File Server | ||
+ | |- | ||
+ | | '''[https://app.globus.org/file-manager?origin_id=4e8d2bca-00d3-11ea-9949-0a8c187e8c12 cac#mito]''' | ||
+ | | mito.cac.cornell.edu | ||
+ | |- | ||
+ | | '''[https://app.globus.org/file-manager?origin_id=2aaf7737-4b26-4845-b53d-5790d7f804cc Red Cloud Object Storage]''' | ||
+ | | [[Openstack Object Storage|Red Cloud Object Storage]]. See [https://www.cac.cornell.edu/wiki/index.php?title=Openstack_Object_Storage#Access_Red_Cloud_Object_Storage_via_Globus additional setup information here]. | ||
+ | |- | ||
+ | | '''[https://app.globus.org/file-manager?origin_id=a795f33e-5996-11ea-af4f-0201714f6eab cac#thecube]''' | ||
| [[THECUBE Cluster]] | | [[THECUBE Cluster]] | ||
+ | |- | ||
|} | |} |
Latest revision as of 13:02, 6 March 2023
Introduction to Globus
Many CAC resources are on Globus for high speed file transfers. Globus uses multiple parallel TCP streams to achieve high throughput. Globus also monitors file transfers and automatically retries when errors are encountered. It provides a fast and reliable method for transferring research data to and from CAC.
Log into Globus
When logging into Globus,
- Cornell users should select Cornell University under Use your existing organizational login, or
- Weill Cornell Medicine users should select Weill Cornell Medical College,
and then click on the Continue button. You will get forwarded to the CUWebLogin (Cornell users) or WCM Web Login (Weill Cornell users) page. Login using your NetID or CWID and password.
First-Time Use
- Log into Globus
- If you need to transfer files to and from your local laptop or desktop, download and install Globus Connect Personal on your host.
- To use Globus web interface, log into your Globus account and start transfer files.
- To use Globus command line interface (CLI) or script your file transfers, read the Command Line Interface documentation for more information.
Additional Documentation
More Globus documentation can be found at https://docs.globus.org.
CAC Globus Collections
The following CAC resources are on Globus via these collections:
Collection | CAC Resource |
---|---|
cac#home | CAC home directories |
CAC Archive 2/DTN | CAC Archival Storage |
Altas Cluster | ALTAS Cluster |
cac#HeritageWatch | HeritageWatch |
Hopper Cluster | Hopper Cluster |
cac#marvin | MARVIN Cluster |
cac#marx1 | Marx1 Cluster |
Pool Cluster icsefs01 File Server | Pool Cluster icsefs01 File Server |
Pool Cluster icsefs02 File Server | Pool Cluster icsefs02 File Server |
cac#mito | mito.cac.cornell.edu |
Red Cloud Object Storage | Red Cloud Object Storage. See additional setup information here. |
cac#thecube | THECUBE Cluster |