Difference between revisions of "Openstack Object Storage"

From CAC Documentation wiki
Jump to navigation Jump to search
Line 46: Line 46:
  
 
=='''Globus'''==
 
=='''Globus'''==
Red Cloud object storage is accessible via the '''cac#redcloud''' Globus endpoint. See [https://www.cac.cornell.edu/wiki/index.php?title=Archival_Storage#Using_Globus documentation here on Globus access]
+
Red Cloud object storage is accessible via the '''cac#redcloud''' Globus collection. See [https://www.cac.cornell.edu/wiki/index.php?title=Archival_Storage#Using_Globus documentation here on Globus access]
  
==='''Enabling Your Red Cloud Account on the Endpoint'''===
+
==='''Access Red Cloud Object Storage via Globus'''===
  
 
# First create ec2 credentials for your Openstack account using the <code>openstack ec2 credentials create</code> command in the [[Using_Openstack_CLI_Client | Openstack CLI client]].
 
# First create ec2 credentials for your Openstack account using the <code>openstack ec2 credentials create</code> command in the [[Using_Openstack_CLI_Client | Openstack CLI client]].
 
#* List existing ec2 credentials in your Openstack account using the <code>openstack ec2 credentials list</code> command or revoke one using <code>openstack ec2 credentials delete</code>.
 
#* List existing ec2 credentials in your Openstack account using the <code>openstack ec2 credentials list</code> command or revoke one using <code>openstack ec2 credentials delete</code>.
 
#* If you have multiple Red Cloud accounts, you can only configure one account for Globus access at any given time.  
 
#* If you have multiple Red Cloud accounts, you can only configure one account for Globus access at any given time.  
# ssh to <code>globus-redcloud.cac.cornell.edu</code> and log in using your CAC user name and password.
+
# Follow Globus instructions on [ https://docs.globus.org/how-to/access-aws-s3/ | how to access files on AWS S3 with Globus ] using
# Create the <code>~/.globus</code> directory: <code>mkdir ~/.globus</code>
+
# * The '''cac#redcloud''' Globus collection
# Create the following <code>~/.globus/s3</code> file:
+
# * The ec2 credentials you obtained using the <code>openstack ec2 credentials list</code> command in the previous step.
  <CAC user name>;<access key>;<secret key>
 

Revision as of 15:44, 26 July 2022

Red Cloud object storage can be accessed using the following interfaces:

Swift

S3

  1. To use the S3 interface, first create ec2 credentials for your Openstack account using the openstack ec2 credentials create command in the Openstack CLI client.
    • List existing ec2 credentials in your Openstack account using the openstack ec2 credentials list command or revoke one using openstack ec2 credentials delete.
  2. You can use an s3 client or SDK to access the object storage. For reference, here's a configuration file for s3cmd
[default]
access_key = <<ACCESS KEY>>
secret_key = <<SECRET KEY>>
host_base = redcloud.cac.cornell.edu:8443
host_bucket = redcloud.cac.cornell.edu:8443
signature_v2 = True
bucket_location = US
default_mime_type = binary/octet-stream
delete_removed = False
dry_run = False
encoding = UTF-8
encrypt = False
follow_symlinks = False
force = False
get_continue = False
gpg_command = /usr/local/bin/gpg
gpg_decrypt = %(gpg_command)s -d --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
gpg_encrypt = %(gpg_command)s -c --verbose --no-use-agent --batch --yes --passphrase-fd %(passphrase_fd)s -o %(output_file)s %(input_file)s
gpg_passphrase =
guess_mime_type = True
human_readable_sizes = False
list_md5 = False
preserve_attrs = True
progress_meter = True
recursive = False
recv_chunk = 4096
reduced_redundancy = False
send_chunk = 4096
skip_existing = False
socket_timeout = 300 
urlencoding_mode = normal
use_https = True
verbosity = WARNING

Globus

Red Cloud object storage is accessible via the cac#redcloud Globus collection. See documentation here on Globus access

Access Red Cloud Object Storage via Globus

  1. First create ec2 credentials for your Openstack account using the openstack ec2 credentials create command in the Openstack CLI client.
    • List existing ec2 credentials in your Openstack account using the openstack ec2 credentials list command or revoke one using openstack ec2 credentials delete.
    • If you have multiple Red Cloud accounts, you can only configure one account for Globus access at any given time.
  2. Follow Globus instructions on [ https://docs.globus.org/how-to/access-aws-s3/ | how to access files on AWS S3 with Globus ] using
  3. * The cac#redcloud Globus collection
  4. * The ec2 credentials you obtained using the openstack ec2 credentials list command in the previous step.