Difference between revisions of "Red Cloud Linux Instances Test"

From CAC Documentation wiki
Jump to navigation Jump to search
(→‎Initialize and Mount a Volume: Warning for initialization.)
Line 58: Line 58:
 
:** Remember, if you are not on campus but the security group is configured for ingress from 10.0.0.0/8, you would need to be connected to the [https://it.cornell.edu/cuvpn Cornell VPN] in order to SSH into the instance.
 
:** Remember, if you are not on campus but the security group is configured for ingress from 10.0.0.0/8, you would need to be connected to the [https://it.cornell.edu/cuvpn Cornell VPN] in order to SSH into the instance.
 
:** Is your instance on the [[Networks#Public Network|public network]]?  If not, does it have an associated [[Networks#Floating IP Addresses|floating IP address]] and are you using the correct address?
 
:** Is your instance on the [[Networks#Public Network|public network]]?  If not, does it have an associated [[Networks#Floating IP Addresses|floating IP address]] and are you using the correct address?
 +
:** Here is a tool for finding your current [whatsmyip.com IP address]. There are also port connection tools like ping and telnet you can use for troubleshooting.
  
 
:* An error like '''"Permissions <4-digits> for <key-file-name> are too open"''' means you can reach the instance, but your private key file has improper permissions.
 
:* An error like '''"Permissions <4-digits> for <key-file-name> are too open"''' means you can reach the instance, but your private key file has improper permissions.

Revision as of 21:18, 28 February 2021

Linux Instances can be created and maintained on Red Cloud using the OpenStack Web Interface. This documentation assumes a basic understanding of OpenStack, so please review that page as needed. If you are new to Linux, you may want to read the Linux Tutorial first. It is also a good idea to be familiar with the Linux Tutorial if you have not previously done Linux system administration, which is an assumed prerequisite to managing Linux Instances. Additionally, you may find the Introduction to Linux topic on the Cornell Virtual Workshop helpful.

Creating a New Linux Instance

You can boot an instance with most modern Linux distributions. Currently Red Cloud offers pre-made VM images running the following Linux distributions:

  • CentOS
  • Ubuntu (including LTS)

Steps

  1. Log in to the OpenStack Web Interface (check out how to log in if you need to)
  2. If you have not already, create a key pair
  3. If you have not already, create a security group. Note that your security group should include the inbound SSH rule so you can connect to it.
  4. Optional: Set up a Private Network
  5. Select Launch Instance from the Instances page
  6. Follow the instructions about launching a new instance, and select one of the a CentOS or Ubuntu images under the Source tab
  7. Optional: Create and attach a Volume
  8. Optional: Associate a Floating IP address

Now that you have created and launched an instance, your next steps will be to connect to it and set up a new user account. See the CentOS steps or Ubuntu steps for more information on how to set up a new user, update, and install software for each distribution.

Accessing Instances

First, establish access to your instance using Secure Shell (ssh), possibly including X Windows for remote graphical display. If you are at all unfamiliar with Linux, we recommend following the Linux Tutorial. If you would like to have a desktop environment (not available by default for Linux instances), then you may want to follow the steps for XFCE Desktop on CentOS. Establishing an SSH connection is a prerequisite for creating a Linux desktop environment such as XFCE.

Secure Shell (SSH)

The main requirements for logging in to your instance using secure shell are:

  • The security group for your instance must permit SSH connections (TCP port 22) from your current IP address.
  • You must use the private key that matches the public key in the key pair you specified when launching the instance.
  • You must log in to your instance using the correct initial username:
    • For CentOS 7, the username is centos,
    • For CentOS 8, the username is cloud-user, and
    • For Ubuntu, it is ubuntu.

To log in through SSH, specify the key pair file (for example my_key.pem), username and IP address as follows:

 ssh -i my_key.pem <username>@<IP address of your instance>

For more information on how to use SSH, see the Connect to Linux page.

Note: Transferring files can also be done over ssh. See the scp and sftp commands, or programs like WinSCP and similar software for Mac OS X.

Troubleshooting

There are several common error messages you may see when trying to access your Linux instance using SSH. These are the most likely causes for each common message.

  • "Connection timed out" means that your SSH command can't communicate at all with the instance.
    • Note: It may take a while for the connection time out to occur, so it may seem that the system is not responding at all initially. However, this is still likely a "Connection timed out" error.
    • Has the instance been started? Check the instance's console in the OpenStack Web Interface. Did the instance boot successfully?
    • Do the security group's rules allow incoming ssh connections (TCP port 22) from an address range (CIDR) that includes your current IP address? Double check that you followed the instructions for security groups.
    • Remember, if you are not on campus but the security group is configured for ingress from 10.0.0.0/8, you would need to be connected to the Cornell VPN in order to SSH into the instance.
    • Is your instance on the public network? If not, does it have an associated floating IP address and are you using the correct address?
    • Here is a tool for finding your current [whatsmyip.com IP address]. There are also port connection tools like ping and telnet you can use for troubleshooting.
  • An error like "Permissions <4-digits> for <key-file-name> are too open" means you can reach the instance, but your private key file has improper permissions.
    • Make sure your private key file is saved as a ".pem" extension and that it has the proper permissions:

      chmod 600 <key name>.pem

  • "Permission denied (<some details>)" means that the combination of the username and SSH key you are providing are not correct for this instance.
    • Make sure you are using the correct username:
      • If you are using Ubuntu, did you login as the ubuntu user? For more information on that, see the Linux Tutorial.
      • If you are using CentOS 7, did you login as the centos user?
      • If you are using CentOS 8, did you login as the cloud-user user?
      • If you are using a CentOS MATLAB instance, did you login as the root user?
    • Did you create a key pair and make sure to select it when creating the instance?
    • Are you supplying your key pair in the command? See the SSH instructions above for an example.
  • If you get an unexpected password prompt:

VNC with XFCE Desktop

In case you would prefer a desktop environment over a command-line, your Linux instance needs to have a VNC (Virtual Network Computing) server and a desktop environment installed on it. Red Cloud's "gpu-accelerated" images come with the TigerVNC server preinstalled, as well as the XFCE Desktop Environment, making it relatively easy to use a VNC client to connect to a Linux instance that is based on one of the "gpu-accelerated" images.

For Linux instances based on other images, certain packages must be installed on the instance first. This section details the steps to setting up an XFCE desktop environment for use with VNC on a CentOS 7.4 instance. Other typical Linux desktop environments, such as GNOME, are also available, but XFCE is used as an example here. Setting up a desktop environment should work similarly on Ubuntu instances as well, with some differences. Once the environment is set up, you can launch a VNC server on the instance and connect to it using a VNC client through an ssh tunnel.

VNC and XFCE Installation on CentOS

  1. Log in as root via ssh as described above.
  2. Install needed packages:
    • yum install tigervnc-server
    • yum groupinstall xfce
  3. Install some additional software that most users will want. These are only suggestions, and this is not a comprehensive list

VNC and XFCE User Setup

For each user that will want to use the XFCE Desktop, you will need to set up VNC capability. To do this, follow the directions below. Alternatively, there is also an Easy guide to secure VNC server with TLS encryption.

  1. Open a shell as that user
  2. vncpasswd
    • Sets the user's VNC password
    • This step is not necessary for read-only VNC
    • This creates a ~/.vnc folder
  3. vim ~/.vnc/xstartup
    • Do not change this file on "gpu-accelerated" instances (as commands in it prevent Anaconda from interfering with dbus)
    • On other instances, paste this text into the file:
      #!/bin/bash
      xrdb $HOME/.Xresources
      startxfce4 &
  4. chmod 775 ~/.vnc/xstartup
  5. mkdir ~/bin
  6. vim ~/bin/start_vncserver.sh
    • Paste this text into the file:
      #!/bin/bash
      vncserver -geometry 1680x1050
  7. chmod 775 ~/bin/start_vncserver.sh

Using VNC

A brief overview for users is provided here, and for more information please see the Using VNC section on our Getting Started page.

Manage the VNC Server

Whenever an instance gets rebooted, you can restart the VNC server by doing the following

  1. ssh into the instance
  2. run ~/bin/start_vncserver.sh

To find the port, you can run e.g. ps gxu | grep vnc.

You can stop the VNC server by running vncserver -kill :1. If this doesn't work, you can try pkill Xvnc.

To change or reset the VNC password, you can simply run vncpassword

To change the screen resolution:

  • Permanently: edit the script ~/.vnc/xstartup
  • For this session only: use Applications->Display
View the Desktop
  1. Open a local shell and ssh to establish the tunnel (recommended local port 10000):
    • ssh -L 10000:localhost:5901 <username>@<remote_ip>
    • Note: When this shell is closed, the VNC viewer will have to close, too, though VNC is still running.
  2. In a VNC viewer app, connect to the VNC server localhost:10000 (or whichever port you chose above).
    • This should open a window showing the desktop
    • The first time you do this:
      • For the remote computer, you may have to dismiss a warning dialog
      • You will need to initialize a "panel". Click "Use default config"

Note for Windows users: You can also find useful instructions on the VNC Tunnel Windows page. You may also want to look into OpenSSH or Bash on Ubuntu on Windows.

Instance Maintenance

All self-managed desktops, laptops, servers, and Red Cloud instances, both Windows and Linux, should be updated with Operating System, Adobe Flash, Acrobat, and Reader critical and security updates on a monthly basis. For Linux instances:

  1. Check for updates
    • Ubuntu: sudo apt update
    • CentOS: yum check-update
  2. Install updates
    • Ubuntu: sudo apt upgrade
    • CentOS: sudo yum update
  3. Reboot the instance with sudo reboot on both Ubuntu and CentOS

Before rebooting make sure to save all active work. Rebooting will disconnect you from the instance. Wait a minute or two to allow the instance to restart before reconnecting. When you reconnect, you should verify that the updates were applied by repeating step 1.

Initialize and Mount a Volume

WARNING: FILE SYSTEM INITIALIZATION OVERWRITES AND DESTROYS PREVIOUS DATA.

The instructions here are for formatting and mounting attached volumes, though steps like these can only be performed if you have allocated and attached the volume through OpenStack, which can be done while the instance is running.

Note: These instructions assume you are the root user. If you are not (such as on Ubuntu), then you may need to prepend sudo where appropriate.

  1. Set up file system:
    • mkfs.ext4 /dev/vdb
  2. Make a directory where device will be mounted, for example "scratch":
    • mkdir /scratch
  3. Mount the device:
    • mount /dev/vdb /scratch
  4. To have the mount automatically renewed after reboot, add an fstab entry (this is a little dangerous)
    • vim /etc/fstab
    • Add a line with tab separations between four fields: disk device, mounted location, "ext4", "defaults":
      • /dev/vdb /scratch ext4 defaults