Skip to main content


Operating Status

Downtimes: There is only one e-mail sent per downtime. Information concerning completion of the work or extension of the downtime will be posted on this page. Information on this page is also available via RSS feed.

2/15/2017 12:55:00 PM

February 2017's security patching is complete.

The scheduled Linux and Windows server and cluster patching for February 15, 2017 is complete. Please send questions to help@cac.cornell.edu. The next scheduled downtime is Wednesday, March 15, 2017.

2/10/2017 9:44:00 AM

DOWNTIME: Wednesday, February 15, 2017, 8am-5pm

REASONS: To apply February 2017 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CBSUFTP, CBSUSRVxx, MOLMED, WINLOGIN
  • Linux Servers: COMMCLOUD, GRIDFTP2, LINUXLOGIN, MITO, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Archival Storage
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, LIPID, MARVIN, SDSx, TARDIS, THECUBE, WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, March 15, 2017

2/7/2017 11:36:00 AM

Update: Feb 7, 2017

All CAC managed clusters, servers, and services have been restored. Please send questions to cac-help@cornell.edu

2/5/2017 5:45:00 PM

Status Update: Sunday February 5, 2016 5:45pm

The majority of CAC managed servers and services that were down as a result of Saturday evening's power outage have been restored. At this time, the ASTRA cluster remains under maintenance. Please report any troubles/problems to cac-help@cornell.edu.

2/4/2017 8:59:00 PM

Unplanned Power Outage - Feb 4, 2017 5pm - 8pm

An unplanned Ithaca campus power outage Saturday evening Feb 4, 2017 affected many CAC managed servers. CAC staff is working to restore servers and services as quickly as possible.

1/11/2017 12:58:00 PM

January 2017's security patching is complete.

The scheduled Linux and Windows server and cluster patching for January 11, 2017 is complete. Please send questions to help@cac.cornell.edu. The next scheduled downtime is Wednesday, February 15, 2017.

1/6/2017 9:42:00 AM

DOWNTIME: Wednesday, January 11, 2017, 8am-5pm

REASONS: To apply January 2017 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • CAC Archive – hardware maintenance – access will be restored upon completion
  • Windows Servers: ARECIBOWEB, ARECIBOFS, CBSUFTP, CBSUSRVxx, MOLMED, WINLOGIN
    • Linux Clusters:
    • DSS – all sessions will be terminated, all running jobs will be lost
  • SDSx – new memory will be installed in head node; all sessions will be terminated, all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, RT, STORAGE01, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Linux Clusters: ASTRA, ATLAS, ECCO, HD-HNI, LIPID, MARVIN, OSG (NYS1), TARDIS, THECUBE, WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, February 15, 2017

1/4/2017 2:57:00 PM

Campus Network Maintenance Sunday, January 8, 2017, 5am-8am

NETWORK MAINTENANCE: Sunday, January 8, 2017, 5am - 8am
REASONS: Campus router, switch, and wi-fi code upgrades
WHAT WILL BE AFFECTED? External connections (ssh, https, etc) to all CAC managed servers, clusters, and Red Cloud instances will be dropped and will need to be reconnected. All CAC managed servers, clusters, and Red Cloud instances will experience a brief (up to 15 minutes) network outage while the Rhodes Hall router is rebooted
WHAT WILL NOT BE AFFECTED? All running jobs on CAC Managed HPC clusters will stay running. All running Red Cloud instances will stay running. All servers will stay running.

12/14/2016 4:49:00 PM

December 2016's security patching is complete.

The scheduled Linux and Windows server and cluster patching for December 14, 2016 is complete. Please send questions to help@cac.cornell.edu. The next scheduled downtime is Wednesday, Jan 11, 2017.

12/9/2016 9:01:00 AM

DOWNTIME: Wednesday, December 14, 2016, 8am-5pm

REASONS: To apply December 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CBSUFTP, CBSUSRVxx, MOLMED, WINLOGIN
  • Linux Cluster: THECUBE – Extended downtime Tuesday, December 13 and Wednesday, December 14 – the entire cluster will be unavailable
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, January 11, 2017

11/9/2016 1:45:00 PM

November 2016's security patching is complete.

The scheduled Linux and Windows server and cluster patching for November 9, 2016 is complete. Please send questions to help@cac.cornell.edu. The next scheduled downtime is Wednesday, December 14, 2016.

11/4/2016 2:47:00 PM

DOWNTIME: Wednesday, November 9, 2016, 8am-5pm

REASONS: To apply November 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CBSUFTP, CBSUSRVxx, MOLMED, WINLOGIN
  • Linux Clusters: ASTRA: The head node and compute nodes will be affected; all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, December 14, 2016

10/19/2016 10:48:00 AM

Unplanned Outage: CAC Archive Service

CAC's Archive Service is down and undergoing unplanned maintenance. We will post again when it's back online.

10/12/2016 2:48:00 PM

October 2016's security patching is complete.

The scheduled Linux and Windows server and cluster patching for October 12, 2016 is complete. Please send questions to help@cac.cornell.edu. The next scheduled downtime is Wednesday, November 9, 2016.

10/7/2016 11:51:00 AM

DOWNTIME: Wednesday, October 12, 2016, 8am-5pm

REASONS: To apply October 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: LIPID and TARDIS: The head nodes and compute nodes will be affected; all running jobs will be lost.
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDSx, THECUBE, and WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, November 9, 2016

Announcements:
XSEDE 2.0 Announced: Cornell to Coordinate Software and Training Activities
Enhanced Red Cloud Exploratory Accounts Available for Free to Cornell Students and Faculty

Announcements:
XSEDE 2.0 Announced: Cornell to Coordinate Software and Training Activities
Enhanced Red Cloud Exploratory Accounts Available for Free to Cornell Students and Faculty

9/14/2016 4:48:00 PM

September 2016's security patching is complete.

The scheduled Linux and Windows server and cluster patching for September 14, 2016 is complete. Please send questions to help@cac.cornell.edu. The next scheduled downtime is Wednesday, October 12, 2016.

9/8/2016 4:10:00 PM

DOWNTIME: Wednesday, September 14, 2016, 8am-5pm

REASONS: To apply September 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters:
    HD-HNI with HD-HNI-FS – head node, cluster nodes, and file server will be rebooted; all running jobs will be lost; all active connections lost
    ECCO – head node will be rebooted; a rolling updates of compute nodes, one node at a time; active connections to head node will be lost; running jobs will not be affected
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/
  • https://federatedcloud.org/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, October 12, 2016

Announcements:
XSEDE 2.0 Announced: Cornell to Coordinate Software and Training Activities
Enhanced Red Cloud Exploratory Accounts Available for Free to Cornell Students and Faculty

8/10/2016 2:44:00 PM

August 2016's security patching is complete.

The scheduled Linux and Windows server and cluster patching for August 10, 2016 is complete. Please send questions to help@cac.cornell.edu. The next scheduled downtime is Wednesday, September 14, 2016.

8/4/2016 1:10:00 PM

DOWNTIME: Wednesday, August 10, 2016, 8am-5pm

REASONS: To apply August 2016 security patches (Windows and Linux)

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Cluster: SDSx – Staff will perform rolling updates one node at a time; running jobs will not be lost
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, September 14, 2016

7/13/2016 2:54:00 PM

July 2016's security patching is complete

The scheduled Linux and Windows server and cluster patching for July 13 is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, August 10, 2016.

7/7/2016 12:12:00 PM

UPDATE - Cooling failure in the Machine room

All systems are up

7/7/2016 11:00:00 AM

Cooling failure in the Machine room

CAC systems that were effected by cooling failure

The following systems were effected by the cooling failure. We are wokring to restore them as quickly as possible.

• kinglab • lipid • atlas • astra • tardis • marvin • nys1 • thecube

7/7/2016 10:21:00 AM

DOWNTIME: Wednesday, July 13, 2016, 8am-5pm

REASONS: To apply July 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • CAC Archive: connections will be lost, Globus will reconnect when available
  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: : DSS. The head nodes and compute nodes will be affected; all running jobs will be lost
  • Linux Servers: ARCHIVE01, GRIDFTP1, GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, STORAGE01, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Linux Clusters: ASTRA, ATLAS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, August 10, 2016

7/7/2016 9:10:00 AM

Unplanned Downtime

Machine room cooling problems have affected clusters and other systems. Details will be added as they become available.

6/16/2016 10:26:00 AM

NETWORK MAINTENANCE: Sunday, June 19, 5am - 8am

REASONS: Campus router, switch, and wi-fi code upgrades

WHAT WILL BE AFFECTED? External connections (ssh, https, etc) to all servers and Red Cloud instances will be dropped and will need to be reconnected. All servers and Red Cloud instances will experience a brief (up to 15 minutes) network outage while the Rhodes Hall router is rebooted.

WHAT WILL NOT BE AFFECTED? All running jobs on HPC clusters will stay running. All running Red Cloud instances will stay running. All servers will stay running.

6/15/2016 4:09:00 PM

June 2016's security patching is complete

The scheduled Linux and Windows server and cluster patching for June 15 is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, July 13, 2016.

6/9/2016 11:47:00 AM

DOWNTIME: Wednesday, June 15, 2016, 8am-5pm

REASONS: To apply June 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ASTRA, ATLAS, and KINGLAB: The head nodes and compute nodes will be affected; all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: DSS, ECCO, HD-HNI, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, July 13, 2016

6/6/2016 12:03:00 PM

WHAT: RED CLOUD ITHACA UNPLANNED OUTAGE

WHEN: Monday, June 6, 2016 9:45 – noon

REASONS: Rhodes Hall Machine Room cooling problems caused Red Cloud hardware to shut down due to high temperatures.

WHO/WHAT WAS AFFECTED? All EBS instances running in Red Cloud Ithaca were stopped; running instances were lost.

WHAT DO YOU NEED TO DO? Start your Red Cloud instances. If your instance still has a “running” status, please first stop and then start the instance.

PLEASE notify us if you have trouble restarting your Red Cloud Ithaca instances: https://www.cac.cornell.edu/help/

5/23/2016 5:07:00 PM

DOWNTIME: Wednesday, May 25, 2016, 8am-Noon Eastern

REASONS: Upgrade Eucalyptus software on Red Cloud Ithaca to 4.2.2 to fix known bugs

WHO WILL BE AFFECTED? Red Cloud Ithaca users

WHAT WILL BE UNAVAILABLE DURING THE UPGRADE?

  • The Red Cloud web console: https://Euca4.cac.cornell.edu
  • Command line cloud API
  • Users will not be able to modify instances using the web console or the cloud API

WHAT WILL NOT BE AFFECTED DURING THE UPGRADE?

  • Red Cloud instances should continue to run without disruptions.

STATUS: Downtime status will be posted.

PLEASE NOTIFY US AS SOON AS POSSIBLE IF THIS UPGRADE WILL CAUSE AN INCONVENIENCE: https://www.cac.cornell.edu/help/

5/11/2016 3:57:00 PM

May 2016's security patching is complete

The scheduled Linux and Windows server and cluster patching for May 11 is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, June 15, 2016!

5/5/2016 3:53:00 PM

DOWNTIME: Wednesday, May 11, 2016, 8am-5pm

REASONS: To apply May 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: LIPID and TARDIS: The head nodes and compute nodes will be affected; all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, STORAGE02, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDSx, THECUBE, and WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, June 15, 2016

4/11/2016 12:50:00 PM

April 11th, 2016 - campus wide power outage

The campus wide power outage affected many CAC services. CAC staff is working to bring all services back online as soon as possible. We will post another status when all services are restored. For assistance, send email to help@cac.cornell.edu.

4/8/2016 11:38:00 AM

DOWNTIME: Wednesday, April 13, 2016, 8am-5pm

REASONS: To apply April 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: LIPID and TARDIS: The head nodes and compute nodes will be affected; all running jobs will be lost.
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDSx, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, May 11, 2016

3/10/2016 8:46:00 AM

March 2016's security patching is complete

The scheduled Linux and Windows server and cluster patching for March 9 is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, April 13, 2016!

3/3/2016 4:10:00 PM

DOWNTIME: Wednesday, March 9, 2016, 8am-5pm

REASONS: To apply March 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ECCO and SDSx: The head nodes will be affected. Existing connections will be dropped. Running jobs will NOT be affected
  • Linux Clusters: HD-HNI and WALLER: The head nodes and compute nodes will be affected; all running jobs will be lost
  • Linux Servers: ARCHIVE01, GRIDFTP1, GRIDFTP2, LINUXLOGINx, MYPROXY, RT, STORAGE01, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Linux Clusters: ASTRA, ATLAS, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), TARDIS, and THECUBE.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, April 13, 2016

2/10/2016 2:43:00 PM

February 2016's security patching is complete

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, March 9, 2016!

2/5/2016 10:30:00 AM

DOWNTIME: Wednesday, February 10, 2016, 8am-5pm

REASONS: To apply February 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGIN, MITO, MYPROXY, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, March 9, 2016

1/13/2016 4:20:00 PM

January 2016's security patching is complete.

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, February 10, 2016!

1/7/2016 1:44:00 PM

DOWNTIME: Wednesday, January 13, 2016, 8am-5pm

REASONS: To apply January 2016 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • CAC Archive: Globus endpoints will be unavailable
  • Linux Clusters: DSS: The head nodes and compute nodes will be patched, all running jobs will be lost
  • Linux Servers: ARCHIVE01, GRIDFTP1, GRIDFTP2, LINUXLOGINx, MYPROXY, RT, STORAGE01, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Linux Clusters: ASTRA, ATLAS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, February 10, 2016

12/9/2015 4:00:00 PM

December 2015's security patching is complete.

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, January 13, 2016!

12/4/2015 2:24:00 PM

DOWNTIME: Wednesday, December 9, 2015, 8am-5pm

REASONS: To apply December 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ATLAS: The head nodes and compute nodes will be patched, all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT, TALE-NT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER.

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, January 13, 2016

12/1/2015 8:25:00 AM

NETWORK MAINTENANCE: Saturday, December 5, 5am – 7am (EST).

REASONS: CIT Network Engineers will perform maintenance on Cornell campus routers.

WHAT WILL BE AFFECTED? External connections to all servers and Red Cloud instances will be dropped and will need to be reconnected. All servers and Red Cloud instances will experience a brief (up to 15 minutes) network outage while the Rhodes Hall router is rebooted.

WHAT WILL NOT BE AFFECTED? All running jobs on HPC clusters will stay running. All running Red Cloud instances will stay running.

11/20/2015 12:04:00 PM

Archive service

Issues are resolved

11/19/2015 11:49:00 AM

Archive service

Currently experiencing hardware issues on Archive

CAC staff is working on this

11/11/2015 3:23:00 PM

November 2015's security patching is complete.

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, December 9th, 2015.

11/5/2015 4:41:00 PM

DOWNTIME: Wednesday, November 11, 2015, 8am-5pm

REASONS: To apply November 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ASTRA and KINGLAB: The head nodes and compute nodes will be patched, all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Linux File Servers: STORAGE02
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ATLAS, DSS, ECCO, HD-HNI, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, December 9, 2015

10/14/2015 6:58:00 PM

October 2015 security patching is complete.

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, November 11th, 2015.

10/8/2015 3:06:00 PM

DOWNTIME: Wednesday, October 14, 2015, 8am-5pm

REASONS: To apply October 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: TARDIS and LIPID: The head nodes and compute nodes will be patched, all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Linux File Servers: STORAGE02
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDSx, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, November 11, 2015

9/9/2015 5:15:00 PM

September 2015 security patching is complete.

August 2015 security patching is complete The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, October 14, 2015.

9/4/2015 10:27:00 AM

DOWNTIME: Wednesday, September 9, 2015, 8am-5pm

REASONS: To apply September 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ECCO, SDSx, HD-HNI, and WALLER. The head nodes and compute nodes will be patched, all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Linux File Servers: HD-HNI-FS
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ASTRA, ATLAS, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), TARDIS, THECUBE

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, October 14, 2015

8/14/2015 8:17:00 AM

NETWORK MAINTENANCE: Sunday, August 16, 6am – noon (EST).

REASONS: CIT Network Engineers will upgrade Cornell campus routers.

WHAT WILL BE AFFECTED? External connections to all servers and Red Cloud instances will be dropped and will need to be reconnected. All servers and Red Cloud instances will experience a 10 minute network outage while the Rhodes Hall router is rebooted.

WHAT WILL NOT BE AFFECTED? All running jobs on HPC clusters will stay running. All running Red Cloud instances will stay running.

8/12/2015 4:27:00 PM

August 2015 security patching is complete

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, September 9th, 2015.

8/6/2015 2:53:00 PM

DOWNTIME: Wednesday, August 12, 2015, 8am-5pm

REASONS: To apply August 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Cluster: DSS : The head node and compute nodes will be patched, all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Linux File Servers: STORAGE01, GRIDFTP2, ARCHIVE01
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • CAC Services: Archival Storage Service will be unavailable for a portion of the maintenance window
  • https://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Linux Clusters: ASTRA, ATLAS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, WALLER

STATUS: Downtime status will be posted.

QUESTIONS: https://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, September 9, 2015

ANNOUNCEMENT:
CAC has created an URGENT queue in our ticketing system (https://www.cac.cornell.edu/help). The URGENT queue is intended for CAC users to report CRITICAL system outages. Tickets created in this queue will alert senior CAC staff via SMS 24 hours a day 7 days a week. The CAC operates under standard business hours (Monday-Friday, 8am-5pm) but we make a best effort to respond to outages during off-hours. Users must use the web form to create tickets in the Urgent queue.

7/15/2015 5:07:00 PM

July 2015 security patching is complete

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, August 12th, 2015.

7/9/2015 4:30:00 PM

DOWNTIME: Wednesday, July 15, 2015, 8am-5pm

REASONS: To apply July 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ATLAS (ATLAS’ head node and compute nodes will be patched; all running jobs will be lost.)
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Database servers: CACSQL, ARECIBOSQL, and CBSUSQLxx
  • Archival Storage Service
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Linux Clusters: ASTRA, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, August 12, 2015

7/6/2015 9:08:00 AM

Documentation wiki update today 7-6-2015

The wiki database is turned to read-only while updates are being applied.

6/10/2015 12:23:00 PM

ANNOUNCEMENT: CAMPUS-WIDE NETWORK MAINTENANCE: On Sunday, June 14th, 2015, 5am – noon, the Ithaca campus network switches that serve most campus buildings will have their firmware upgrades. This will cause rolling brief outages of less than 10 minutes for the wired and wireless networks, as well as Voice over IP (VOIP) telephones, when each building's switch is upgraded. External connections to all CAC managed clusters, servers, and services (including Red Cloud instances) will be unavailable for up to 10 minutes while the Rhodes Hall switch is upgraded.

6/10/2015 12:22:00 PM

June 2015 security patching is complete

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, July 15th, 2015.

6/4/2015 3:50:00 PM

DOWNTIME: Wednesday, June 10, 2015, 8am-5pm

REASONS: To apply June 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Archival Storage Service
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, July 15, 2015

ANNOUNCEMENT: CAMPUS-WIDE NETWORK MAINTENANCE:
On Sunday, June 14th, 2015, 5am – noon, the Ithaca campus network switches that serve most campus buildings will have their firmware upgrades. This will cause rolling brief outages of less than 10 minutes for the wired and wireless networks, as well as Voice over IP (VOIP) telephones, when each building's switch is upgraded. External connections to all CAC managed clusters, servers, and services (including Red Cloud instances) will be unavailable for up to 10 minutes while the Rhodes Hall switch is upgraded.

6/4/2015 2:20:00 PM

Sunday, June 14th, 5am - noon, Campus-wide Network Maintenance

On Sunday, June 14th, between 5am and noon, the campus network switches that serve most campus buildings will have their firmware upgrades. This will cause rolling brief outages of less than 10 minutes for the wired and wireless networks, as well as Voice over IP (VOIP) telephones, when their building's switch is upgraded.

5/13/2015 4:34:00 PM

May 2015 security patching is complete

The scheduled Linux and Windows server and cluster patching for today is complete. Please send questions to help@cac.cornell.edu The next scheduled downtime is Wednesday, June 10th, 2015

5/8/2015 2:00:00 PM

DOWNTIME: Wednesday, May 13, 2015, 8am-5pm

REASONS: To apply May 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ASTRA and KINGLAB (cluster head node and compute nodes will be patched; all running jobs will be lost).
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Archival Storage Service
  • Linux Clusters: ATLAS, DSS, ECCO, HD-HNI, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, June 10, 2015

4/15/2015 4:38:00 PM

April 2015 security patching is complete

All of the scheduled Linux and Windows patching for today is complete. Please send questions to help@cac.cornell.edu Next scheduled downtime: Wednesday, May 13, 2015

4/10/2015 1:25:00 PM

DOWNTIME: Wednesday, April 15, 2015, 8am-5pm

REASONS: To apply April 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: LIPID and TARDIS (cluster head node and compute nodes will be patched; all running jobs will be lost).
  • Linux Servers: STORAGE02, GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Archival Storage Service
  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDSx, THECUBE, WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, May 13, 2015

3/20/2015 11:31:00 AM

Unplanned Outage: March 20, 2015 - Red Cloud Storage Controller

Red Cloud storage controller failed and was rebooted.

The Red Cloud storage controller was rebooted to restart hung services. As far as we can tell all instances are still running. For your running instances please check: 1) Is the instance reachable? If the instance is unreachable, please reboot the instance using the web console or “euca-reboot-instances” command. 2) Does the instance have an EBS volume mounted? If the instance has a mounted EBS volume, then the EBS file system probably became read-only. Please unmount/mount or remount the file system. 3) Is the instance an EBS instance? If so, please reboot it so the root file system is read-writable again using the web console or the "euca-reboot-instances" command. As always, please report problems to help@cac.cornell.edu

3/11/2015 5:19:00 PM

March 2015 CAC security patching is complete

All of the scheduled Linux and Windows patching for today is complete. Please send inquiries to help@cac.cornell.edu Next scheduled downtime: Wednesday, April 15, 2015

3/6/2015 8:48:00 AM

DOWNTIME: Wednesday, March 11, 2015, 8am-5pm

REASONS: To apply March 2015 security patches (Windows and Linux)

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: ECCO, SDSx, HD-HNI, and WALLER (cluster head nodes and their compute nodes will be patched; all running jobs will be lost)
  • Linux Servers: HD-HNI-FS (all connections will be lost), GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Archival Storage Service
  • Linux Clusters: ASTRA, ATLAS, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), TARDIS, and THECUBE

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, April 15, 2015

2/17/2015 10:34:00 AM

UNPLANNED OUTAGE: Feb 17, 2015 - Archival Storage is down

CAC staff are investigating reported problems with accessing the Archival Storage Service.

2/6/2015 3:18:00 PM

DOWNTIME: Wednesday, February 11, 2015, 8am-5pm

REASONS: To apply February 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Cluster: DSS cluster head node and its compute nodes; all running jobs will be lost
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Storage Service: STORAGE01 and GRIDFTP1 all connections will be lost
  • Archival Storage Service: All connections will be lost; data transfers should resume automatically
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • Linux Clusters: ASTRA, ATLAS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, March 11, 2015

1/14/2015 3:32:00 PM

January 2015 CAC security patching is complete

All of the scheduled Linux and Windows patching for today is complete. Please send questions to help@cac.cornell.edu

Next scheduled downtime: Wednesday, February 11, 2015

1/8/2015 1:35:00 PM

DOWNTIME: Wednesday, January 14, 2015, 8am-5pm

REASONS: To apply January 2015 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, RED CLOUD Managed Instances, and WINLOGINx
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, TALE-NT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLE
  • CAC Archive
  • CAC Storage (DDN, home directories)
  • Red Cloud

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, February 11, 2015

12/23/2014 4:19:00 PM

CAC Winter Break Schedule

CAC will observe the Cornell University winter break starting December 24, 2014, returning on Monday, January 5, 2015.

The operating status of all CAC resources will be monitored as usual during this period.

CAC staff will periodically monitor consulting questions throughout the holiday period. Critical user questions will be answered; non-critical user questions will be addressed beginning Monday, January 5, 2015.

Please submit any questions you may have via the help system:http://www.cac.cornell.edu/help/ or help@cac.cornell.edu.

Happy Holidays
Cornell University Center for Advanced Computing

12/8/2014 9:34:00 AM

DOWNTIME: Wednesday, December 10, 2014, 8am-5pm

REASONS: To apply December 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters (head nodes and compute nodes will be patched; all running jobs will be lost): ASTRA, KINGLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT, TALE-NT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • CAC Archive
  • Linux Clusters: ATLAS, DSS, ECCO, HD-HNI, LIPID, MARVIN, OSG (NYS1), SDS, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, January 14, 2015

11/7/2014 1:26:00 PM

DOWNTIME: Wednesday, November 12, 2014, 8am-5pm

REASONS: To apply November 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Cluster (including head node and compute nodes, all running jobs will be cancelled): ATLAS
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Red Cloud
  • ASTRA, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, December 10, 2014

10/15/2014 2:46:00 PM

October 2014 CAC security patching is complete

All of the scheduled Linux and Windows patching for today is complete. Please send questions to help@cac.cornell.edu

10/10/2014 11:37:00 AM

DOWNTIME: Wednesday, October 15, 2014, 8am-5pm

REASONS: To apply October 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN(x)
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters (running jobs will be lost, entire cluster will be rebooted): ATLAS, LIPID, and TARDIS
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, TALE-NT, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, November 12, 2014

10/2/2014 2:21:00 PM

Red Cloud with Matlab is back in service.

10/2/2014 12:16:00 PM

Red Cloud with Matlab: unplanned outage Oct 1, 2014 - ?

Red Cloud with Matlab is currently down. We are working with Mathworks to correct the problem as soon as possible. Please send inquiries to help@cac.cornell.edu

9/15/2014 11:58:00 AM

UNPLANNED OUTAGE: CAC Archive Service

CAC Staff is investigating reported troubles with accessing the CAC archive service. We will post more information as soon as possible.

9/5/2014 12:26:00 PM

DOWNTIME: Wednesday, September 10, 2014, 8am-5pm

REASONS: To apply September 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of many CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, October 15, 2014

8/13/2014 6:27:00 PM

August 2014 CAC security patching is complete.

All of the scheduled Linux and Windows patching for today is complete. Please send questions to help@cac.cornell.edu

8/7/2014 3:08:00 PM

DOWNTIME: Wednesday, August 13, 2014, 8am-5pm

REASONS: To apply August 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN(x)
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters (head node and compute node kernel updates): ECCO, HD-HNI (including HD-HNI-FS), SDSx, and WALLER
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), TARDIS, and THECUBE
  • Red Cloud

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, September 10, 2014

7/17/2014 2:32:00 PM

July 18, 2014 Emergency Network Maintenance

CIT will perform emergency network maintenance Friday morning, July 18th at around 5am on CAC networks. All external connections to CAC managed servers and CBSU servers will be disconnected as a result.

7/9/2014 12:00:00 PM

July 2014 CAC security patching is complete.

All of the scheduled Linux and Windows patching for today is complete. Please send questions to help@cac.cornell.edu

7/7/2014 11:35:00 AM

DOWNTIME: Wednesday, July 9, 2014, 8am-noon

REASONS: To apply July 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, RED CLOUD Managed Instances, and WINLOGINx
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDSx, TARDIS, THECUBE, and WALLER
  • CAC Storage (DDN, home directories)

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, August 13, 2014

6/11/2014 4:20:00 PM

June 2014 CAC security patching is complete.

Scheduled Linux and Windows patching for today is complete. Please send questions to help@cac.cornell.edu

6/11/2014 9:49:00 AM

Red Cloud EBS volumes are online and EBS-backed instances can be restarted.

Red Cloud EBS volumes are now available. EBS-backed instances can be restarted and EBS volumes can be re-attached as required. Please report problems or ask questions at: http://www.cac.cornell.edu/help.

6/5/2014 2:29:00 PM

DOWNTIME: Wednesday, June 11, 2014, 8am-5pm

REASONS: To apply (1) June 2014 security patches to Windows and Linux stand alone servers, and (2) emergency critical patches to the CAC storage unit (DDN).

WHO WILL BE AFFECTED? Users of many CAC managed resources housed in Rhodes Hall, specifically this month, users of CAC storage.

WHAT WILL BE UNAVAILABLE WHILE THE CAC DDN IS SERVICED?

  • CAC Archival Storage service
  • CAC Storage leases
  • Red Cloud EBS volumes will be unavailable. Red Cloud users will be sent a separate email with instructions to prevent data loss
  • Gluster volumes will not be accessible (managed by James Vanee, Biotech)
  • DDN attached file servers: archive01, hd-hni-fs, gridftp1, storage01, storage02, storage03, storage05, weill-fs, and xrootd01
  • Linux Cluster home directories: DSS, HD-HNI, LIPID, OSG Storage Element, and TARDIS

WHAT WILL BE UNAVAILABLE WHILE THE RESOURCES ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, ECCO, KINGLAB, MARVIN, THECUBE

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, July 9, 2014

6/5/2014 2:25:00 PM

Attention Red Cloud users

During the scheduled CAC maintenance next Wednesday, June 11th all Red Cloud EBS volumes will be unavailable.

Please follow these instructions to prevent data loss. Prior to 8am on June 11th:

  1. All EBS backed instances should be “stopped” (NOT terminated). See diagram below for instructions on how to:
    1. Determine if you have EBS backed instances
    2. Select the instance
    3. Stop the instance

  2. Any EBS Volumes attached to instance-store instances should be un-mounted and detached

After the maintenance is complete, users can “start” their stopped EBS instances and re-attach and mount their EBS volumes to their instance-store instances.

For assistance: http://www.cac.cornell.edu/help/

5/9/2014 2:39:00 PM

DOWNTIME: Wednesday, May 14, 2014, 8am-5pm

REASONS: To apply May 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters (includes head nodes and cluster nodes; all running jobs will be canceled): ASTRA and KINGLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT, STORAGE02
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ATLAS, DSS, ECCO, HD-HNI, LIPID, MARVIN, OSG (NYS1), SDS, TARDIS, THECUBE, and WALLER
  • Red Cloud infrastructure (note: administrators should patch their running Red Cloud instances where necessary).

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, June 11, 2014

4/14/2014 11:23:00 AM

Openssl heartbeat vulnerability in Red Cloud

  • The Eucalyptus software that runs Red Cloud’s infrastructure was patched to close the openssl heartbeat vulnerability late Tuesday afternoon, April 8th, 2014.
  • The openssl heartbeat vulnerability affected 2 Linux distributions officially supported in Red Cloud:
    • CentOS 6
    • Ubuntu 12.04
    • Please note: CentOS 5 is NOT affected.
  • CentOS 6:
    • Two new images containing fully patched CentOS 6.5 have been added. Users should use these CentOS 6.5 images from now on:
      • emi-47A0330B (instance-store)
      • emi-5A38465A (EBS)
    • All older CentOS 6 images containing vulnerable openssl have been removed.
    • Users using their own customized CentOS 6 instance-store or EBS images should patch openssl immediately by running the “yum -y update openssl” command as root and either reboot the instance or restart all services depending on openssl (httpd, sshd, tomcat, etc). To verify your instance is patched, run the “rpm -q openssl” and make sure you get “openssl-1.0.1e-16.el6_5.7.x86_64” as the response.
  • Ubuntu 12.04 LTS
    • Two new images containing fully patched Ubuntu 12.04 LTS have been added. Users should use these Ubuntu images from now on:
      • emi-51773BB2 (instance store)
      • emi-A3FD41FA (EBS)
    • All older Ubuntu 12.04 images containing vulnerable openssl have been removed.
    • Users using their own customized Ubuntu 12.04 LTS instance-store or EBS images should patch openssl immediately by running the “apt-get upgrade openssl” command as root and either reboot the instance or restart all services depending on openssl (httpd, sshd, tomcat, etc). To verify your instance is patched, run the “openssl version -a” command as root and make sure you see the line “built on: Mon Apr 7 20:33:29 UTC 2014” or later in the output.

QUESTIONS: http://www.cac.cornell.edu/help/

4/9/2014 1:55:00 PM

April 2014 CAC security patching is complete.

Scheduled patching for today is complete. Emergency OpenSSL patching is also complete. Please send questions to help@cac.cornell.edu

4/9/2014 9:19:00 AM

ALERT: All CAC managed servers using OpenSSL will be patched immediately.

CAC servers using OpenSSL will be patched today, April 9, 2014, during our regularly scheduled downtime. Please send questions to help@cac.cornell.edu.

4/4/2014 3:05:00 PM

DOWNTIME: Wednesday, April 9, 2014, 8am-5pm

REASONS: To apply April 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED AND REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters (includes head nodes and cluster nodes; all running jobs will be canceled): LIPID and TARDIS
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT, STORAGE02
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, May 14, 2014

3/26/2014 4:28:00 PM

RED CLOUD DOWNTIME -- COMPLETE

If you should run into any problems please e-mail help@cac.cornell.edu.

3/25/2014 6:55:00 PM

RED CLOUD DOWNTIME

To upgrade RED CLOUD to Eucalyptus 3.4.2

The down time is extended to March 26th, 2014 at 5pm. Please refrain from use of Red Cloud resources until this upgrade is complete.

3/14/2014 3:24:00 PM

RED CLOUD DOWNTIME: Tuesday, March 25th, 2014, 8am-5pm

REASONS: To upgrade RED CLOUD to Eucalyptus 3.4.2

WHY? 3.4.2 Features include:

  • Load Balancer and Autoscaling
  • Improved web console
  • Minimize down time required for future upgrades
  • Improved ephemeral/local disk performance

WHO WILL BE AFFECTED? CAC RED CLOUD Users. User impact:

  • Users will need to shut down instance-store instances prior to the start of the upgrade. Users should save their customized instance-store image using the instructions.
  • Users will need to STOP EBS-backed instances prior to the start of the upgrade. Users will be able to START EBS-backed instances after the upgrade is completed.
  • Prior to the upgrade, all running instances will be TERMINATED.

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

3/12/2014 1:56:00 PM

March 2014 scheduled downtime work is complete.

Please send inquiries to help@cac.cornell.edu.

3/7/2014 1:58:00 PM

DOWNTIME: Wednesday, March 12, 2014, 8am-5pm

REASONS: To apply March 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters (running jobs will be killed, compute nodes will be patched and rebooted): ECCO and HD-HNI (including HD-HNI file server)
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT, TALE-NT, SDS
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, April 9, 2014

3/5/2014 8:57:00 AM

Linux systems patched to avoid the gnutls vulnerability.

For security reasons, all CAC Managed Linux systems will be patched against the gnutls vulnerability today. Reboots are not required.

2/27/2014 10:50:00 AM

Unplanned Power Outage - February 27th at around 10:00am

Power has been restored. CAC staff are bringing up CAC managed servers and services as quickly as possible. Send questions to help@cac.cornell.edu

2/12/2014 12:15:00 PM

February 2014 scheduled downtime work is complete.

Please send questions to help@cac.cornell.edu.

2/7/2014 2:12:00 PM

DOWNTIME: Wednesday, February 12, 2014, 8am-5pm

REASONS: To apply February 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • The CAC Archive service will be unavailable while ARCHIVE01 is patched and rebooted.
  • Website: http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, March 12, 2014

1/22/2014 10:43:00 AM

Unplanned Power Outage - Jan 22nd at around 10:25am

There was a brief, unplanned power outage across much of the Cornell Ithaca campus. Many CAC managed servers, clusters, and services have been affected.

All servers, clusters, and services will be brought back on line as soon as possible.

1/16/2014 11:22:00 AM

Monday, January 20th, 2014 is a Cornell Holiday.

CAC will observe the Cornell University Holiday on Monday, January 20th, 2014.

The operating status of all CAC resources will be monitored as usual and CAC staff will periodically monitor consulting questions. Critical user questions will be answered; non-critical user questions will be addressed on Tuesday, January 21st, 2014.

Please submit any questions via the CAC help system: http://www.cac.cornell.edu/help/ or help@cac.cornell.edu.

1/15/2014 5:10:00 PM

January 2014 scheduled downtime work is complete.

Please send questions to help@cac.cornell.edu.

1/10/2014 11:46:00 AM

DOWNTIME: Wednesday, January 15, 2014, 8am-5pm

REASONS: To apply January 2014 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE BRIEFLY WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: ARCHIVE01, GRIDFTP1, STORAGE01
  • Linux Clusters and Servers: DSS, GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • The CAC Archive service will be unavailable while ARCHIVE01 is patched and rebooted.
  • Website: http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, TARDIS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, February 12th, 2014

12/11/2013 2:21:00 PM

December 2013 scheduled downtime work is complete.

Please send questions to help@cac.cornell.edu.

12/6/2013 1:40:00 PM

DOWNTIME: Wednesday, December 11, 2013 8am-5pm

REASONS: To apply December 2013 security patches (Windows and Linux).

WHAT WILL BE UNAVAILABLE BRIEFLY WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, January 15th, 2013

11/8/2013 3:56:00 PM

DOWNTIME: Wednesday, November 13, 2013 8am-5pm

REASONS: To apply November 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE BRIEFLY WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Cluster head nodes: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, LIPID, MARVIN, NYS2 (OSG), SDS, TARDIS, THECUBE, and WALLER
  • Linux Servers: GRIDFTP2, HLB, LINUXLOGINx, MYPROXY, PETIE, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, December 11th, 2013

10/20/2013 7:30:00 PM

Unplanned Power Outage - 10/20/2013 at around 5:15pm

There is an unplanned power outage across much of the Cornell campus. Many CAC managed servers and clusters have been affected.

All servers, clusters, and services will be brought back on line first thing Monday morning.

10/15/2013 3:03:00 PM

Red Cloud EBS Volumes are accessible.

The previously reported trouble with Red Cloud EBS Volumes has been resolved. All Red Cloud services are running. Please, as always, send your questions to help@cac.cornell.edu.

10/12/2013 3:56:00 PM

ALL CAC-managed systems are back on-line except:

RED CLOUD: EBS volumes are not available; Users can use Red Cloud instances that do not require EBS attached volumes.

Thank you for your patience.

As always, please send your questions to help@cac.cornell.edu

10/11/2013 4:02:00 PM

DOWNTIME EXTENDED UNTIL NOON ON SATURDAY, OCT 12.

This week's downtime work continues. We anticipate everything back online tomorrow at noon.

10/10/2013 4:53:00 PM

DOWNTIME EXTENSION:

REASON:

  • We are actively working with the vendor (DDN) to resolve unexpected issues encountered during the firmware upgrade process.
  • We will bring the system online as soon as possible.
  • We will provide a better ETA as soon as we can.
  • We apologize for the inconvenience.

WHAT IS UNAVAILABLE WHILE THE STORAGE CONTROLLER'S AND ENCLOSURE'S FIRMWARE WORK CONTINUES?

  • WINLOGIN
  • Red Cloud with MATLAB
  • LINUXLOGIN1 and LINUXLOGIN2
  • File Servers: archive01, euca3-sc, gridftp1, hd-hni-fs, osg-xrootd01, seqpipe, storage01, storage02, storage03, storage05, and winstor01
  • RED CLOUD: Users can use Red Cloud instances that do not require EBS attached volumes
  • CAC Archival Storage service
  • glusterfs managed by James VanEe
  • Linux Clusters: DSS, HD-HNI, LIPID, OSG (SE only), and TARDIS -
    (User's home directories on these clusters are served from CAC storage and will not be accessible until the downtime work is complete)

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

10/9/2013 4:42:00 PM

DOWNTIME EXTENDED

REASON: Today's work to apply firmware updates to CAC storage controllers and enclosures is taking longer than we expected. We are working with the vendor (DDN) to bring the system on-line as soon as possible.

WHAT WILL BE UNAVAILABLE WHILE THE STORAGE CONTROLLER'S AND ENCLOSURE'S FIRMWARE WORK CONTINUES?

  • WINLOGIN
  • Red Cloud with MATLAB
  • LINUXLOGIN1 and LINUXLOGIN2
  • File Servers: archive01, euca3-sc, gridftp1, hd-hni-fs, osg-xrootd01, seqpipe, storage01, storage02, storage03, storage05, and winstor01
  • RED CLOUD: EBS storage
  • CAC Archival Storage service
  • glusterfs managed by James VanEe
  • Linux Clusters: DSS, HD-HNI, LIPID, OSG (SE only), and TARDIS
    (User's home directories on these clusters are served from CAC storage and will not be accessible until the downtime work is complete)

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

10/4/2013 1:47:00 PM

DOWNTIME: Wednesday, October 9, 2013, 8am-5pm

REASONS: To apply October 2013 security patches (Windows and Linux). To apply firmware updates to CAC storage controllers and enclosures. To update the operating system on CLAL server: amma2 – reboot required.

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Servers: GRIDFTP2, HLB, LINUXLOGINx, MYPROXY, PETIE, RT
  • MAC Server: AMMA2
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

WHAT WILL BE UNAVAILABLE WHILE THE STORAGE CONTROLLER'S AND ENCLOSURE'S FIRMWARE IS UPDATED?

  • File Servers: archive01, euca3-sc, gridftp1, hd-hni-fs, osg-xrootd01, seqpipe, storage01, storage02, storage03, storage05, and winstor01
  • RED CLOUD: All users should detach EBS volumes and stop EBS backed instances before the down time to prevent data loss.
  • CAC Archival Storage service
  • Red Cloud with MATLAB
  • glusterfs managed by James VanEe
  • Linux Clusters: DSS, HD-HNI, LIPID, OSG (SE only), and TARDIS - (User's home directories are served from CAC storage)

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, ECCO, KINGLAB, MARVIN, SDS, THECUBE, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, November 13th, 2013

9/11/2013 4:01:00 PM

September downtime work complete.

Please send questions to help@cac.cornell.edu.

9/6/2013 3:21:00 PM

DOWNTIME: Wednesday, September 11, 2013, 8am-5pm

REASONS: To apply September 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Clusters: LIPID and TARDIS user's home directories will be unavailable for approximately 30 minutes during STORAGE02's maintenance. Running jobs writing to LIPID and TARDIS user's home directories will fail; other LIPID and TARDIS jobs will not be affected
  • Linux Servers: STORAGE02, GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, PWSLINUX, RT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

WHAT WILL NOT BE AFFECTED THIS MONTH?

  • Linux Clusters: ASTRA, ATLAS, DSS, ECCO, HD-HNI, KINGLAB, MARVIN, OSG (NYS1), SDS, SSG, and WALLER

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, October 9th, 2013

8/14/2013 4:15:00 PM

August 2013 Downtime Tasks complete.

Please send your questions and/or report problems to help@cac.cornell.edu

8/12/2013 9:43:00 AM

Network maintenance Tuesday, August 13, 2013 at 5am

Network Maintenance Tuesday morning will affect the following research subnets in the Rhodes Hall server farm: Vlan Subnet 369 128.84.162.0/24 405 128.84.70.0/24 555 128.84.40.0/22 609 128.84.1.0/24 612 128.84.20.0/24 614 128.84.5.0/24 745 128.84.29.0/24 All servers attached to these subnets will experience a brief network outage while the switch is rebooted.

8/9/2013 3:08:00 PM

DOWNTIME: Wednesday, August 14th, 2013, 8am-5pm

REASONS: To apply August 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE WHILE THEY ARE PATCHED and REBOOTED?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Linux Cluster head nodes: AMMA2, ASTRA, ATLAS, DSS, HD-HNI, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, and WALLER
  • Linux Servers: GRIDFTP2, LINUXLOGINx, MYPROXY, PETIE, PWSLINUX, RT, ZELLIG
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, September 11th, 2013

8/9/2013 10:38:00 AM

Unexpected power outage at 10:30am

There was an unexpected power outage at about 10:30am on Friday, August 9th. Some of the managed machines were affected. We are restoring them as quickly as possible. Please report any problems to help@cac.cornell.edu.

7/10/2013 4:28:00 PM

July 2013 Downtime Tasks complete.

Please report troubles to help@cac.cornell.edu

7/8/2013 3:35:00 PM

DOWNTIME: Wednesday, July 10th, 2013, 8am-5pm

REASONS: To apply July 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATO, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: Red Cloud with MATLAB
  • Storage Servers: STORAGE01 and STORAGE02– user's home directories served from these servers will be unavailable during the maintenance window. This includes the Biotech (J. Vanee) supported Gluster file system
  • Linux Clusters affected (these clusters use storage01 and storage02 for home directories): CLASSE, DSS, LIPID, TARDIS
  • Linux Clusters NOT affected (these use locally supplied home directories): ASTRA, ATLAS, MARVIN, NYS1 (OSG), KINGLAB, SDS, SSG, WALLER
  • Linux Servers: GRIDFTP1, GRIDFTP2, HLB, LINUXLOGINx, MONITOR, MYPROXY, PETIE, PWSLINUX, RT, TALE-NT
  • Database servers: CTCSQL, ARECIBOSQL, CBSUSQLX
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, August 14th, 2013

6/28/2013 4:46:00 PM

unplanned outage: storage01

CAC file server storage01, which serves many CAC user's home directories unexpectedly crashed Friday, June 28th, at approx 4:30pm.

The server has been rebooted and files are being served again.

6/7/2013 2:45:00 PM

DOWNTIME: Wednesday, June 12th, 2013, 8am-5pm

REASONS: To apply June 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATO, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: CATS and Red Cloud with MATLAB
  • Linux Cluster's head nodes will be patched and rebooted: ASTRA, ATLAS, CLASSE, DSS, LIPID, MARVIN, SDS, SSG, TARDIS, and WALLER
  • Linux Servers: GRIDFTP1, GRIDFTP2, HLB, LINUXLOGIN2, MONITOR, MYPROXY, PETIE, PWSLINUX, RT, TALE-NT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, July 10th, 2013

REMINDER: V4 will be decommissioned July 1rst, 2013.

5/23/2013 1:48:00 PM

/v4scratch has been rebuilt and is available on v4.

/v4scratch has been rebuilt on replacement hardware. It's available for use on V4 at this time. Reminder, this is a scratch volume, and should be used for temporary file storage only. Save all important files to your home directory to prevent data loss.

5/22/2013 11:24:00 AM

ALERT: /v4scratch is down.

/v4scratch file system on the V4 cluster has crashed. Estimated time for availability is unknown. CAC staff will report more when possible.

5/15/2013 4:33:00 PM

May 2013 downtime tasks have been completed.

5/14/2013 8:06:00 AM

5/14/2013: Power outage affecting many CAC managed clusters and servers

A campus power outage at 7:20am has brought down many CAC managed clusters and servers. Staff are working to restore all as quickly as possible.

5/10/2013 11:48:00 AM

DOWNTIME: Wednesday, May 15th, 2013, 8am-5pm

REASONS: To apply May 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATO, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: CATS and Red Cloud with MATLAB
  • Linux Cluster's head nodes will be patched and rebooted: ASTRA, ATLAS, CLASSE, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, V4, and WALLER
  • Linux Servers: GRIDFTP1, GRIDFTP2, HLB, LINUXLOGIN2, MONITOR, MYPROXY, PETIE, PWSLINUX, RT, TALE-NT
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, June 12th, 2013

4/5/2013 3:26:00 PM

DOWNTIME: Wednesday, April 10th, 2013, 8am-5pm

REASONS: To apply April 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE?

  • Windows Servers: ARECIBOWEB, ARECIBOFS, CATO, CATSLOGINxx, CBSUFTP, CBSUSRVxx, MOLMED, and WINLOGIN
  • Windows Clusters: CATS and Red Cloud with MATLAB
  • Linux Cluster head nodes will be patched and rebooted: ASTRA, ATLAS, CLASSE, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, V4, and WALLER
  • Linux Servers: GRIDFTP1, GRIDFTP2, HLB, LINUXLOGIN2, MONITOR, MYPROXY, PETIE, PWSLINUX, RT, ZELLIG
  • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLxx
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, May 15th, 2013

3/28/2013 10:16:00 AM

CIT network maintenance on CAC subnets 4/2/2013 at 5am

WHEN? Tuesday, April 2nd, 2013, 5am - 7am

WHAT? CIT will be performing network maintenance on the CAC subnetslisted below. Remote connections (SSH and RDP) to servers with connections to these subnets will be lost. Users will need to reconnect after the maintenance is complete.

SUBNETS AFFECTED:

128.84.1.x
128.84.5.x
128.84.20.x
128.84.29.x
128.84.40.x
128.84.70.x
128.84.162.x

USERS AFFECTED: CBSU, CFG, KINGLAB, LIPID, PETIE, SDS, SSG, TARDIS

WHAT IS NOT AFFECTED: CAC subnet 128.84.3.x; connections to servers on this subnet will not be affected.

STATUS: Maintenance status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, April 10th, 2013

3/11/2013 12:45:00 PM

EMERGENCY NETWORK MAINTENANCE: Monday, March 11th, 2013, 3pm

REASONS: To correct a network routing issue.

WHO WILL BE AFFECTED? Users connected to CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE? Existing connections to CAC managed resources will be temporarily dropped while the switch reboots.

STATUS: Status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, April 10th, 2013

3/10/2013 3:13:00 AM

Storage01 is back online

Storage01 is online and all users home directories and CAC leased storage are available.

Please report any problems to help@cac.cornell.edu

3/9/2013 10:24:00 PM

Unplanned outage: Storage01 down - home directories affected

CAC Server storage01 is currently down. This server provides access to the majoority of user's home directores and CAC leased storage.

CAC Staff is addressing. Updates will be posted.

3/8/2013 9:55:00 AM

DOWNTIME: Wednesday, March 13th, 2013, 8am-5pm

REASONS: To apply March 2013 security patches (Windows and Linux).

WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

WHAT WILL BE UNAVAILABLE?

  • Windows Servers: WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED
  • Windows Clusters: CATS, Red Cloud with MATLAB
  • Linux Cluster head nodes running Centos 6 will be patched and rebooted on: ASTRA, DSS, TARDIS
  • Linux Servers running Centos 6: TALE-NT
  • Windows Database servers: CTCSQL, ARECIBOSQL, CBSUSQLX
  • Website: http://www.cac.cornell.edu/

STATUS: Downtime status will be posted.

QUESTIONS: http://www.cac.cornell.edu/help/

NEXT SCHEDULED DOWNTIME: Wednesday, April 10th, 2013

2/14/2013 1:24:00 PM

Emergency Down Time on 2/14 Completed

All file systems should be back online. Report any problems to help@cac.cornell.edu. Thank you!

2/14/2012 9:21:00 AM

EMERGENCY DOWNTIME: Thursday, February 14, 2013, 1:00-1:20 pm

REASONS: To reboot a shared file server (storage02) to correct a problem encountered after yesterday's scheduled maintenance.

WHO WILL BE AFFECTED? Users belonging to the following groups/projects:

  • Home directories for Tardis cluster users (cjf76_0001)
  • Home directories for Lipid cluster users (gwf3_0001)
  • Home directories of Alon Keinan's group (ak735_0001)
  • Storage for frmaxfie_0001, har2001_0001, taryan_0001 that have access via Globus Connect/GridFTP.

QUESTIONS: http://www.cac.cornell.edu/help/

2/8/2013 2:54:00 PM

DOWNTIME: Wednesday, February 13th, 2013, 8am-5pm

REASONS: To apply February 2013 security patches (Windows and Linux).

  • Windows Servers: WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED
  • Windows Clusters: CATS, Red Cloud with MATLAB
  • Storage Servers: STORAGE01, STORAGE02, STORAGE03 – all user's home directories served from these servers will be unavailable for a brief time during the maintenance window. This includes the Biotech (J. Vanee) supported Gluster file system and the Globus Connect endpoints for frmaxfie_0001, har2001_0001, and taryan_0001.
    • Linux Clusters affected (these use CAC storage for home directories): CLASSE, DSS, LIPID, TARDIS, V4
    • Linux Clusters NOT affected (these use local home directories): ASTRA, ATLAS, MARVIN, KINGLAB, OSG (NYS1), SDS, SSG, WALLER
  • Linux Servers: TALE-NT, PETIE, ZELLIG, PWSLINUX, CLOUD-LOGIN, RT, LINUXLOGIN2, GRIDFTP
  • Database servers: CTCSQL, ARECIBOSQL, CBSUSQLX
  • http://www.cac.cornell.edu/
  • STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, March 13th, 2013

    1/31/2013 7:03:00 AM

    Several CAC systems are down due to a power outage late Wednesday night

    CAC staff is working to bring up all affected servers as soon as possible.

    We will update the status page periodically until all systems are online.

    1/10/2013 10:19:00 AM

    January 2013 security patching complete.

    1/4/2013 9:45:00 AM

    DOWNTIME: Wednesday, January 9th, 2013, 8am-5pm

    REASONS: To apply January 2013 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED
    • Windows Clusters: CATS, Red Cloud with MATLAB
    • Linux Cluster head nodes running Centos 6 will be patched and rebooted on: ASTRA, DSS, TARDIS
    • Linux Servers running Centos 6: TALE-NT, ZELLIG, HLB, CLOUD-LOGIN, RT
    • Windows Database servers: CTCSQL, ARECIBOSQL, CBSUSQLX
    • http://www.cac.cornell.edu/

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, February 13th, 2013

    12/19/2012 10:16:00 AM

    /v4scratch has been rebuilt and is available on v4.

    The hardware housing /v4scratch suffered a catastrophic failure on Saturday, Dec 15th and all data on this scratch space was lost. The volume has been rebuilt and is available on V4. Please remember that this is a true scratch space so please do not store valuable data there permanently.

    12/19/2012 9:17:00 AM

    CAC Winter Break Schedule

    CAC will observe the Cornell University winter break starting December 24, 2012, returning on Wednesday, January 2, 2013.

    The operating status of all CAC resources will be monitored as usual during this period.

    CAC staff will periodically monitor consulting questions throughout the holiday period. Critical user questions will be answered; non-critical user questions will be addressed beginning Wednesday, January 2, 2013.

    Please submit any questions you may have via the help system: http://www.cac.cornell.edu/help/ or help@cac.cornell.edu.

    Happy Holidays
    Cornell University Center for Advanced Computing

    12/18/2012 3:22:00 PM

    /v4scratch back online

    /v4scratch on v4linux cluster is now back online. Unfortunately, all data in this scratch space were lost due to hardware failure.

    12/16/2012 1:57:00 PM

    /v4scratch is unavailable

    CAC staff is investigating.

    12/12/2012 4:57:00 PM

    December 2012 patching is complete.

    All work scheduled for today has been completed. Please report any problems to help@cac.cornell.edu

    12/7/2012 1:57:00 PM

    DOWNTIME: Wednesday, December 12th, 2012, 8am-5pm

    REASONS: To apply December 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED
    • Windows Clusters: CATS, Red Cloud with MATLAB
    • Linux Cluster head nodes will be patched and rebooted on: ASTRA, ATLAS, CLASSE, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, V4, WALLER
    • Linux Servers: TALE-NT, PETIE, ZELLIG, HLB, MONITOR, PWSLINUX, CLOUD-LOGIN, RT, LINUXLOGIN2, GRIDFTP1, GRIDFTP2, MYPROXY
    • Database servers: CTCSQL, ARECIBOSQL, CBSUSQLX
    • http://www.cac.cornell.edu/

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, January 9th, 2013

    11/27/2012 3:40:00 PM

    Red Cloud with MATLAB disk maintenance planned

    Downtime Nov 28, 2012 9-10AM Eastern Time.

    11/26/2012 11:34:00 AM

    Emergency Maintenance on Red Cloud with MATLAB is complete

    11/26/2012 9:20:00 AM

    Emergency Maintenance

    Affects Red Cloud with MATLAB only. 9:30AM - Noon on Monday, Nov 26, 2012

    11/14/2012 3:39:00 PM

    November downtime and Unexpected Power Outage Recovery complete

    Security and Critical patches have been applied to CAC servers per the announcement. All clusters and servers should now be available after unexpected campus wide power outage at approximately 10:45AM.

    Please, as always, report problems and send inquiries to help@cac.cornell.edu.

    11/14/2012 12:12:00 PM

    Red Cloud Restored; All Running Instances Lost

    Because of the unplanned power outage this morning, all Red Cloud nodes were rebooted. Consequently all running instances were lost. The service has been restored. Users should be able to start new instances and access EBS volumes again.

    11/14/2012 11:23:00 AM

    Power outage affecting many CAC managed clusters and servers

    CAC staff are reacting to a power blip that brought down many clusters and servers. Stay tuned for more information.

    11/14/2012 11:17:00 AM

    Unplanned Power Outage

    We recently had a ten second power outage, which was apparently campus wide.

    The scheduled down time is still in progress. But now ALL servers and clusters have been power cycled since the power outage also hit the machine room.

    11/8/2012 4:02:00 PM

    DOWNTIME: Wednesday, November 14th, 2012, 8am-5pm

    REASONS: To apply November 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED
    • Windows Clusters: CATS and Red Cloud with MATLAB
    • Linux Servers: TALE-NT, PETIE, ZELLIG, HLB, MONITOR, PWSLINUX, SYSRH5, CONSULTRH5, LM-R900, LINUXSVC01, LINUXSVC02, PWSLINUX1, CLOUD-LOGIN, RT, LINUXLOGIN2, MYPROXY
    • Database servers: CTCSQL, ARECIBOSQL, CBSUSQLX, etc
    • http://www.cac.cornell.edu/

    NOTE: Linux clusters ASTRA, ATLAS, CLASSE, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, V4, and WALLER will NOT be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, December 12th, 2012

    WORKSHOP ANNOUNCEMENT: CAC will present “Parallel Computing at TACC: Ranger to Stampede Transition” at Cornell University in Ithaca on December 11, 2012. For more informationand to register, visit https://www.xsede.org/web/xup/course-calendar/-/training/class/73. Register by Dec 3.

    10/31/2012 12:07:00 PM

    Storage02.cac.cornell.edu - emergency reboot Thursday, Nov 1st, 8am

    Storage02 will be rebooted at 8am on Thursday, Nov 1st to improve performance.

    The following users will be affected: Tardis cluster users Lipid cluster users Alon Keinan (group) leased storage users James VanEe's Gluster storage users The reboot should take less than 1 hour.

    10/24/2012 11:20:00 AM

    Emergency Maintenance complete. Red Cloud with MATLAB is back in projection.

    10/24/2012 12:00:00 AM

    Emergency Maintenance on Red Cloud with MATLAB file storage - Wednesday, October 24th 9am -noon

    10/10/2012 2:04:00 PM

    October downtime work complete.

    Security and Critical patches have been applied to CAC servers per the downtime announcement. Please, as always, report problems and send inquiries to help@cac.cornell.edu.

    10/4/2012 11:44:00 AM

    DOWNTIME: Wednesday, October 10th, 2012, 8am-5pm

    REASONS: To apply October 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, and MOLMED
    • Windows Clusters: CATS and Red Cloud with MATLAB
    • Linux Cluster head nodes will be patched and rebooted on: ASTRA, ATLAS, CLASSE, DSS, DSS1, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, V4, and WALLER
    • Linux Servers: PETIE, ZELLIG, HLB, MONITOR, PWSLINUX, CLOUD-LOGIN, RT, LINUXLOGIN2, DC, GRIDFTP1, GRIDFTP2, and MYPROXY
    • Database servers: CTCSQL, ARECIBOSQL, and CBSUSQLX
    • http://www.cac.cornell.edu/

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, November 14th, 2012

    9/21/2012 8:40:00 AM

    All work scheduled for the Sept. 21 downtime has been completed.

    9/20/2012 10:26:00 AM

    EMERGENCY DOWNTIME

    Friday, 8-9AM ET. During the downtime we will replace a failed PERC battery in order to avoid the possibility of data loss. During this downtime you will not be able to submit batch jobs, and some web pages will fail.

    9/12/2012 3:53:00 PM

    September 2012 security patching is complete.

    All work scheduled for the September 2012 downtime has been completed.

    9/7/2012 3:38:00 PM

    DOWNTIME: Wednesday, September 12th, 2012, 8am-5pm

    REASONS: To apply September 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: (WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED)
    • Windows Clusters: CATS, Red Cloud with MATLAB
    • Linux Cluster: V4: All jobs will be cancelled and all compute nodes will be rebooted
    • Linux Servers: (PETIE, ZELLIG, HLB, MONITOR, PWSLINUX, CLOUD-LOGIN, RT, LINUXLOGIN2, DC)
    • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc)
    • http://www.cac.cornell.edu/

    NOTE: Linux clusters ASTRA, ATLAS, CLASSE, DB, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, and WALLER will NOT be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, October 12th, 2012

    8/15/2012 11:38:00 AM

    August 2012 security patching is complete.

    All work scheduled for August 2012 downtime has been completed.

    8/9/2012 1:53:00 PM

    DOWNTIME: Wednesday, August 15th, 2012, 8am-noon

    REASONS: To apply August 2012 security patches (Windows only this month).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: (WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED)
    • Windows Clusters: Red Cloud with MATLAB
    • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: Linux stand-alone servers and Linux clusters ATLAS, CLASSE, DB, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, V4, and WALLER will NOT be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, September 12th, 2012

    8/7/2012 9:12:00 AM

    V4 Scheduling Problems Resolved

    Please send your questions and report any troubles to help@cac.cornell.edu

    8/6/2012 6:14:00 PM

    V4 Problems Under Investigation

    Reported problems where V4 jobs are being blocked or deferred have been confirmed. CAC staff is investigating. Stay tuned for further updates.

    7/25/2012 9:18:00 AM

    Marvin lustre file system back online

    The lustre file system /scratch2 is back online on the marvin cluster.

    7/24/2012 11:44:00 AM

    Marvin Cluster Lustre File System Down

    the lustre file system on marvin cluster, /scratch2, is experiencing problems. CAC systems staff is working with Terascala Support to resolve the problem.

    7/11/2012 12:05:00 PM

    July 2012 security patching is complete.

    All work scheduled for July 2012 downtime has been completed.

    7/5/2012 1:35:00 PM

    DOWNTIME: Wednesday, July 11th, 2012, 8am-5pm

    REASONS: To apply July 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: (WINLOGIN, CATO, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, MOLMED)
    • Windows Clusters: Red Cloud with MATLAB
    • Linux Servers: (PETIE, ZELLIG, HLB, MONITOR, PWSLINUX, SYSRH5, CONSULTRH5, LM-R900, SCHEDULER, LINUXSVC01, LINUXSVC02, PWSLINUX1, CLOUD-LOGIN, RT, LINUXLOGIN2, MYPROXY, DC)
    • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: Linux clusters ATLAS, CLASSE, DB, DSS, KINGLAB, LIPID, MARVIN, OSG (NYS1), SDS, SSG, TARDIS, V4, and WALLER will NOT be affected

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, August 15th, 2012

    7/3/2012 2:50:00 PM

    v4linuxlogin1.cac Emergency Power Cycle

    v4linuxlogin1 was forced to have an emergency power cycle due to unresponsiveness. Please be reminded to NOT perform heavy I/O with heavy writes to your home directories NOR should one be running any jobs from the head node. Please submit jobs via the scheduler. If any further questions, please send message to: help@cac.cornell.edu.

    6/13/2012 5:59:00 PM

    June 2012 security patching is complete.

    All work scheduled for June 2012 downtime has been completed.

    6/8/2012 12:00:00 AM

    DOWNTIME: Wednesday, June 13th, 2012, 8am-5pm

    REASONS: To apply June 2012 security patches (Windows and Linux) and to migrate a few file systems (including home directories) to new disks.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: (WINLOGIN, CATO, CATS cluster, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS)
    • Windows Clusters: Red Cloud with MATLAB
    • Linux Servers: (PETIE, ZELLIG, HLB, MONITOR, PWSLINUX, SYSRH5, CONSULTRH5, LM-R900, SCHEDULER, LINUXSVC01, LINUXSVC02, PWSLINUX1, CLOUD-LOGIN, RT, LINUXLOGIN2, MYPROXY, DC)
    • Linux Clusters: V4, CLASSE, and DSS – all home directories on these clusters will be unavailable, all jobs will be canceled, head nodes will be patched and rebooted
    • A few file systems served from storage01.cac.cornell.edu:
      • Sam Cartinhour leased storage (/home/fs02/sc167_0001 on v4linux)
      • CBSU home directories (/home/gfs08 on v4linux)
      • CBSU leased storage (mounted via CIFS)
      • Adam Siepel leased storage (/home/gfs05 on v4linux)
    • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: Linux clusters OSG, ATLAS, DB, KINGLAB, LIPID, MARVIN, SDS, SSG, TARDIS, and WALLER will NOT be affected

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, July 11th, 2012

    CAC SERVICES: Check out Red Cloud, a new Cornell cloud computing service with no charges for data movement in and out of the cloud. See http://www.cac.cornell.edu/redcloud.

    5/9/2012 3:55:00 PM

    May 2012 security patching is complete.

    All work scheduled for May 2012 downtime has been completed.

    5/5/2012 11:21:00 AM

    DOWNTIME: Wednesday, May 9th, 2012 – between 8am-5pm each server will be unavailable for a brief time while it is patched and rebooted

    REASONS: To apply May 2012 security patches (Windows only)

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: Windows Servers: (WINLOGIN, CATS cluster, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS)
    • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc).
    • Red Cloud with MATLAB
    • http://www.cac.cornell.edu/

    NOTE: NOTE: The following will NOT be affected:

    • Linux clusters (ATLAS, CLASSE, DB, DSS, KINGLAB, LIPID, MARVIN, NYS1, SDS, SSG, TARDIS, V4, WALLER)
    • Home directories housed on CAC storage
    • Red Cloud instances (these are normally maintained by the owner)

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, June 13th, 2012

    CAC SERVICES: Check out Red Cloud, a new Cornell cloud computing service with no charges for data movement in and out of the cloud. See http://www.cac.cornell.edu/redcloud.

    4/14/2012 8:42:00 AM

    April 2012 Downtime Work Complete

    All work scheduled for April 2012 downtime has been completed.

    All work scheduled for April 2012 downtime has been completed. Please report any problems to help@cac.cornell.edu.

    4/13/2012 4:01:00 PM

    Progress continues to be made re. the DDN storage upgrade.

    Drives continue to rebuild. We are anticipating users can log back in on Sat, 4/14/12. Check back for further status.

    4/13/2012 11:59:00 AM

    Progress continues to be made re. the DDN storage upgrade.

    After several drive failures, drives are currently rebuilding. The ETA is still unknown. We will post another status approx. 3:00pm today.

    4/13/2012 8:50:00 AM

    Storage Upgrade Continues to be in Progress

    We will post another status noon today.

    4/12/2012 3:28:00 PM

    Storage upgrade is still in progress

    Storage upgrade is on-going

    We are continuing work on the DDN upgrade and anticipate another 24 hours of unavailable services. Please see prior anouncement for list of CAC services that are unavailable.

    4/11/2012 8:10:00 PM

    Storage upgrade is in progress

    Please see prior announcement for list of unavailable CAC services.

    Storage upgrade is in progress. Please see prior announcement for list of unavailable CAC services.

    4/6/2012 3:30:00 PM

    CAC April Downtime: April 11th, 2012 (and possibly April 12, 2012

    In addition to the DDN upgrade work listed below, April’s monthly security patches will be installed on CAC managed Windows servers including: • Windows Servers: (WINLOGIN, CATO, CATS cluster, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS) • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc). • http://www.cac.cornell.edu/ These servers will be unavailable briefly around 10am while they reboot after the patches are applied. STATUS: Downtime status will be posted.

    3/28/2012 12:00:00 AM

    DDN upgrade scheduled for April 11 and April 12

    REASONS: To increase data storage capacity

    This work is scheduled for Wednesday April 11 and Thursday April 12!

    To increase data storage capacity, CAC will double the number of disk slots available on the CAC Storage Farm. A two day outage is necessary to do the upgrade.

    There is a risk that data will be lost as a result of the upgrade. If your data on CAC storage is your only copy, you may want to back it up prior to the upgrade. CAC has contracted with the vendor to perform this upgrade in a way that minimizes the risk of data loss, however there is still a risk.

    BACKUP REMINDER: We want to remind you that your CAC storage is NOT backed up by default. Project owners can request regularly scheduled backups, which are administered through the CIT EZBackup service.

    WHEN: April 11th, 8am to April 12th, 5pm

    THE FOLLOWING STORAGE WILL BE UNAVAILABLE:

    • All home directories for users on the following clusters: V4, CLASSE, DSS, LIPID, TARDIS
    • Storage Leases: All, including the GlusterFS file system managed by James VanEe, and the xrootd file system served by OSG Storage Element
    • EBS Volumes in Red Cloud: Red Cloud instances must detach all EBS volumes to avoid data corruption. Red Cloud instances can continue to run without EBS volumes attached and can re-attach EBS volumes after the upgrade
    • Red Cloud with MATLAB

    THE FOLLOWING COMPUTING WILL BE UNAVAILABLE:

    • Red Cloud with MATLAB: computing will be unavailable
    • V4, CLASSE, DSS, LIPID, TARDIS: During the upgrade, access to computing on these clusters will be limited. Your home directories will NOT be available
    • OSG Storage Element: Storage Element will not be accessible. Jobs on the Compute Element not requiring access to the Storage Element should continue to run uninterrupted. The Compute Element should continue to accept and start new jobs

    NOTE: The following will NOT be affected re storage or computing:

    • Linux clusters (ATLAS, DB, KINGLAB, MARVIN, SDS, SSG, WALLER, OSG Compute Element)
    • Local disks in Red Cloud instances

    QUESTIONS: http://www.cac.cornell.edu/help/

    3/14/2012 2:16:00 PM

    March 2012 downtime work completed

    All work scheduled for March 2012 downtime has been completed.

    3/9/2012 4:25:00 PM

    DOWNTIME: Wednesday, March 14th, 2012 8am-5pm

    REASONS: To apply March 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows Servers: Windows Servers: (WINLOGIN, CATO, CATS cluster, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS)
    • Linux Servers: (PETIE, ZELLIG, HLB, MONITOR, PWSLINUX, SYSRH5, CONSULTRH5, LM-R900, SCHEDULER, LINUXSVC01, LINUXSVC02, PWSLINUX1, CLOUD-LOGIN, RT, LINUXLOGIN2, MYPROXY, DC)
    • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc).
    • Red Cloud with MATLAB
    • http://www.cac.cornell.edu/

    NOTE: Linux clusters OSG, ATLAS, CLASSE, DB, DSS, KINGLAB, LIPID, MARVIN, SDS, SSG, TARDIS, WALLER, and home directories housed on CAC storage will NOT be affected

    NEW SOFTWARE: Intel 12.1 Compilers and Libraries
    On March 14th, the default version of the Intel compilers will change from 11.1 to 12.1 on the login nodes linuxlogin1.cac.cornell.edu and linuxlogin2.cac.cornell.edu. Please refer to the V4 User Guide for instructions.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, April 11th, 2012

    CAC SERVICES: Check out Red Cloud, a new Cornell cloud computing service with no charges for data movement in and out of the cloud. See http://www.cac.cornell.edu/redcloud.

    Red Cloud Lunch ‘n Learn seminar – March 28: CAC will be presenting a technical seminar on how to use Cornell’s Red Cloud, an Infrastructure as a Service that runs Eucalyptus, the open source, Amazon-compatible cloud computing platform. For more information, visit: http://www.cac.cornell.edu/about/news/120228.aspx.

    2/24/2012 7:01:00 AM

    Announcement:

    CAC ANNOUNCEMENT: To increase data storage capacity, CAC will double the number of disk slots available on the CAC Storage Farm. A two day outage is necessary to do the upgrade.

    There is a risk that data will be lost as a result of the upgrade. If your data on CAC storage is your only copy, you may want to back it up prior to the upgrade. CAC has contracted with the vendor to perform this upgrade in a way that minimizes the risk of data loss, however there is still a risk.

    BACKUP REMINDER: We want to remind you that your CAC storage is NOT backed up by default. Project owners can request regularly scheduled backups, which are administered through the CIT EZBackup service.

    WHEN: TBD. Our estimate is for two days in early April 2012. We will send another announcement when the actual dates are set.

    THE FOLLOWING STORAGE WILL BE UNAVAILABLE:

    • All home directories for users on the following clusters: V4, CLASSE, DSS, LIPID, TARDIS
    • Storage Leases: All, including the GlusterFS file system managed by James VanEe, and the xrootd file system served by OSG Storage Element
    • EBS Volumes in Red Cloud: Red Cloud instances must detach all EBS volumes to avoid data corruption. Red Cloud instances can continue to run without EBS volumes attached and can re-attach EBS volumes after the upgrade.
    • Red Cloud with MATLAB

    THE FOLLOWING COMPUTING WILL BE UNAVAILABLE:

    • Red Cloud with MATLAB: computing will be unavailable.
    • V4, CLASSE, DSS, LIPID, TARDIS: During the upgrade, access to computing on these clusters will be limited. Your home directories will NOT be available.
    • OSG Storage Element: Storage Element will not be accessible. Jobs on the Compute Element not requiring access to the Storage Element should continue to run uninterrupted. The Compute Element should continue to accept and start new jobs.

    NOTE: The following will NOT be affected re storage or computing:

    • Linux clusters (ATLAS, DB, KINGLAB, MARVIN, SDS, SSG, WALLER, OSG Compute Element)
    • Local disks in Red Cloud instances

    QUESTIONS: http://www.cac.cornell.edu/help/

    2/15/2012 3:29:00 PM

    February 2012 downtime work completed

    All work scheduled for February 2012 downtime has been completed.

    2/13/2012 4:12:00 PM

    DOWNTIME: Wednesday, February 15th, 2012 8am-5pm

    REASONS: To apply February 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows and Linux Servers: (WINLOGIN, SCHEDULER (V4), CATO, CATS cluster, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS)
    • Database servers (CTCSQL, ARECIBOSQL, CBSUSQLX, etc).
    • Red Cloud with MATLAB
    • http://www.cac.cornell.edu/

    NOTE: The following will NOT be affected:

    • Linux clusters (OSG, ATLAS, CLASSE, DB, DSS, KINGLAB, LIPID, MARVIN, SDS, SSG, TARDIS, WALLER)
    • Home directories housed on CAC storage
    • Red Cloud instances (these are normally maintained by the owner)

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, March 14th, 2012

    NEW SOFTWARE: Intel 12.1 Compilers and Libraries
    On March 14th, the default version of the Intel compilers will change from 11.1 to 12.1 on the login nodes linuxlogin1.cac.cornell.edu and linuxlogin2.cac.cornell.edu. We highly recommend recompiling and testing your codes prior to this change. Please refer to the V4 User Guide for instructions.

    CAC SERVICES: Check out Red Cloud, a new Cornell cloud computing service with no charges for data movement in and out of the cloud. See http://www.cac.cornell.edu/redcloud.

    1/31/2012 4:55:00 PM

    STORAGE01 is back online and stable at this time.

    Logins to v4linuxlogin1 and response times to commands like showq, ls, and showqlease should behave normally at this time.

    1/31/2012 3:49:00 PM

    UNPLANNED OUTAGE: CAC HOME DIRECTORIES SERVED FROM STORAGE01.CAC

    STORAGE01.CAC.CORNELL.EDU is currently experiencing trouble. This is causing delayed responses when logging in to linuxlogin1 and to commands like df, ls, showq, showqlease, etc. CAC staff is addressing the issue at this time.

    1/13/2012 11:40:00 AM

    STORAGE01 is back online.

    We apologize for the unplanned outage. Please report any problems to help@cac.cornell.edu.

    1/13/2012 10:30:00 AM

    UNPLANNED OUTAGE: CAC HOME DIRECTORIES SERVED FROM STORAGE01.CAC

    CAC file server storage01.cac.cornell.edu crashed unexpectedly. CAC staff are working to bring it back online. Many CAC home directories are affected.

    1/11/2012 4:31:00 PM

    Jan 2012 downtime work completed

    All work scheduled for Jan 2012 downtime has been completed.

    1/6/2012 4:25:00 PM

    DOWNTIME: Wednesday, January 11th, 2011 8am-5pm

    REASONS: To apply January 2012 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows and Linux Servers: (WINLOGIN, CATO, CATS cluster, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, RT, PETIE, ZELLIG, HLB, LINUXLOGIN2, DC)
    • v4linuxlogin1 (alias linuxlogin1) - maintenance will include adding memory to improve performance
    • V4 cluster - due to v4linuxlogin1's maintenance
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Red Cloud with MATLAB
    • http://www.cac.cornell.edu/

    NOTE: The following with NOT be affected:

    • Linux clusters (OSG, ATLAS, CLASSE, DB, DSS, KINGLAB, LIPID, MARVIN, SDS, SSG, TARDIS, WALLER)
    • Home directories housed on CAC storage, and Red Cloud instances.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, February 15th, 2012

    NEW SOFTWARE: Intel 12.1 Compilers and Libraries
    The latest Intel Composer XE software, which includes C/C++ and Fortran compilers (icc, ifort), as well as MKL 10.3.6 and various other performance libraries, has recently been installed on v4.The new versions will become the defaults during the Februrary downtime. Therefore, you are encouraged to try compiling and linking with them now. To do this, you must first "source /opt/intel/intel-12.sh" (or .csh). This should be done not only on the login nodes at compile/link time, but also in your batch jobs at run time so that the correct dynamic libraries are found. More information is available.

    DATA ANALYSIS ON RANGER AND LONGHORN TRAINING WORKSHOP: On Thursday and Friday, January 19-20, 2012, Cornell Center for Advanced Computing staff will present Data Analysis on Ranger and Longhorn, on the Ithaca, New York campus of Cornell University. After a review of getting started using Ranger's environment and batch system, the first day of the workshop will emphasize data movement and analysis tools. The second day will focus on scientific visualization and code improvement. You do not need to have an account on Ranger or Cornell Center for Advanced Computing HPC clusters to attend the workshop. There is no fee to attend.
    Register
    Questions
    Agenda

    CAC SERVICES: Check out Red Cloud, a new Cornell cloud computing service with no charges for data movement in and out of the cloud. See http://www.cac.cornell.edu/redcloud.

    12/14/2011 12:23:00 PM

    Today’s scheduled maintenance has been completed.

    Please report problems to help@cac.cornell.edu or http://www.cac.cornell.edu/help

    12/9/2011 2:57:00 PM

    DOWNTIME: Wednesday, December 14th, 2011 8am-5pm

    REASONS: To apply December 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows and Linux Servers: (WINLOGIN, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, RT, PETIE, ZELLIG, HLB, DSRG, LINUXLOGIN2, DC)
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc)
    • Red Cloud with MATLAB
    • http://www.cac.cornell.edu/

    NOTE: The following with NOT be affected: Linux clusters (OSG, CLASSE, DSS, LIPID, KINGLAB, SDS, SSG, TARDIS, V4, WEBLAB, WALLER), home directories housed on CAC storage, and Red Cloud instances.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, January 11th, 2012

    NEW SERVICES: Check out Red Cloud, a new Cornell cloud computing service with no charges for data movement in and out of the cloud. See http://www.cac.cornell.edu/redcloud. Another service, Red Cloud with MATLAB, is also available for MATLAB users and educators.

    11/28/2011 5:18:00 PM

    /v4scratch's maintenance is complete.

    The /v4scratch file system is available at this time.

    11/28/2011 10:57:00 AM

    /v4scratch file system: Emergency Maintenance today at 1pm (Monday, Nov 28)

    CAC staff will be performing emergency maintenance on the /v4scratch file system today at 1pm. We anticipate the work to be completed in 5 hours. We will re-announce when it's available.

    11/4/2011 3:27:00 PM

    DOWNTIME: Wednesday, November 9th, 2011 8am-5pm

    REASONS: To apply November 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • Windows and Linux Servers: (WINLOGIN, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, RT, PETIE, ZELLIG, HLB, DSRG, LINUXLOGIN2, DC)
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc)
    • http://www.cac.cornell.edu/

    NOTE: Linux clusters will NOT be affected (OSG, CLASSE, DSS, LIPID, KINGLAB, SDS, SSG, TARDIS, V4, WEBLAB, WALLER). Home directories housed on CAC storage will not be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, December 14th, 2011

    10/12/2011 6:41:00 PM

    RT (CAC Help desk) is currently experiencing problems.

    http://rt.cac.cornell.edu and http://www.cac.cornell.edu/help are currently unavailable. CAC staff is working on this.

    10/12/2011 4:52:00 PM

    Today’s scheduled maintenance has been completed.

    Please report problems to help@cac.cornell.edu or http://www.cac.cornell.edu/help

    10/7/2011 3:35:00 PM

    DOWNTIME: Wednesday, October 12th, 2011 8am-5pm

    REASONS: (1) Apply October 2011 security patches (Windows and Linux) (2) Install Intel 12 compilers on v4 (Intel 10 compilers will be removed)

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE? Servers listed will be unavailable for a brief period during the downtime window while they are patched and rebooted.

    • Windows and Linux Servers: (WINLOGIN, CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, RT, PETIE, ZELLIG, HLB, DSRG, LINUXLOGIN2, DC, CITRUS-GREENING)
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc)
    • http://www.cac.cornell.edu/

    NOTE: Linux clusters will not be affected (OSG, CLASSE, DSS, LIPID, KINGLAB, SDS, SSG, TARDIS, V4, WEBLAB, WALLER). Home directories housed on CAC storage will not be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, November 9th, 2011

    9/20/2011 11:40:00 AM

    48 Nodes added to the CAC's V4 cluster

    48 additional nodes have been added to the V4 standard queue. These nodes are identical to all other v4 nodes (8core/16gb RAM).

    9/14/2011 5:17:00 PM

    Today’s scheduled maintenance has been completed.

    Please report problems to help@cac.cornell.edu or http://www.cac.cornell.edu/help

    9/9/2011 2:06:00 PM

    DOWNTIME: Wednesday, September 14th, 2011 8am-5pm

    REASON: To install September 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (all sessions will be lost).
    • Linux clusters (OSG, CLASSE, KINGLAB, DSS, WEBLAB, WALLER): Running jobs will be lost.
    • Windows, Linux, and all virtual servers (CATSLOGINxx, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC0x, SEQPIPE, ZELLIG, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The SSG, LIPID, and TARDIS clusters and the SDS resource will not be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, October 12th, 2011

    8/26/2011 2:04:00 PM

    EMERGENCY MAINTENANCE: Monday, August 29th, 2011 8am-9am EDT

    REASON: Reassign storage to a new file server.

    WHO MAY BE AFFECTED? CAC users with home directories on CAC managed storage (storage01).

    WHAT SHOULD USERS EXPECT? We don’t anticipate any service interruptions but there is a slight chance that the storage moves will require a reboot of storage01. Users should save files frequently.

    STATUS: System status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    8/10/2011 4:42:00 PM

    The scheduled maintenance for August 10th, 2011 has been completed (except for Kinglab cluster

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    Today's maintenance work has been completed except the Kinglab cluster rebuild. CAC staff is working to bring Kinglab online as soon as possible.

    8/8/2011 10:48:00 AM

    DOWNTIME: Wednesday, August 10th, 2011 8am-5pm

    REASON: To install August 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, LIPID, DSS, WEBLAB, WALLER): A kernel patch will be applied to head nodes and compute nodes. Running jobs will be lost.
    • Windows, Linux, and all virtual servers (CATSLOGINxx, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC0x, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The SSG cluster and SDS resource will not be affected by this downtime.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, September 14th, 2011

    7/13/2011 1:33:00 PM

    The scheduled maintenance for July 13th, 2011 has been completed

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    7/8/2011 4:40:00 PM

    DOWNTIME: Wednesday, July 13th, 2011 8am-5pm

    REASON: To install June 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, LIPID, DSS, WEBLAB, WALLER, OSG): head nodes will be patched, no reboot will be required. Running jobs should not be lost.
    • Windows, Linux, and all virtual servers (CATSLOGINx, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC0x, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The SSG cluster and SDS resource will not be affected by this downtime.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, August 10th, 2011

    7/6/2011 1:36:00 PM

    NSUB problems resolved - July 6th, 1:15pm

    The previously reported problems with NSUB on V4 have been resolved. We are sorry for any inconvenience this may have caused.

    7/6/2011 12:39:00 PM

    Unplanned Outage

    Problems with nsub on V4

    CAC staff is investigating reported problems with NSUB failures and jobs being "deferred". We will post updates as we know more.

    6/22/2011 2:41:00 PM

    Network outage June 25th between 4am and 7am

    CIT will be performing network maintenance this Saturday between 4am and 7am. This work will affect CAC networks, specifically the network (128.84.3.x/24) which houses the v4 cluster, the CAC home directories, AMMA2, Arecibo servers and DDN, CATSLOGINn, Weblab, and more. Connectivity to resources on this network will be disrupted for approx. 30 minutes during the maintenance window.

    6/15/2011 4:58:00 PM

    The scheduled maintenance for June 15th, 2011 has been completed

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    6/10/2011 2:59:00 PM

    Announcements:

    /tmp cleanup policy revised: Beginning June 15, 2011, all files in /tmp on the compute nodes will be deleted prior to each job start.

    /v4scratch: All users now have a subdirectory under /v4scratch, which is accessible from all v4 linux nodes. Data will not be erased from these directories, but there is no backup for this file system. You should use /v4scratch when you have large amounts of data that are needed for multiple jobs. Instead of copying your data from your home directory to /tmp on the v4 linux nodes each time you run a job, you should copy the data once to /v4scratch and then copy the data from /v4scratch to /tmp when you run your jobs. /v4scratch can also be used when your job fills /tmp and you need a place to offload temporary files to free up disk space on /tmp while your job is running. Data transfer will be faster between /v4scratch and /tmp than between /home and /tmp and will have significantly less impact on other users. We strongly encourage you to run from /tmp, not from /v4scratch and definitely not from /home.

    6/10/2011 2:56:00 PM

    DOWNTIME: Wednesday, June 15th, 2011 8am-5pm

    REASON: To install June 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, LIPID, DSS, WEBLAB, WALLER, OSG): all compute nodes on all clusters will be rebooted to apply the security patches; all running jobs will be canceled.
    • Windows, Linux, and all virtual servers (CATSLOGINx, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC0x, etc).
    • Database servers (CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, SCIDATA1, etc).
    • http://www.cac.cornell.edu/

    NOTE: The SSG, SDS, and OSG clusters are not affected by this downtime.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, July 13th, 2011

    5/11/2011 4:34:00 PM

    The scheduled maintenance for May 11th, 2011 has been completed

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    5/6/2011 10:19:00 AM

    DOWNTIME: Wednesday, May 11th, 2011 8am-5pm

    REASON: To install May 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • CAC Storage Leases, OSG Storage Elements, and all user home directories and project directories will be unavailable during a portion of the downtime while we update the file servers (storage01, storage02, storage03, mccoy, xrootd01).
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, LIPID, DSS, WEBLAB, WALLER, OSG): all compute nodes on all clusters will be rebooted to remount the home directories; all running jobs will be canceled.
    • Windows, Linux, and all virtual servers (CATSLOGINx, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC0x, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The SSG cluster and SDS resource will not be affected as these servers does not connect to the CAC storage.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, June 15th, 2011

    4/13/2011 4:13:00 PM

    The scheduled maintenance for April 13th, 2011 has been completed

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    4/8/2011 2:19:00 PM

    DOWNTIME: Wednesday, April 13th, 2011 8am-5pm

    REASON: (1) To install April 2011 security patches (Windows and Linux), and (2) Network maintenance on the 128.84.3.0/24 subnet.

    • Connections to the V4, CLASSE, WALLER, and WEBLAB clusters and all other servers on the 128.84.3.0/24 subnet will be interrupted between 8am and 8:30am for the network maintenance.
    • Linux servers (PETIE, AMMA2, LM-R900, SYSRH5, CONSULTRH5, MONITOR, CUPS, RT, GRIDFTP1)
    • Virtual Servers (DAS, DSRG, PWSLINUX, PWSLINUX1, LINUXLOGIN2, LITTLEJOHN-PH, DC, CITRUS-GREENING, MYPROXY)
    • Windows servers (WINLOGIN, CATS cluster nodes and CATSLOGINn, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PWS, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The DSS, KINGLAB, LIPID, SSG, SDS, and TARDIS clusters will not be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, May 11th, 2011

    3/14/2011 12:21:00 PM

    The March 14th Emergency Maintenance is complete.

    3/13/2011 7:52:00 AM

    - Emergency Maintenance CAC DDN Storage Array - Monday, March 14th 10am -noon

    Emergency outage to repair hardware on the CAC’s DDN storage unit.

    WHO WILL BE AFFECTED? User home directories, project directories, CAC storage leases, OSG Storage Elements.

    WHAT WILL BE UNAVAILABLE? CAC Storage Leases, OSG Storage Elements, and all user home directories and project directories will be unavailable during most of the downtime while we repair the DDN unit. All users should log off and close files before the downtime begins to prevent losing any data.

    Note: The SSG and SDS resources will not be affected. The Arecibo DDN unit will not be affected.

    Send questions/comments to help@cac.cornell.edu

    3/9/2011 2:06:00 PM

    The scheduled maintenance for March 9th, 2011 has been completed

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    3/4/2011 3:57:00 PM

    DOWNTIME: Wednesday, March 9th, 2011 8am-5pm

    REASON: (1) To install March 2011 security patches (Windows and Linux), and (2) To update the CAC accounting software on V4.

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (all sessions will be lost).
    • CAC Home Directory Servers (storage01, storage02, and storage03) – the servers housing user’s home directories will be rebooted; users will not be able to access their home directories while the servers reboot.
    • Linux clusters (V4): unavailable while we install the new accounting software.
    • Windows servers (CATS cluster nodes and CATSLOGINn, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PWS, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The CLASSE, DSS, KINGLAB, LIPID, PETIE, SSG, SDS, TARDIS, WALLER, and WEBLAB clusters should not be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, April 13th, 2011

    WORKSHOP ANNOUNCEMENT: CAC will present 2-hour “Introduction to Using a CAC Linux Cluster” workshops on February 16 and March 31, 2011. Faculty, staff, students, and Corporate Program members are welcome. There is no fee to attend. Registration is required. Details, including registration, can be found at http://www.cac.cornell.edu/about/news/101202.aspx

    2/9/2011 4:27:00 PM

    All scheduled maintenance for Feb 9th, 2011 has been completed

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    2/3/2011 1:30:00 PM

    DOWNTIME: Wednesday, February 9th, 2011 8am-5pm

    REASON: To install February 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (all sessions will be lost).
    • Linux clusters (V4, CLASSE, TARDIS, KINGLAB, LIPID, DSS, WALLER): head nodes AND cluster nodes will be patched and rebooted; all running jobs will be cancelled.
    • Windows and Linux servers (MCCOY, CATS cluster nodes and CATSLOGINn, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC01, etc).
    • WEBLAB(Hadoop) –all nodes will be patched and rebooted, all running jobs will be lost.
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/
    • NOTE: The SSG and SDS resources will not be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, March 9th, 2011

    WORKSHOP ANNOUNCEMENT: CAC will present 2-hour “Introduction to Using a CAC Linux Cluster” workshops on February 16 and March 31, 2011. Faculty, staff, students, and Corporate Program members are welcome. There is no fee to attend. Registration is required. Details, including registration, can be found at http://www.cac.cornell.edu/about/news/101202.aspx

    1/12/2011 1:48:00 PM

    All scheduled maintenance for Jan 12th, 2011 has been completed.

    Please report problems to www.cac.cornell.edu/help or help@cac.cornell.edu

    1/10/2011 11:55:00 AM

    DOWNTIME: Wednesday, January 12th, 2011 8am-5pm

    REASON: To install January 2011 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (all sessions will be lost).
    • Linux clusters (V4, CLASSE, TARDIS, KINGLAB, LIPID, DSS, WALLER): head nodes on these clusters will be patched and rebooted; all running jobs should be unaffected.
    • Windows and Linux servers (MCCOY, CATSLOGIN, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC01, etc).
    • WEBLAB(Hadoop) –all nodes will be patched and rebooted, all running jobs will be lost.
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/
    • NOTE: The SSG and SDS resources will not be affected.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, February 9th, 2011

    WORKSHOP ANNOUNCEMENT: CAC will present 2-hour “Introduction to Using a CAC Linux Cluster” workshops on February 16 and March 31, 2011. Faculty, staff, students, and Corporate Program members are welcome. There is no fee to attend. Registration is required. Details, including registration, can be found at http://www.cac.cornell.edu/about/news/101202.aspx

    1/9/2011 2:43:00 AM

    Jan 8th and 9th Maintenance Completed.

    The next scheduled maintenance is this Wednesday, Jan 12th, 2011 to apply security patches. Please submit questions to help@cac.cornell.edu or www.cac.cornell.edu/help.

    1/9/2011 1:42:00 AM

    Maintenance in progress.

    Maintenance scheduled for Jan 8 and 9 is in progress. Access to many CAC home directories is not available at this time.

    1/4/2011 11:46:00 AM

    EMERGENCY OUTAGE: Saturday, Jan 8th, 2011 8pm – Sunday, Jan 9th, 2011 8am

    REASONS: please see the CIT bulletin

    WHO WILL BE AFFECTED? Users of CAC managed resources

    WHAT WILL BE UNAVAILABLE? Users will be unable to connect to any CAC managed resources during the outage

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, January 12th, 2011

    12/23/2010 10:55:00 AM

    CAC Winter Break Schedule & Updates

    Winter Break Schedule: CAC will observe Cornell’s winter break from 5 p.m. on Thursday, December 23, 2010, through 8 a.m. on Monday, January 3, 2011. The status of all resources will be monitored during the break. Please submit any questions you may have via the helpdesk. CAC staff will periodically monitor the consulting system throughout the holiday period and answer critical user questions. Non-critical questions will be addressed beginning Monday, 3 January 2011.

    Power Outage January 8-9, 2011: Rhodes UPS Maintenance will occur on January 8-9, 2011. This activity will affect all CAC managed hardware in the Rhodes server farm. We will send more detailed information and timing early that week.

    Interested in applying for a TeraGrid allocation? Please see complete information, including a proposal guideline telecon (January 3) and deadlines (January 15). In particular, those of you interested in the resources at TACC may access consulting services directly from CAC. We can also help guide you through the allocation process. If you’re interested in exploring other possibilities, please see Bridging to National Cyberinfrastructure.

    12/15/2010 4:35:00 PM

    All of the work scheduled for Dec 15th has been completed.

    Please report any problems to www.cac.cornell.edu/help.

    12/6/2010 1:35:00 PM

    DOWNTIME: Wednesday, December 15th, 2010 8am-5pm

    REASONS: (1) To install December 2010 security patches (Windows and Linux), and (2) To replace a failed controller on the DDN storage.

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • CAC Storage Leases, OSG Storage Elements, and all user home directories and project directories will be unavailable during most of the downtime while we replace the DDN controller. All users should log off and close files before the downtime begins to prevent losing any data.
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, LIPID, DSS, WEBLAB(Hadoop)): all compute nodes on all clusters will be rebooted to remount the home directories; all running jobs will be canceled.
    • Windows and Linux servers (MCCOY, CATSLOGIN, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC01, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The SSG cluster and SDS resource will not be affected. These servers does not connect to the CAC storage.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, January 12th, 2011

    12/6/2010 4:17:00 PM

    The problem has been resolved. All systems have been returned to service.

    12/6/2010 2:39:00 PM

    We are experiencing intermittent network outages to CAC managed clusters and servers. The problem is under investigation.

    12/2/2010 4:07:00 PM

    Status update: CAC managed storage, clusters, and servers are mostly back online.

    The CAC managed storage, including all storage leases and users' home directories are back on-line, along with most of the CAC managed clusters, compute nodes, and servers.

    The CAC managed storage, including all storage leases and users' home directories are back on-line, along with most of the CAC managed clusters, compute nodes, and servers.

    CAC staff continues to work on the problems caused by the power outage. Several cluster nodes remain down. These will be brought back one by one as they are diagnosed and repaired.

    The SSG cluster remains down at this time.

    Please report any issues to www.cac.cornell.edu/help

    12/2/2010 7:27:00 AM

    UNPLANNED OUTAGE: CAC Storage (including all user's home directories)

    The CAC DDN storage suffered a catastrophic failure as a result of last night's power outage. All CAC leased storage and CAC user's home directories are unavailable at this time. We have notified DDN for maintenance. We will post more information when we have any.

    12/1/2010 10:36:00 PM

    12.1.2010 10:30pm - Unplanned Power Outage in Rhodes Hall

    Power is out to part of campus, including Rhodes Hall. This is affecting all CAC managed clusters and servers. We will post more information as soon as we can.

    11/10/2010 5:28:00 PM

    November 10th, 2010 scheduled work has been completed.

    Please report any problems to www.cac.cornell.edu/help.

    11/5/2010 11:03:00 AM

    Monthly Downtime Announcement

    DOWNTIME: Wednesday, November 10th, 2010 8am-5pm To install security patches and install Infiniband switch for accessing CAC storage.

    DOWNTIME: Wednesday, November 10th, 2010 8am-5pm

    REASONS: (1) To install November 2010 security patches (Windows), and (2) To install an Infiniband switch between the file servers and the DDN storage controllers.

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

  • CAC Storage Leases, OSG Storage Elements, and all user home directories and project directories will be unavailable during most of the downtime while we install and connect to the Infiniband switch. The addition of the switch will allow CAC to add file servers on demand. All users should log off and close files before the downtime begins to prevent losing any data.
  • LOGIN servers (all sessions will be lost).
  • Linux clusters (V4, WALLER, CLASSE, TARDIS, KINGLAB, LIPID, DSS, WEBLAB(Hadoop)): all compute nodes on all clusters will be rebooted to remount the home directories; all running jobs will be canceled.
  • Windows and Linux servers (MCCOY, CATSLOGIN, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUXxx, LINUXSVC01, etc).
  • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
  • http://www.cac.cornell.edu/
  • NOTE: The SSG cluster and SDS server will not be affected. These servers do not connect to the CAC storage.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, December 15th, 2010

    10/13/2010 4:15:00 PM

    October 2010 downtime work is complete.

    Today's planned patching has been completed.

    *** TODAY'S DOWNTIME, 10/13/10, IS COMPLETE, Please submit any problems or questions to http://www.cac.cornell.edu/help ***

    10/8/2010 11:50:00 AM

    DOWNTIME: Wednesday, October 13th, 2010 8am-5pm

    REASONS: (1) To install October 2010 security patches (Windows and Linux), and (2) To install an Infiniband switch between the file servers and the DDN storage controllers. Update: item(2) has been moved to next month.

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • Update: This item has been moved to next month.
      CAC Storage Leases, OSG Storage Elements,and all user home directories and project directories will be unavailable during most of the downtime while we install and connect to the Infiniband switch. The addition of the switch will allow CAC to add file servers as required. All users should log off and close files before the downtime begins to prevent losing any data.
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, LIPID, DSS, WEBLAB(Hadoop)): all compute nodes on all clusters will be rebooted to deploy the security kernel patches; all running jobs will be canceled.
    • Windows and Linux servers (MCCOY, CATSLOGIN, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC01, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/

    NOTE: The SSG cluster will not be affected. This cluster was patched last week and does not connect to the CAC storage.

    STATUS: Downtime status will be posted.

    QUESTIONS: http://www.cac.cornell.edu/help/

    NEXT SCHEDULED DOWNTIME: Wednesday, November 10th, 2010

    9/15/2010 5:20:00 PM

    September 2010 server patching and maintenance is complete.

    The work for this month's downtime has been completed. Please report problems to help@cac.cornell.edu or www.cac.cornell.edu/help

    9/15/2010 12:00:00 AM

    DOWNTIME: Wednesday, Sept 15th, 2010 8am – Friday, Sept 17th, 2010 5pm (we anticipate services will return within 24 hours but we are reserving the total time as a precaution)

    REASONS: (1) To perform maintenance on the CAC DDN storage device and (2) To install September 2010 security patches (Windows and Linux).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • CAC Storage Leases, OSG Storage Elements, and ALL USER HOME DIRECTORIES and project directories will be unavailable while we perform maintenance on the DDN file systems. **All users should log off and close files before the downtime begins to prevent losing any data**.
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); all jobs writing to the home directories housed on CAC fileservers will be affected.
    • Windows and Linux servers (MCCOY, CATSLOGIN, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC01, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages

    STATUS: Downtime status will be posted

    QUESTIONS

    NEXT Scheduled DOWNTIME: Wednesday, October 13th, 2010

    9/15/2010 12:46:00 PM

    Monthly Downtime in progress today, Wed. Sept 15th

    CAC staff is applying monthly security patches to CAC managed clusters and servers. This includes the storage that houses users home directories. We will post another status message when the maintenance is complete.

    8/24/2010 3:57:00 PM

    RESOLVED: slow response on CAC managed clusters

    Response time has returned to normal on CAC managed clusters. Please remember that these clusters use a common home directory system. High I/O traffic to the home directories will hinder response time. Please use /tmp for your job I/O and write your data back to your home directory periodically during your job runs. This will help to maintain decent response for everyone.

    8/24/2010 12:09:00 PM

    slow response on CAC managed clusters

    We are currently investigating the cause of the current sluggish response on CAC managed clusters (V4, TUC, Tardis, Kinglab, PETIE, etc).

    8/6/2010 1:42:00 PM

    DOWNTIME: DOWNTIME: Wednesday, August 11th , 2010 8am-5pm

    REASONS: (1) To install August 2010 security patches (Windows and Linux), and (2) To increase the /opt partition on the v4 compute nodes to create room for additional third-party software package installations.

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • LOGIN servers (Winlogin.cac.cornell.edu and Linuxlogin.cac.cornell.edu) all sessions will be lost
    • V4 cluster: ALL running jobs will be canceled to rebuild the compute nodes with a larger /opt partition
    • Windows and Linux servers (CATSLOGINn, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, etc)
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc)
    • Web pages
    7/15/2010 11:51:00 AM

    RESOLVED: Interactive Jobs are working correctly again.

    We have resolved the problem with interactive jobs. Thank you for reporting the errors and thanks again for your patience.

    7/15/2010 10:40:00 AM

    Outage: Interactive jobs are not working

    We are working on this and will update the status as soon as it is resolved. We apologize for the inconvenience.

    7/14/2010 9:15:00 PM

    Donwtime complete.

    Downtime is now complete, with all systems updated and back in production. Configuring and testing the new scheduler took longer than anticipated; our apologies for the delay.

    7/9/2010 4:05:00 AM

    DOWNTIME: Wednesday, July 14th, 2010 8am-5pm

    REASONS: (1) To install July 2010 security patches (Windows and Linux), and (2) To upgrade the controllers on the CAC DDN storage device.

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?Updates will be applied affecting the following:

    • CAC Storage Leases, OSG Storage Elements, and all user home directories and project directories will be unavailable during most of the downtime while we update the controllers on the storage device. The upgrade will DOUBLE the network performance on the device.
      All users should log off and close files before the downtime begins to prevent losing any data.
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); all jobs writing to the home directories housed on CAC fileservers will be affected.
    • Windows and Linux servers (MCCOY, CATSLOGIN, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC01, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/
    7/9/2010 3:57:00 AM

    Scheduler and software will be updated July 14, 2010

    The scheduler will be upgraded to a newer, different scheduler called Maui that has almost exactly the same features. The nsub, mjobctl, showq, and other commands should all work the same. CAC has used this scheduler on clusters other than V4 for some time and have tested the configuration we run on V4. Consultants will be on-hand after downtime to address any difficulties with the upgrade. Online documentation will reflect the upgraded scheduler before July 14.

    The latest MATLAB, R2010a, has been installed as the default "matlab" on the v4 login nodes, and its runtimes are available on the compute nodes. You can still access the previous MATLAB and related tools by typing "r2007b" after their names, e.g., "matlabr2007b".

    The Intel Compiler Suite Professional Edition 11.1 has been installed on the v4 login nodes, and its runtimes are available on the compute nodes. On July 14, this will become the default version for all Intel software, including ifort, icc, MKL, etc. Dynamically-linked codes may need to be recompiled unless a setup file is run first. For details on testing the 11.1 compilers and libraries prior to the switchover, please refer to Compiling and Linking Codes documentation.

    5/6/2010 4:32:00 PM

    DOWNTIME: Wednesday, May 12, 2010 8am-5pm

    REASONS: To install May 2010 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • LOGIN servers (Winlogin.cac.cornell.edu and Linuxlogin.cac.cornell.edu) all sessions will be lost, running jobs should not be affected.
    • Windows and Linux servers (MCCOY, CATSLOGINn, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, etc).
    • SSG cluster: bios updates and security patches
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .
    3/5/2010 2:20:00 PM

    DOWNTIME: Wednesday, March 10, 2010 8am-5pm

    REASONS: (1) To install March 2010 security patches (Windows and Linux), and (2) To upgrade the OS on storage01 (CAC home directory server).

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • File Storage, including user home directories, will be unavailable during most of the downtime because we are updating the home directory server.
      **All users should log off and close files before the downtime begins.
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (CLASSE, TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); jobs writing to the home directories housed on CAC fileservers will be affected.
    • Windows cluster nodes (WINHPCnn).
    • Windows and Linux servers (MCCOY, CATSLOGIN, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, LINUXSVC01, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • http://www.cac.cornell.edu/
    2/5/2010 11:00:00 AM

    DOWNTIME: Wednesday, February 10th, 2010 8am-5pm

    REASON: To install February 2010 security patches (Windows and Linux)

    Please also see news announcements below

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (winlogin and linuxlogin, all sessions will be lost).
    • Windows cluster nodes (WINHPCnn, TUCnnn), running jobs will be canceled.
    • ALL CBSU cluster nodes.
    • Windows and Linux servers (MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, SCHEDULER, WEBLAB, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .

    Seminar 2/26/2010: As part of the Cornell Center for Advanced Computing (CAC) Seminar Series, the CAC will be hosting Using Subversion RCS for Collaborative Code Development presented by Dr. Steven Lantz, February 26th, at noon in 655 Rhodes. RSVP required. For details see http://www.cac.cornell.edu/about/news/012710.aspx.

    1/22/2010 9:17:00 AM

    Out-of-band Microsoft Patch applied to Winlogin.cac.cornell.edu - 1/22/2010

    MS10-002, the emergency security patch for Windows Internet Explorer, was applied to winlogin.cac.cornell.edu on Jan 22, 2010. As a result, all existing sessions were logged off and the machine was rebooted.

    1/8/2010 11:00:00 AM

    DOWNTIME: Wednesday, January 13, 2010 8am-5pm

    REASON: To install January 2010 security patches (Windows and Linux)

    ** Please also see news announcements below **

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    • LOGIN servers (winlogin and linuxlogin, all sessions will be lost).
    • Windows cluster nodes (WINHPCnn, TUCnnn), running jobs will be canceled.
    • Windows and Linux servers (MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, SCHEDULER, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .

    Other News from the CAC: Two new commands have been installed on linuxlogin. They were added in response to your requests. We welcome feedback on improving system usability.
    showqlease summary information on the availability of queues and leases
    showbalance remaining compute time balance

    Seminar 1/28/2010: As part of the Cornell Center for Advanced Computing (CAC) Seminar Series, CAC will be hosting a Dell/VMware Virtual Desktop and Disaster Recovery Seminar with live demonstrations for New York State regional information technology professionals from academe and industry on Thursday, January 28 in room G10 of the Cornell University Biotechnology Building, Ithaca, NY. For more information see http://www.cac.cornell.edu/about/news/122209.aspx

    12/17/2009 3:20:00 PM

    Re: CAC Winter Break Schedule

    CAC will observe the Cornell University winter break starting 24 December 2009, returning on Monday, 4 January 2010.

    The operating status of all CAC resources will be monitored as usual during this period.

    CAC staff will periodically monitor consulting questions throughout the holiday period. Critical user questions will be answered; non-critical user questions will be addressed beginning Monday, 4 January 2010.

    Please submit any questions you may have via the help system: http://www.cac.cornell.edu/help/ .

    Happy Holidays
    Cornell Center for Advanced Computing

    12/15/2009 8:15:00 AM

    DOWNTIME: Wednesday December 16 8 AM through Thursday December 17 5 PM

    REASON: New services for job submission and control will be installed and tested.

    WHAT WILL BE UNAVAILABLE? MATLAB on the TeraGrid

    DETAILS: The web services that enable job submission will be installed. We will be replace the authentication mechanism, requiring a total service shutdown, and which will break existing clients. On Thursday, after testing has been completed and the new service and client has been internally validated, we will send a new client (Littlejohn-0.2.0) to all current users. At that point please upgrade your system with the 0.2.0 client to resume work on the MATLAB on the TeraGrid resource.

    We apologize for the inconvenience. Please let us know of any problems you have during or after upgrading your client.

    12/4/2009 8:50:00 AM

    DOWNTIME: Wednesday, December 9, 2009 8am-5pm

    REASON: To install December 2009 security patches (Windows and Linux)

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • LOGIN servers (winlogin and linuxlogin, all sessions will be lost).
    • Linux clusters - head nodes and cluster nodes (V4, TARDIS, KINGLAB, DSS, WALLER); running jobs will be canceled.
    • Windows cluster nodes (WINHPCnn, TUCnnn), running jobs will be canceled.
    • Windows and Linux servers (MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .
    11/9/2009 10:00:00 AM

    DOWNTIME: Wednesday, Nov. 11th, 2009 8am-5pm

    REASON: To install November 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • LOGIN servers (all sessions will be lost).
    • Windows cluster nodes (WINHPCnn, TUCnnn).
    • Windows and Linux servers (CATSLOGIN, CATSFILES, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .
    10/8/2009 4:14:00 AM

    DOWNTIME: Wednesday, Oct 14, 2009 8am-5pm

    REASONS:
    1. To install October 2009 security patches (Windows and Linux)
    2. To upgrade the scheduling software on V4
    3. To move all users home directories to the CAC storage farm

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • File Storage, including user home directories, will be unavailable during most of the downtime because we are moving users home directories.
      **All users should log off and close files before the downtime begins.
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); jobs writing to the home directories housed on CAC fileservers will be affected.
    • Windows cluster nodes (WINHPCnn, TUCnnn).
    • Windows and Linux servers (CATSLOGIN, CATSFILES, MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/

    WHAT WILL YOU NEED TO DO AFTER THE DOWNTIME?

    • Linux users: Continue to use ~ for your home directory.
    • Windows users:
      • H: will be mapped to your new home directory during the downtime.
      • If you have any scripts or code that use pathnames, update them as follows:
        • Old UNC: \\cacfs01.cac.cornell.edu\<username>
        • New UNC: \\storage01.cac.cornell.edu\<username>
    9/4/2009 10:23:00 AM

    DOWNTIME: Wednesday, September 9, 2009 8am-5pm

    REASON: To install September 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • File Storage, including user home directories, will be unavailable during the downtime.
      ** All users should log off and close files before the downtime begins.
    • LOGIN servers (all sessions will be lost).
    • Linux clusters (TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); jobs writing to the home directories housed on CAC fileservers will be affected.
    • Windows cluster nodes (CATSnn, WINHPCnn, TUCnnn).
    • Windows and Linux servers (MASSTOR, CBSUSRVxx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWS, PWSLINUX, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .
    8/6/2009 12:00:00 AM

    DOWNTIME: Wednesday, August 12, 2009 8am-5pm

    REASON: To install August 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE? Updates will be applied affecting the following:

    • File Storage, including user home directories, will be unavailable during the downtime.
    • All users should log off and close files before the downtime begins.
    • LOGIN servers (all sessions will be lost).
    • Managed Linux clusters (TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); any jobs writing to the home directories housed on CAC fileservers will be affected.
    • Managed Windows cluster nodes (CATSnn, WINHPCnn, TUCnnn).
    • Managed Windows and Linux servers (MASSTOR, CBSUSRVx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWSLINUX, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .
    7/10/2009 12:00:00 AM

    DOWNTIME: Wednesday, July 15, 2009 8am-5pm

    REASON: To install July 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED?
    Users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE?
    Updates will be applied affecting the following:

    • User’s home directories on CACFS01 and CACFS02 will be unavailable between 8am and 9am.
    • User’s home directories on the DDN storage will be unavailable between 9am and 4pm.
    • DDN Storage Users should unmount their DDN file systems prior to the downtime.
    • LOGIN servers (all sessions will be lost).
    • Managed Linux clusters (TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); any jobs writing to the home directories housed on CAC fileservers will be affected.
    • Managed Windows cluster nodes (CATSnn, WINHPCnn, TUCnnn).
    • Managed Windows and Linux servers (MASSTOR, CBSUSRVx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWSLINUX, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .
    6/7/2009 4:19:00 PM

    Campus-wide power outage Saturday, June 6, 9:25pm

    There was an unplanned campus-wide power outage at approximately 9:25pm Saturday, June 6, 2009. This outage caused many CAC managed Linux and Windows servers to experience brief interruptions while they rebooted. All services are back online. Please, as always, report any problems to help@cac.cornell.edu.

    6/5/2009 3:35:00 AM

    DOWNTIME: Wednesday, June 10th, 2009 8am-5pm

    REASON: To install June 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED?

    • All users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    Updates will be applied affecting the following (8am-5pm):

    • ALL running jobs on the V4 clusters will be lost
    • CAC file servers (home directories will be unavailable)
    • LOGIN servers (all sessions will be lost)
    • Managed Linux clusters (TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); any jobs writing to the home directories will be affected
    • Managed Windows cluster nodes (CATSnn, CBSUMn, WINHPCnn)
    • Managed Windows and Linux servers (MASSTOR, CBSUSRVx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWSLINUX, etc)
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc)
    • Web pages: http://www.cac.cornell.edu/

    CAC Resource status can be found at: http://www.cac.cornell.edu/datafeed/status.aspx

    5/15/2009 10:33:00 AM

    DOWNTIME: Sunday, May 17th, 2009 6-7am

    REASON: Cornell Information Technologies will be upgrading Ethernet switches in the server room.

    WHO WILL BE AFFECTED? All users of CAC managed resources housed in Rhodes Hall.

    WHAT WILL BE UNAVAILABLE? All remote connections to servers in the machine room will be disconnected. This includes SSH and Remote Desktop connections to the login nodes and any other servers that may allow remote connections. Running jobs will not be affected.

    CAC Resource status can be found at: http://www.cac.cornell.edu/datafeed/status.aspx

    5/14/2009 4:06:00 PM

    CAC Scheduler back in service.

    The patches have been applied successfully. Batch Jobs are being accepted at this time.

    5/14/2009 12:46:00 PM

    Brief scheduler downtime today

    The scheduler will be paused on May 14 from 2:30-4:00pm to install patches. Running jobs will not be affected.

    5/11/2009 12:11:00 PM

    DOWNTIME: Wednesday, May 13th, 2009 8am-5pm

    REASON: To install May 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED?

    • All users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    Updates will be applied affecting the following (8am-5pm):

    • ALL running jobs on the V4 clusters will be lost
    • CAC file servers (home directories will be unavailable)
    • LOGIN servers (all sessions will be lost)
    • Managed Linux clusters (TARDIS, KINGLAB, DSS, WEBLAB(Hadoop)); any jobs writing to the home directories will be affected
    • Managed Windows cluster nodes (CATSnn, CBSUMn, WINHPCnn)
    • Managed Windows and Linux servers (MASSTOR, CBSUSRVx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWSLINUX, etc)
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc)
    • Web pages: http://www.cac.cornell.edu/

    CAC Resource status can be found at: http://www.cac.cornell.edu/datafeed/status.aspx

    4/30/2009 2:30:00 PM

    CAC System Status

    All systems have been returned to full service, including the linux login node (linuxlogin3.cac.cornell.edu) and batch job submission. Please let us know if you have any questions or problems.

    4/28/2009 8:52:00 AM

    Linux Login node is unavailable

    linuxlogin3, the linux login node, is unavailable. We are working to resolve the problem as soon as possible.

    4/24/2009 3:44:00 PM

    Downtime Update

    CAC Power and file system problems resolved

    Details:

    During Project Design and Construction's (PDC) monthly generator test in Rhodes Hall this morning, the wrong switch was accidentally turned off in the switchgear, affecting normal power in part of Rhodes Hall. As a result, some of the machines rebooted. This also resulted in the file system experiencing switch problems. These problems have now been resolved.

    We will work with PDC to ensure that this does not happen again. We are sorry for any trouble or inconvenience this has caused.

    Cornell Center for Advanced Computing
    help@cac.cornell.edu

    4/24/2009 9:09:00 AM

    Unexpected downtime

    REASON: Generator test

    An uncontrolled shutdown of most systems occurred due to a generator test that did not progress as expected. All systems are expected to be back in normal operation by 11am.

    4/10/2009 3:45:00 PM

    DOWNTIME: Wednesday, April 15th, 2009 8am-5pm

    REASON: To install April 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED?

    • All users of CAC managed resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    Updates will be applied to the CAC file servers (cacfs01, cacfs02) affecting the following (8am-5pm)

    • ALL running jobs on all clusters (V4, DSS, WALLER, KINGLAB, WEBLAB(hadoop) and TARDIS) will be canceled.
    • User’s home directories will be unavailable

    After the file servers are completed, there will be brief interruptions while these servers are patched and rebooted (10am-5pm):

    • Windows LOGIN servers (all sessions will be lost).
    • Windows batch cluster nodes (v3, development). ALL running jobs on v3 and development will be cancelled.
    • Managed Windows cluster nodes (CATSnn, CBSUMn, WINHPCnn).
    • Managed Windows and Linux servers (MASSTOR, CBSUSRVx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, PWSLINUX, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/ .

    CAC Resource status can be found at: http://www.cac.cornell.edu/datafeed/status.aspx

    3/19/2009 9:32:00 AM

    OUTAGE: Thursday, March 19th, 2009 10-11am

    REASON: To upgrade Moab from 5.2.2 to 5.3.

    WHO WILL BE AFFECTED?

    • All users who submit jobs using the Moab scheduler
      • Job submissions to V4, V4DEV, and V4-64G will be unavailable.
      • Anyone who has a running job during this time should check that it checkpointed properly.
    3/6/2009 9:10:00 AM

    DOWNTIME: Wednesday, March 11, 2009 8am-5pm

    REASON: To install March 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED?

    • All users who use CAC managed resources housed in Rhodes Hall, except for the following Linux clusters: USDA, Waller (Arecibo), Tardis, WebLab Hadoop, DSS, and Kinglab.

    WHAT WILL BE UNAVAILABLE?

    • Extended outages between 8am-5pm while configurations are modified:
      • Moab Scheduler for V4 and V4DEV jobs will be paused.
      • V4 Compute Nodes. All running jobs on V4 and V4DEV will be cancelled.

    • Brief interruptions between 8am-noon while servers are patched and rebooted:
      • Windows LOGIN servers (all sessions will be lost).
      • Windows batch cluster nodes (v3, development). ALL running jobs on v3 and development will be cancelled.
      • Managed Windows cluster nodes (CATSnn, CBSUMn).
      • Managed Windows and Linux servers (CBSUSRVx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, etc).
      • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
      • Web pages: http://www.cac.cornell.edu/

    CAC Resource status can be found at http://www.cac.cornell.edu/datafeed/status.aspx

    2/10/2009 11:41:00 AM

    DOWNTIME: Sunday, February 15th, 2009 6-8am

    REASON: Cornell Information Technologies will upgrade network architecture to include redundant routers and more bandwidth capacity.

    WHO WILL BE AFFECTED?

    • All CAC managed servers in the 757 Rhodes Machine room.
    • All CAC managed machines will experience network outages.
    • All active connections to login nodes will be disconnected.

    Note: This list pertains only to CAC resources. For a complete list, please see http://www.cit.cornell.edu/computer/news/articles.html#feb15down

    2/6/2009 3:50:00 PM

    DOWNTIME: Wednesday, February 11th,2009 8am-5pm

    REASON: To install February 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? All users who use CAC managed resources housed in Rhodes Hall, except for the following Linux clusters: USDA, Waller (Arecibo), Tardis, and Kinglab.

    WHAT WILL BE UNAVAILABLE?

    Extended outages between 8am-5pm while configurations are modified:

    • Moab Scheduler for V4 and V4DEV jobs will be paused.
    • V4 Compute Nodes. All running jobs on V4 and V4DEV will be cancelled.
    • DSS cluster (networking maintenance and new nodes brought online).
    • WEBLAB (HADOOP) cluster (configuration modifications).

    Brief interruptions between 8am-noon while servers are patched and rebooted:

    • Windows LOGIN servers (all sessions will be lost).
    • Windows batch cluster nodes (v3, development). ALL running jobs on v3 and development will be cancelled.
    • Managed Windows cluster nodes (CATSnn, CBSUMn).
    • Managed Windows and Linux servers (CBSUSRVx, CBSUFTP, ARECIBOWEB, ARECIBOFS, PETIE, etc).
    • Database servers (SCIDATA1, CTCSQL, SQLSRV02, ARECIBOSQL, CBSUSQLX, etc).
    • Web pages: http://www.cac.cornell.edu/

    CAC Resource status can be found at http://www.cac.cornell.edu/datafeed/status.aspx

    1/9/2009 2:15:00 PM

    DOWNTIME: Wednesday, January 14th, 9am-5pm

    REASON: To install January 2009 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? All users who use CAC managed resources housed in Rhodes Hall, except for the following Linux clusters: v4, USDA, Waller, Weblab (hadoop), Tardis, and Kinglab.

    WHAT WILL BE UNAVAILABLE?
    NOTE: Most will see brief interruptions while servers are rebooted.

    • ALL Windows LOGIN servers (all sessions will be lost)
    • ALL Windows batch cluster nodes (v3, development). ALL running jobs on these nodes will be cancelled.
    • ALL managed servers and Windows clusters (CBSUMn, CBSUFSRV1, CBSUSRVnn, CATSnn, ARECIBO, PETIE, etc)
    • ALL Web pages will be unavailable: http://www.cac.cornell.edu/
    • ALL Database servers (ctcsql, sqlsrv02, etc)
    • Moab Scheduler for v4 and v4dev jobs (current running jobs on v4 and v4dev will not be affected)

    CAC Resource status can be found at http://www.cac.cornell.edu/datafeed/status.aspx

    11/11/2008 2:16:00 PM

    DOWNTIME: Wednesday, November 12th, 8am-5pm

    REASON: To install November 2008 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? All users who use CAC managed resources housed in Rhodes Hall, except for the following clusters: v4, USDA, Waller, Weblab (hadoop), and Kinglab.

    WHAT WILL BE UNAVAILABLE?

    • ALL Windows LOGIN servers (all sessions will be lost)
    • ALL Windows batch cluster nodes (v3, development, cbsu1, cbsu2). ALL running batch jobs on these nodes will be cancelled
    • ALL managed servers (CBSUFSRV1, CBSUSRVnn, SCIDATAn, CATSnn, PETIE, ARECIBO, DSSLINUXn, etc)
    • ALL Web pages will be unavailable
    • ALL Database servers (ctcsql, etc)
    • Moab Scheduler for v4 and v4dev jobs (running jobs on v4 and v4dev will not be affected)

    CAC Resource status can be found at http://www.cac.cornell.edu/datafeed/status.aspx

    10/14/2008 10:30:00 AM

    DOWNTIME: Wednesday, October 15th, 8am-5pm

    REASON: To install October 2008 security patches (Windows and Linux)

    WHO WILL BE AFFECTED? All users who use CAC managed resources housed in Rhodes Hall, except for the following clusters: v4, USDA, waller, and kinglab.

    WHAT WILL BE UNAVAILABLE?

    • ALL Windows LOGIN servers (all sessions will be lost)
    • ALL Windows batch cluster nodes (v3, development, cbsu1, cbsu2). ALL running batch jobs on these nodes will be cancelled.
    • ALL managed servers (CBSUFSRV1, CBSUSRVnn, SCIDATAn, CATSnn, WEBLAB (hadoop), ARECIBO, DSSLINUXn, etc)
    • ALL Web pages will be unavailable: http://www.cac.cornell.edu/
    • ALL Database servers (ctcsql, etc)
    9/16/2008 1:53:00 AM

    CAC Fileservers and batch queue will be removed from service

    To Current CAC Researchers:

    v3linux will be removed from service on September 17. If you are using this resource, please move your jobs to v4 now so your production computing can continue without disruption.

    To Former CTC Researchers:

    All old (formerly CTC) accounts will be deleted as of October 1st. In order to continue to use CAC resources you will need to be added to a faculty sponsored project. Project information is listed here: http://www.cac.cornell.edu/services/projects.aspx

    To Both Groups:

    After October 1, 2008, we will no longer be able to recover files from the old CAC fileservers (ctcfsrv6 through ctcfsrv13). The fileservers will be reformatted. Therefore, after 10/1, there will be no way to get any files from these machines or from backup. Please contact help if you have any questions about recovering or moving your files.

    9/8/2008 2:33:00 PM

    CAC Computing Update

    Resource and fileserver update.

    New computing resource - v4

    A new computing resource will be available on September 10, 2008. v4 has 1024 cores (128 servers, each with 2 quad-cores/server), 2.5 GHz Intel Xeon, and 16GB RAM/server. It is running Red Hat Enterprise Linux Server release 5.1. There will be a charge for using the v4 compute nodes. v4 nodes are accessed using the Moab scheduler.

    Login node name: linuxlogin3
    Batch queue names:
    v4 (up to 128 servers)
    v4dev (up to 2 servers, 1 hour time limit)
    v4-64g (4 servers with 64GB RAM/server)


    Batch documentation
    Software
    CAC Resources

    Training on v4 September 11 & 12

    From noon until 1pm on Thursday September 11 and Friday September 12, we will hold training sessions on using Moab to compute on the v4 nodes. The sessions will include a demo, a review of the available documentation, and time to try the scheduler with help from CAC consultants. Join us in room 514 Rhodes Hall. Bring your laptop if you have one. Registration is not necessary.

    v3linux will be removed from service on September 17

    This will allow current users one week to migrate to the new v4 resource. Please make use of the transition time to move to v4 as soon as possible so your production computing can continue without disruption. The v3 Windows queue will continue to be available without charge for the short term; soon it too will be moved to the Moab scheduler, and the operating system will be updated to Windows server 2008 x64.

    Fileserver update

    After October 1, 2008, we will no longer be able to recover files from the old CAC fileservers (ctcfsrv6 through ctcfsrv13). Please contact help@cac.cornell.edu if you have any questions.

    9/8/2008 2:25:00 PM

    DOWNTIME: Wednesday, September 10th, 8am-5pm

    REASON: To add the NEW v4 computing resource to production and to install September 2008 security patches (Linux and Windows)

    WHO WILL BE AFFECTED? All users who use CAC, CBSU, WEBLAB, ARECIBO, DSS, ADMM and USDA resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    • ALL LOGIN servers (all sessions will be lost)
    • ALL batch cluster nodes (v3, development, v3Linux, v3linuxdev, admm, cbsu1, cbsu2, x64test, all running jobs will be cancelled).
    • ALL managed servers
    • ALL Web pages will be unavailable: http://www.cac.cornell.edu/
    • ALL Fileservers containing home directories
    • ALL Database servers
    8/11/2008 1:40:00 PM

    DOWNTIME: Wednesday, August 13th, 8am-5pm

    REASON: To install August 2008 security patches (Linux and Windows)

    WHO WILL BE AFFECTED? All users who use CAC, CBSU, WEBLAB, ARECIBO, DSS, ADMM and USDA resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    • ALL LOGIN servers (all sessions will be lost)
    • ALL batch cluster nodes (v3, development, v3Linux, v3linuxdev, admm, cbsu1, cbsu2, x64test, all running jobs will be cancelled).
    • ALL managed servers
    • ALL Web pages will be unavailable: http://www.cac.cornell.edu/
    • ALL Fileservers containing home directories
    • ALL Database servers
    7/10/2008 8:25:00 AM

    IMPORTANT DOWNTIME ANNOUNCEMENT

    Downtime July 15-16 for power outage and to install security patches

    WHEN? Tuesday, July 15th, 3pm – Wednesday, July 16th, 3pm (24 hours)

    REASONS: Power outage for electrical repairs/upgrades in Rhodes Hall and to install July security patches (Linux and Windows)

    WHO WILL BE AFFECTED? All users who use CAC, CBSU, WEBLAB, ARECIBO, DSS, ADMM and USDA resources housed in Rhodes Hall

    WHAT WILL BE UNAVAILABLE?

    • ALL LOGIN servers (all sessions will be lost)
    • ALL batch cluster nodes (v3, development, v3Linux, v3linuxdev, admm, cbsu1, cbsu2, x64test, all running jobs will be cancelled).
    • ALL Web pages will be unavailable: http://www.cac.cornell.edu/ .
    • ALL Fileservers containing home directories
    • ALL Database servers
    7/10/2008 8:21:00 AM

    UPDATE: Project information available

    MANAGEMENT CONSOLE FOR PROJECT PIs

    If you are the Principal Investigator for one or more projects, you can now view your project settings and view the list of userids you have enabled. By July 18th you will be able to update project settings from this page as well; that functionality will be added incrementally over the next ten days.

    http://www.cac.cornell.edu/services/projects/manage.aspx

    7/1/2008 11:20:00 AM

    UPDATE: Cost-recovery model transition

    Update on new project transition and deadlines for those not moving to new system

    Notice to Researchers:

    We are now in the first week of moving to a cost-recovery model. As you probably have noticed, we still have some work to do on systems and interfaces. We are still waiting for power installation in order to install the V4 linux cluster and four large shared memory nodes (16 core, 64 GB memory). Until the new systems are available, anyone who has created a project and added users can continue to use the V3 windows and linux clusters at no charge. We will begin charging for consulting, cluster maintenance and storage as of today, July 1. We are waiting final approval from the Cornell Division of Financial Affairs for the 2009 rates. As soon as the rates are approved we will update our web site. Any charges incurred starting July 1 will be billed at the new rates.

    We will continue to improve the Web forms. In addition we plan to provide a web interface to allow PIs to view and manage their projects; we hope to have the first iteration next week, allowing the project PI to view project numbers, people added to the project(s), and limits set.

    We welcome your feedback and will continue to make improvements. Regular updates will be provided as the changeover progresses.

    If you are not moving to a new project:

    • July 1: You will not be able to submit any jobs to the Velocity queues (v3,development, v3linux, or v3linuxdev). Your login will remain active for a short period of time (1-2 months) to allow you time to move your data to local storage.
    • Sept 1: Your account will be disabled.
    • Oct 1: We will no longer be able to recover files.

    As always, please contact us if you have any questions or concerns.

    6/6/2008 6:12:00 PM

    DOWNTIME: Wednesday, June 11, 8am-5pm

    REASON: Patches will be applied to both Linux and Windows servers.

    WHO WILL BE AFFECTED?

    All users:

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, v3linux, v3linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/ .

    To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.

    Database: The following machines will be inaccessible:

    • sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager

    Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.

    • Cbsusrv01-03
    • Scicentr1-3
    • Weblab
    • Arecibo
    5/16/2008 11:32:00 AM

    Fileserver ctcfsrv13 experiencing hardware problems, only linux users affected.

    ctcfsrv13 is experiencing hardware problems. This problem only affects linux users who have home folders on ctcfsrv13. Those users will be moved to other filesystems. If you think you are in this group, please contact us.

    5/9/2008 1:35:00 AM

    CAC downtime changes and updates

    REASON: Patches and scheduler changes

    Network maintenance 5/18/2008: Network connectivity to CAC managed servers will be lost from 7:00 - 7:15 AM. Running jobs will not be affected.

    Velocity Scheduler (vsched) changes 5/14/2008: The changes will provide better access to the temporary smaller number of nodes and high demand.

    • The v2linux and v2linuxdev machines will be removed to allow space and power for new hardware
    • Cluster affiliation v3 will have the Max_Queue_Limit* raised from 244800 to 259200
    • Cluster affiliation v3linux will have the Max_Queue_Limit* changed from unlimited to 230400
    * Max_Queue_Limit is the maximum number of node-wallclock minutes for all jobs in a given queue belonging to a single user, both running and waiting.

    Downtime changes 5/14/2008, 8am-5pm:

    All users:

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, v3Linux, v3linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/ .
    To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.

    Database: The following machines will be inaccessible:

    • sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager

    Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.

    • Cbsusrv01-05
    • Scicentr2&3
    • Weblab
    • Arecibo
    5/6/2008 3:23:00 AM

    Network maintenance 5/18/2008

    Network connectivity to CAC managed servers will be lost on Sunday, May 18, 2008, 7:00 and 7:15 AM

    4/28/2008 2:00:00 PM

    CAC cluster changes

    REASON: v2linux will be removed to be replaced with new cluster

    The CAC is in the process of acquiring a new linux cluster, called v4linux. v4linux will consist of 128 M600 Dell Blades, each with 2 x Quad-core 2.5GHz Intel Processors (8 cores), 16GB RAM, and 1 x 120GB hard drive, running RHEL 5 linux. We plan to use the Moab scheduler on v4linux.

    To make room for v4, the v2linux and v2linuxdev clusters must be removed first. In order to continue to offer both Windows and Linux clusters in the interim, we are temporarily moving half of the v3 nodes to Linux, configured as closely as possible to the current v2linux nodes. The v3 nodes will be returned to Windows as soon as v4linux comes online. Our goal is to have as many systems ready by July 1st as possible.

    TIMEFRAME:

    • Monday, April 28th - Friday, May 1: Half of the v3 nodes will move from Windows to Linux
    • Monday, April 28th: v3linux nodes begin to be available for test and migration
    • Wednesday, May 14th: v2linux and v2linuxdev will be removed from service

    TEMPORARY CHANGES FOR V3 (WINDOWS) USAGE:

    • Fewer nodes will be available in this pool. The nodes will be returned after v4linux is installed

    TRANSITION CHANGES FOR V2 (LINUX) USAGE:

    • Change the affiliation in your xml batch script from v2linux to v3linux
    • Change the affiliation in your xml batch script from v2linuxdev to v3linuxdev
    • The v3linux and v3linuxdev nodes have been configured as closely as possible to the v2linux nodes. The nodes have more memory and faster cpus than v2
    4/7/2008 11:00:00 AM

    DOWNTIME: Thursday, April 9, 8am-5pm

    REASON: Patches will be applied to both Linux and Windows servers. Velocity Scheduler policy changes will be applied.

    WHO WILL BE AFFECTED?

    All users:

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, serial, v2Linux, v2linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/ .

    To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.

    Velocity Scheduler (vsched) users:

    • Cluster affiliations development and v2linuxdev will have the max_time_limit raised from 20 to 60 minutes
    • Cluster affiliation v3 will have the max_time_limit raised from 24 to 48 hours
    • Cluster affiliation v3 will have min_nodes reduced from 2 to 1
    • The serial affiliation will be removed. All serial nodes will be merged into v3. Jobs submitted to serial will fail with the message Affiliation "serial" does not exist. If you have been using the serial affiliation, simply change it to v3.

    Database: The following machines will be inaccessible:

    • sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager

    Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.

    • Cbsusrv01-03
    • Scicentr1-3
    • Weblab
    • Arecibo
    3/6/2008 4:13:00 PM

    DOWNTIME: Wednesday, March 12, 8am-5pm

    REASON: Patches will be applied to both Linux and Windows servers.

    WHO WILL BE AFFECTED?

    All users:

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, serial, v2Linux, v2linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/ .

    To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.

    Database: The following machines will be inaccessible:

    • sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager

    Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.

    • Cbsusrv01-03
    • Scicentr1-3
    • Weblab
    • Arecibo
    2/8/2008 2:43:00 PM

    DOWNTIME: Wednesday, February 13, 8am-5pm

    REASON: Patches will be applied to both Linux and Windows servers.

    WHO WILL BE AFFECTED?

    All users:

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, serial, v2Linux, v2linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/ .

    To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.

    Database: The following machines will be inaccessible:

    • sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager

    Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.

    • Cbsusrv01-03
    • Scicentr1-3
    • Weblab
    • Arecibo
    1/7/2008 11:41:00 AM

    DOWNTIME: Wednesday, January 9, 8am-5pm

    REASON: Patches will be applied to both Linux and Windows servers.

    WHO WILL BE AFFECTED?

    All users:

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, serial, v2Linux, v2linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/ .

    To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.

    Database: The following machines will be inaccessible:

    • sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager

    Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.

    • Cbsusrv01-03
    • Scicentr1-3
    • Weblab
    • Arecibo
    1/2/2008 4:12:00 PM

    ctcloginb is available again.

    This machine is back online at this time.

    Please report any problems with this machine.

    1/2/2008 11:06:00 AM

    ctcloginb is unavailable.

    ctcloginb is experiencing hardware trouble. CAC systems staff is working on it now.

    12/10/2007 11:00:00 AM

    DOWNTIME: Wednesday, Dec 12th, 8am-5pm

    REASON: Patches will be applied to both Linux and Windows servers.

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, serial, v2Linux, v2linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/.
    • To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.
    • The following database machines will be inaccessible: sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager
    • Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.
      • Cbsusrv01-03
      • Scicentr1-3
      • Weblab
      • Arecibo
    11/9/2007 10:30:00 AM

    DOWNTIME: Wednesday, Wed, Nov 14th., 8am-5pm

    REASON: Patches will be applied to both Linux and Windows servers.

    • Fileservers containing home directories on H: and /home/nfs will be inaccessible.
    • ctclogina, ctcloginb, ctclogind, linuxlogin1, linuxlogin2 - all login sessions will be lost.
    • CAC batch machines (v3, development, serial, v2Linux, v2linuxdev, admm, cbsu1, cbsu2, x64test). All running jobs will be cancelled.
    • CAC Web pages will be unavailable: http://www.cac.cornell.edu/.
    • To minimize interruptions in accessing files, the fileservers containing home directories on H: and /home/nfs will be patched first.
    • The following database machines will be inaccessible: sqlsrv01, sqlsrv02, ctcsql, scidata1, scidata2, sonofstager
    • Specific groups: If you are using any of the following machines, you would make direct connections to them. These connections will be interrupted.
      • Cbsusrv01-03
      • Scicentr1-3
      • Weblab
      • Arecibo
    11/5/2007 3:30:00 PM

    Sessions disconnected for more than 24 hours will be terminated

    All sessions to login nodes that are disconnected for more than 24 hours will be terminated in order to improve system response time.