The Daily Bulletin

08/15/18 - The Cheyenne, Geyser, and Caldera clusters and the GLADE file system will be unavailable on Tuesday, August 21, starting at 6 a.m. MDT to allow CISL staff to update key system software components. The downtime is expected to last until approximately 6 p.m. but every effort will be made to return the system to service as soon as possible. The updates will include the changes to GLADE’s scratch file spaces described in today’s Daily Bulletin.

A system reservation will prevent batch jobs from executing after 6 a.m. All batch queues will be suspended and the clusters’ login nodes will be unavailable throughout the maintenance period. All batch jobs and interactive processes that are still executing when the outage begins will be killed.

CISL will inform users through the Notifier service when all of the systems are restored.

Updated 8/15/2018 - A number of the previously announced changes to the GLADE file system are scheduled for Tuesday, August 21. First, /glade/scratch will be moved to /glade/scratch_old and become read-only. The purge policy for files in that space will be 30 days. The /glade/scratch_old space will be removed from the system on October 2.

Also, the new and larger /glade/scratch_new (implemented on July 10) will be renamed to /glade/scratch. The 60-day purge policy for this space will remain in place.

To prepare for the renaming of the file spaces, users are encouraged to begin using the new scratch space as soon as possible and where it is practical to do so.  For example, files remaining on the old scratch space should be moved to the new scratch space.

Aug 21/glade/scratch -> /glade/scratch_oldBecomes read-only
30-day purge policy
Aug 21/glade/scratch_new -> /glade/scratchRetains 60-day purge policy
Oct 2/glade/scratch_old will be removed 

8/2/2018 - CISL is now accepting large-scale allocation requests from university-based researchers for the 5.34-petaflops Cheyenne cluster. Submissions are due September 11.

The fall opportunity will include allocations on some new supporting resources. The Casper analysis and visualization cluster will soon enter production to replace the Geyser/Caldera clusters. University projects should request long-term space on the Campaign Storage resource instead of HPSS. Unlike HPSS, Campaign Storage has no default minimum amount; users are asked to justify the amount requested. Scrutiny of the justification will increase with the size of the request.

Researchers are encouraged to review the allocation instructions before preparing their requests. The CISL HPC Allocations Panel (CHAP) is applying increased scrutiny to data management plans and justifications for storage requests. For instructions and information regarding available resources, see the CHAP page:

At the fall meeting, CISL will allocate 180 million core-hours on Cheyenne, up to 2 PB of Campaign Storage space, and up to 500 TB of GLADE project space. Large allocations on Cheyenne are those requesting more than 400,000 core-hours. CISL accepts requests from university researchers for these large-scale allocations every six months.

Please contact if you have any questions.

7/31/2018 - Some of the changes to the GLADE project and work spaces that were announced in July will take place on Tuesday, October 2, as part of the migration to CISL’s new storage architecture and user environment.

The /glade/p_old/ space will be made read-only. This means it will continue to be read-write two months longer than previously planned. It will be decommissioned December 31. (These and other scheduled updates to storage systems have been published in table format here.)

Users are asked to:

  • Migrate any files they still have on /glade/p_old/ or /glade/p_old/work to one of the new storage systems as soon as possible. CISL recommends moving active project data to /glade/p/<entity>/<project_code> where entity can be univ, uwyo, cesm, mmm, nsc, or other designated NCAR lab or special program.

  • Move project data that is not active but needs to be preserved to the Campaign Storage archive. Users access and manage their Campaign Storage files with Globus services.

  • Move files they need from their individual /glade/p_old/work/ directories to the new /glade/work.

  • Delete files from /glade/p_old/ and /glade/p_old/work once their transfers are complete and validated.   

Contact with questions or for help moving their files.