Daily Bulletin Archive

July 12, 2018

The CISL Help Desk and Consulting support will close at 3:00 p.m. Friday so staff members can attend a UCAR function.

July 11, 2018

A new and larger work space is now available for GLADE. The new /glade2/work file space has a total capacity of 2 PB. The default quota for individual users 1 TB. Users can access the new space as /glade/work.

The older /glade/p/work file space (where users’ default quota is 512 GB) will become read-only within the next two months. The date will be announced soon. The /glade/p/work space will be retired by the end of 2018.

Users are encouraged to begin using the new space soon and move all of their active files and directories from the old space to their individual /glade/work directories at their earliest convenience.

Based on input from users, the new /glade/work spaces will remain unpurged. We apologize for the incorrect info in yesterday's Daily B item.

July 11, 2018

Changes to the GLADE project space being implemented on Tuesday, July 10, continue the evolution of CISL’s storage architecture and user environment as announced in April. Users should take note of the changes for their impact on workflows and scripts.

Here are the key changes to be aware of:

  • On July 10, the present /glade/p/ spaces will become /glade/p_old/ and be made read/write-only for a period of 30 days. After 30 days, the old spaces will be read-only until they are decommissioned at the end of 2018.

  • Also on July 10, new /glade/p/<entity>/ spaces will be in place for existing projects so users can move their files from /glade/p_old/ to the new file system. An entity can be univ, uwyo, cesm, cisl, nsc, or other designated NCAR lab or special program.

Examples:

  • NCAR Lab: /glade/p/P12345678 becomes /glade/p_old/P12345678 and the new space is /glade/p/cisl/P12345678

  • University: /glade/p/UABC1234 becomes /glade/p_old/UABC1234 and the new space is /glade/p/univ/UABC1234

CISL recommends using Globus as the most efficient way to transfer files. The system monitors progress and automatically validates correctness of each file transfer. Users are asked to remove files from /glade/p_old/ once their transfers are complete.

July 10, 2018

A recording of the July 9 tutorial, “Using Globus and Campaign Storage,” is now available on the CISL web site. See the course page to review the presentation and download the slides. The 45-minute tutorial familiarizes users with the Globus file transfer system and the new Campaign Storage resource.

July 10, 2018

A new, larger GLADE scratch space is now available for immediate use as /glade/scratch_new/. The new space is built with the latest version of GPFS 5, providing more efficient use of the available storage and improved I/O performance. Users are encouraged to move their existing /glade/scratch files to the new space as soon as possible. As with the new /glade/p file space, users should take note of the changes for their impact on workflows and scripts.

Here are the key changes to be aware of:

  • The present /glade/scratch/ spaces will remain read/write for a period of 30 days.

  • In 30 days the present /glade/scratch/ spaces will be renamed /glade/scratch_old/ and will become read-only. The purge policy for files in /glade/scratch_old/ will be reduced to 30 days.

  • Also in 30 days, /glade/scratch_new will be renamed /glade/scratch.

  • Each user’s current scratch quotas will be preserved in the new scratch space.

  • Effective immediately, all requests for increases to scratch quotas will be made to the new scratch space.

  • /glade/scratch_old will be removed from the system in approximately 60 days, in early September.

CISL recommends using Globus as the most efficient way to transfer files across file systems. Globus monitors progress and automatically validates correctness of each file transfer. Users are asked to remove files from /glade/scratch_old/ once their transfers are complete.

July 6, 2018

The new Campaign Storage file system that was announced recently is now available for production use. NCAR users are advised to contact their lab’s data storage coordinators for details on how to use the lab’s allocated space.

Campaign Storage is accessible using the Globus web and command line interfaces. CISL is offering a tutorial on Monday, July 9, to introduce users to the Globus file transfer system. See this announcement in today’s Daily Bulletin for more details and to register for the tutorial.


July 6, 2018

Registration is now open for the NCAR/CISL Consulting Services Group’s 45-minute tutorial at 10 a.m. MDT on Monday, July 9. The tutorial will introduce users to the Globus file transfer system and cover the following topics in detail:

  • Using the Globus web and command line interfaces

  • Making transfers between remote Globus endpoints

  • Accessing the new Campaign Storage spaces using Globus

  • Moving data between NCAR HPC systems and local workstations

Register to attend in person—in the Damon Conference Room at NCAR’s Mesa Lab in Boulder—or via webcast by selecting one of these links:

July 6, 2018

The Cheyenne, Geyser, and Caldera clusters and the GLADE file system will be unavailable on Tuesday, July 10, starting at approximately 7 a.m. MDT to allow CISL staff to update key system software components. The downtime is expected to last until approximately 6 p.m. but every effort will be made to return the system to service as soon as possible. The updates include installing the latest version of the PBS scheduler, changes to /glade/p/ described in today’s Daily Bulletin, and completing GLADE’s transition to GPFS 5.

A system reservation will prevent batch jobs from executing after 7 a.m. All batch queues will be suspended and the cluster’s login nodes will be unavailable throughout the update period. All batch jobs and interactive processes that are still executing when the outage begins will be killed.

CISL will inform users through the Notifier service when all of the systems are restored.

June 29, 2018

No downtime: Cheyenne, GLADE, Geyser_Caldera and HPSS

June 29, 2018

The CISL Consulting Services Group is planning a 30- to 45-minute tutorial for 10 a.m. MDT on Monday, July 9, to demonstrate how to use Globus to move data between the Cheyenne/GLADE environment, external endpoints, and the new Campaign Storage file system that will become available soon. Registration forms and more information about the tutorial will be available this week.

Pages