Daily Bulletin Archive

July 16, 2018

Containers are a hot topic in high-performance and scientific computing, but while they can provide significant advantages they don't always live up to the hype. That’s why CISL is offering a hands-on class, “Containers and How They Work,” from 9 a.m. to noon MDT on Friday, July 20, at the NCAR Mesa Lab in Boulder.

The course explains what containers are and how they work, and it surveys some popular implementations with an eye toward supporting scientific workloads. Security and other operational concerns will also be covered for cluster administrators who are thinking about supporting containerized workloads on their systems. Topics to be covered include:

  • What are containers and how do they work?

  • Image formats (tar/filesystem/overlayfs/dense filesystem image/singularity)

  • Build vs. run [singularityhub]

  • Platform independence/reproducibility

  • User namespaces and rootless containers

  • Scheduler integration

  • Container runtimes (Docker, Charliecloud, Inception, Singularity, others)

  • OCI/Standards/runc

  • Applications

  • Education/outreach

  • Cloud

  • Reproducible science

The class is intended for anyone who is planning to deploy applications and create application environments using containers; developers and systems support staff getting started with containers; and others interested in learning about containers. Participants should be familiar with Linux and system operations and should bring a laptop and authentication token for connecting to Geyser and Caldera. Laptops should be fully charged as there may not be enough power receptacles in the seminar room.

Please use this form to register so CISL knows how many participants to expect. Space is limited to 50 participants and registration is open through July 16.

July 13, 2018

HPSS downtime: Tuesday, July 17th 7:30 a.m. - 10:00 a.m.

No downtime: Cheyenne, GLADE, Geyser_Caldera

July 12, 2018

The CISL Help Desk and Consulting support will close at 3:00 p.m. Friday so staff members can attend a UCAR function.

July 11, 2018

A new and larger work space is now available for GLADE. The new /glade2/work file space has a total capacity of 2 PB. The default quota for individual users 1 TB. Users can access the new space as /glade/work.

The older /glade/p/work file space (where users’ default quota is 512 GB) will become read-only within the next two months. The date will be announced soon. The /glade/p/work space will be retired by the end of 2018.

Users are encouraged to begin using the new space soon and move all of their active files and directories from the old space to their individual /glade/work directories at their earliest convenience.

Based on input from users, the new /glade/work spaces will remain unpurged. We apologize for the incorrect info in yesterday's Daily B item.

July 11, 2018

Changes to the GLADE project space being implemented on Tuesday, July 10, continue the evolution of CISL’s storage architecture and user environment as announced in April. Users should take note of the changes for their impact on workflows and scripts.

Here are the key changes to be aware of:

  • On July 10, the present /glade/p/ spaces will become /glade/p_old/ and be made read/write-only for a period of 30 days. After 30 days, the old spaces will be read-only until they are decommissioned at the end of 2018.

  • Also on July 10, new /glade/p/<entity>/ spaces will be in place for existing projects so users can move their files from /glade/p_old/ to the new file system. An entity can be univ, uwyo, cesm, cisl, nsc, or other designated NCAR lab or special program.


  • NCAR Lab: /glade/p/P12345678 becomes /glade/p_old/P12345678 and the new space is /glade/p/cisl/P12345678

  • University: /glade/p/UABC1234 becomes /glade/p_old/UABC1234 and the new space is /glade/p/univ/UABC1234

CISL recommends using Globus as the most efficient way to transfer files. The system monitors progress and automatically validates correctness of each file transfer. Users are asked to remove files from /glade/p_old/ once their transfers are complete.

July 10, 2018

A recording of the July 9 tutorial, “Using Globus and Campaign Storage,” is now available on the CISL web site. See the course page to review the presentation and download the slides. The 45-minute tutorial familiarizes users with the Globus file transfer system and the new Campaign Storage resource.

July 10, 2018

A new, larger GLADE scratch space is now available for immediate use as /glade/scratch_new/. The new space is built with the latest version of GPFS 5, providing more efficient use of the available storage and improved I/O performance. Users are encouraged to move their existing /glade/scratch files to the new space as soon as possible. As with the new /glade/p file space, users should take note of the changes for their impact on workflows and scripts.

Here are the key changes to be aware of:

  • The present /glade/scratch/ spaces will remain read/write for a period of 30 days.

  • In 30 days the present /glade/scratch/ spaces will be renamed /glade/scratch_old/ and will become read-only. The purge policy for files in /glade/scratch_old/ will be reduced to 30 days.

  • Also in 30 days, /glade/scratch_new will be renamed /glade/scratch.

  • Each user’s current scratch quotas will be preserved in the new scratch space.

  • Effective immediately, all requests for increases to scratch quotas will be made to the new scratch space.

  • /glade/scratch_old will be removed from the system in approximately 60 days, in early September.

CISL recommends using Globus as the most efficient way to transfer files across file systems. Globus monitors progress and automatically validates correctness of each file transfer. Users are asked to remove files from /glade/scratch_old/ once their transfers are complete.

July 6, 2018

The new Campaign Storage file system that was announced recently is now available for production use. NCAR users are advised to contact their lab’s data storage coordinators for details on how to use the lab’s allocated space.

Campaign Storage is accessible using the Globus web and command line interfaces. CISL is offering a tutorial on Monday, July 9, to introduce users to the Globus file transfer system. See this announcement in today’s Daily Bulletin for more details and to register for the tutorial.

July 6, 2018

Registration is now open for the NCAR/CISL Consulting Services Group’s 45-minute tutorial at 10 a.m. MDT on Monday, July 9. The tutorial will introduce users to the Globus file transfer system and cover the following topics in detail:

  • Using the Globus web and command line interfaces

  • Making transfers between remote Globus endpoints

  • Accessing the new Campaign Storage spaces using Globus

  • Moving data between NCAR HPC systems and local workstations

Register to attend in person—in the Damon Conference Room at NCAR’s Mesa Lab in Boulder—or via webcast by selecting one of these links:

July 6, 2018

The Cheyenne, Geyser, and Caldera clusters and the GLADE file system will be unavailable on Tuesday, July 10, starting at approximately 7 a.m. MDT to allow CISL staff to update key system software components. The downtime is expected to last until approximately 6 p.m. but every effort will be made to return the system to service as soon as possible. The updates include installing the latest version of the PBS scheduler, changes to /glade/p/ described in today’s Daily Bulletin, and completing GLADE’s transition to GPFS 5.

A system reservation will prevent batch jobs from executing after 7 a.m. All batch queues will be suspended and the cluster’s login nodes will be unavailable throughout the update period. All batch jobs and interactive processes that are still executing when the outage begins will be killed.

CISL will inform users through the Notifier service when all of the systems are restored.