Daily Bulletin Archive

July 10, 2018

A recording of the July 9 tutorial, “Using Globus and Campaign Storage,” is now available on the CISL web site. See the course page to review the presentation and download the slides. The 45-minute tutorial familiarizes users with the Globus file transfer system and the new Campaign Storage resource.

July 10, 2018

A new, larger GLADE scratch space is now available for immediate use as /glade/scratch_new/. The new space is built with the latest version of GPFS 5, providing more efficient use of the available storage and improved I/O performance. Users are encouraged to move their existing /glade/scratch files to the new space as soon as possible. As with the new /glade/p file space, users should take note of the changes for their impact on workflows and scripts.

Here are the key changes to be aware of:

  • The present /glade/scratch/ spaces will remain read/write for a period of 30 days.

  • In 30 days the present /glade/scratch/ spaces will be renamed /glade/scratch_old/ and will become read-only. The purge policy for files in /glade/scratch_old/ will be reduced to 30 days.

  • Also in 30 days, /glade/scratch_new will be renamed /glade/scratch.

  • Each user’s current scratch quotas will be preserved in the new scratch space.

  • Effective immediately, all requests for increases to scratch quotas will be made to the new scratch space.

  • /glade/scratch_old will be removed from the system in approximately 60 days, in early September.

CISL recommends using Globus as the most efficient way to transfer files across file systems. Globus monitors progress and automatically validates correctness of each file transfer. Users are asked to remove files from /glade/scratch_old/ once their transfers are complete.

July 6, 2018

The new Campaign Storage file system that was announced recently is now available for production use. NCAR users are advised to contact their lab’s data storage coordinators for details on how to use the lab’s allocated space.

Campaign Storage is accessible using the Globus web and command line interfaces. CISL is offering a tutorial on Monday, July 9, to introduce users to the Globus file transfer system. See this announcement in today’s Daily Bulletin for more details and to register for the tutorial.

July 6, 2018

Registration is now open for the NCAR/CISL Consulting Services Group’s 45-minute tutorial at 10 a.m. MDT on Monday, July 9. The tutorial will introduce users to the Globus file transfer system and cover the following topics in detail:

  • Using the Globus web and command line interfaces

  • Making transfers between remote Globus endpoints

  • Accessing the new Campaign Storage spaces using Globus

  • Moving data between NCAR HPC systems and local workstations

Register to attend in person—in the Damon Conference Room at NCAR’s Mesa Lab in Boulder—or via webcast by selecting one of these links:

July 6, 2018

The Cheyenne, Geyser, and Caldera clusters and the GLADE file system will be unavailable on Tuesday, July 10, starting at approximately 7 a.m. MDT to allow CISL staff to update key system software components. The downtime is expected to last until approximately 6 p.m. but every effort will be made to return the system to service as soon as possible. The updates include installing the latest version of the PBS scheduler, changes to /glade/p/ described in today’s Daily Bulletin, and completing GLADE’s transition to GPFS 5.

A system reservation will prevent batch jobs from executing after 7 a.m. All batch queues will be suspended and the cluster’s login nodes will be unavailable throughout the update period. All batch jobs and interactive processes that are still executing when the outage begins will be killed.

CISL will inform users through the Notifier service when all of the systems are restored.

June 29, 2018

No downtime: Cheyenne, GLADE, Geyser_Caldera and HPSS

June 29, 2018

The CISL Consulting Services Group is planning a 30- to 45-minute tutorial for 10 a.m. MDT on Monday, July 9, to demonstrate how to use Globus to move data between the Cheyenne/GLADE environment, external endpoints, and the new Campaign Storage file system that will become available soon. Registration forms and more information about the tutorial will be available this week.

June 29, 2018

CISL’s documentation for Geyser and Caldera users has been revised to reflect the recent updating of those systems to CentOS 7. Key differences  include the following:

  • Procedures for loading Python modules were changed to match the procedures used on Cheyenne.

  • Earlier example scripts included a source command for initializing the Slurm environment. That command is no longer needed and should be removed from scripts used in the CentOS 7 environment. (Updated examples are on this page.)

  • The first line of example bash scripts for Slurm jobs has been revised to include the -l option, which now is required to initialize the environment.

  • Some modules for outdated software are no longer available, so affected scripts should be revised to specify the newer versions.

  • The openmpi-slurm module has been renamed to openmpi.

June 28, 2018

Nearly all of the researchers who responded to the recent CISL survey about their CMIP6 plans expressed strong interest in using NCAR facilities such as the CMIP Analysis Platform to support their work. Of the 38 respondents, 95% said they were likely to very likely to use those resources.

Researchers were also asked to identify which DECK and CMIP6 historical simulations they anticipate needing for their work. The following shows what percentage of respondents selected each simulation:

  • 100% - Historical simulation using CMIP6 forcings (1850-2014)

  • 68.4% - Pre-industrial control simulation

  • 55.3% - AMIP simulation (~1979-2014)

  • 47.4% - 1%/yr CO2 increase

  • 36.8% - Abrupt 4xCO2 run

The survey also asked researchers to indicate which CMIP-endorsed MIPs they anticipate using. The most frequently selected were:

  • 36.8% - Cordex

  • 36.8% - HighResMIP

  • 28.9% - CMIP Coupled Climate Carbon Cycle MIP

  • 28.9% - RFMIP Radiative Forcing MIP

  • 28.9% - Scenario MIP

The results will help CISL prioritize the addition of CMIP6 data sets to the CMIP Analysis Platform. NCAR CMIP6 data products are expected to be available this summer. Estimated time frames for data from other modeling centers will be published when they become available.

June 26, 2018

Does your institution have lots of researchers and educators who want to use advanced computing but need some help learning how? Consider attending the free ACI-REF Virtual Residency Summer Workshop on Research Computing Facilitation to learn to be more effective at helping researchers and educators use Research Cyberinfrastructure (CI).

This intermediate-level workshop is August 5-10 on the University of Oklahoma Norman campus. Participants can attend either in person or remotely by videoconference. You do not need to have completed an introductory workshop to attend. Use this link to register or contact hneeman@ou.edu for additional information.

Virtual Residency workshops have served 188 institutions in 51 U.S. states and territories and five other countries.