The Daily Bulletin

November 14, 2018

Registration is now open for an NCAR/CISL tutorial on using the Globus command line interface (CLI) at 9:30 a.m. MST on November 29. The one-hour tutorial will show participants how the Globus CLI can be used both interactively and within scripts as part of larger workflows. Much like the HSI interface to tape, the Globus CLI enables programmatic access to NCAR and external data endpoints, including the new NCAR Campaign Storage archive.

Topics will include:

  • Initiating, monitoring, and modifying transfers between endpoints

  • Incorporating CLI commands into data mover scripts

  • Best practices for storing data at NCAR

  • Strategies for archiving research data on the new Campaign Storage platform

Register to attend in person – in the Small Seminar Room (FL2-1001) at NCAR’s Foothills Lab in Boulder – or attend online by selecting one of these links:

November 9, 2018

The frequency and severity of hardware failures on the Geyser and Caldera clusters and the /glade/p_old file system have increased as they approach end of life. These failures pose a risk to users who have not yet moved files that they need from /glade/p_old to one of the new storage spaces or have not begun to migrate their workflows to the new Casper data analysis and visualization cluster.

Several Geyser and Caldera nodes and /glade/p_old disks have already suffered irrecoverable hardware failures. They have been removed and will not be replaced. CISL storage engineers have been able to recover all files from failed /glade/p_old disks and will continue their data recovery efforts until December 15.  After that date, all files on /glade/p_old/ disks that fail will be lost permanently.

As announced previously, the /glade/p_old/ project and work spaces will be decommissioned December 31 and all files will be permanently removed from the system. CISL provides example scripts to help users move their files from old to new GLADE file spaces and documentation for using the new Campaign Storage archive. A tutorial planned for November 29 will demonstrate how to use the Globus CLI to work with Campaign Storage. Watch the Daily Bulletin for more information about the tutorial.