Daily Bulletin Archive

Feb. 15, 2017

Critical updates to the Cheyenne system that were scheduled for today have been postponed because of unexpected problems encountered during tests of the PBS Pro scheduling system on the Laramie cluster. Determining the causes of the problems and implementing fixes may take several more days. Once the fixes are installed and tested on Laramie, CISL will reschedule the Cheyenne updates and make the system available as soon as possible to the general user community.

We will continue to keep you up to date with any and all new information on Cheyenne’s status

Feb. 14, 2017

 By Sophie Hou, NCAR Data Curation & Stewardship Coordinator

 In order to document, describe, and define data, especially with quality attributes (e.g. complete, accurate, credible, consistent), it is helpful for researchers and their collaborators to be familiar with the concept of metadata as well as the commonly known metadata standards and formats associated with the researchers’ fields of study. The use of metadata, or “good documentation,” could tell people that “they can trust your data by enabling validation, replication, and reuse” as LYD suggests.

At NCAR, the Digital Asset Services Hub (DASH) can help researchers in learning about metadata, the different standards and formats, and how to use them. An example is the metadata from DataCite, which is used when requesting and registering digital object identifiers (DOIs). Another example is the metadata format used with the upcoming DASH Search and Discovery system (a centralized system that uses metadata to assist with and enhance the effectiveness/efficiency of finding, understanding, and using research products and output from NCAR labs).

To learn more about DataCite’s metadata and how it works with DOI assignments, please visit DASH’s Digital Object Identifiers (DOIs) page, and for further information about NCAR’s metadata used for DASH Search and Discovery system, please check back at DASH Search and Discovery page (updates will be provided over the next months) or contact us at datahelp@ucar.edu. This information is provided as part of the Love Your Data (LYD) Week 2017 series.

Feb. 14, 2017

The High-Performance Storage System (HPSS) will be unavailable to users from 7 a.m. Tuesday until 9 a.m. Wednesday as a major upgrade is completed. The extended downtime is the final step in a complex upgrade to HPSS version 7.4.3 and to version 5.02 of the HSI and HTAR utilities that are used to manage and transfer files.

These changes are internal to the system and will not affect the way users archive and retrieve files. Thank you for your patience as the upgrade is completed. Users who subscribe to the CISL Notifier service will be informed by email when the system is returned to service.

Feb. 14, 2017

HPSS: Downtime Tuesday, February 14, 7:00 am through Wednesday, February 15, 9:00 am

No Downtime: Yellowstone, Cheyenne, GLADE, Geyser/Caldera

Feb. 13, 2017

By Sophie Hou, NCAR Data Curation & Stewardship Coordinator

Quality is a crucial characteristic of data; it enables people to have trust and confidence in the data and the related studies. However, “quality” can also be difficult to measure. In order to establish data quality and differentiate quality levels, LYD suggests that researchers consider the following:

“Data quality is the degree to which data meets the purposes and requirements of its use. Depending on the uses, good quality data may refer to complete, accurate, credible, consistent or ‘good enough’ data.”

There are several resources from the Digital Asset Services Hub (DASH) that can help UCAR/NCAR researchers and their collaborators in evaluating, improving, and enhancing the quality of their research products and output; these resources can be found on DASH’s website and include the DMP Preparation Guidance and Template Document and DMP Checklist for Awarded Proposals.

By integrating the suggested activities from DASH’s resources in the research lifecycle, researchers and their collaborators could establish and demonstrate essential quality of their data. Additionally, partnerships with data management support, including DASH and the Data Curation & Stewardship Coordinator, could further improve data’s quality for the long term.

To learn more about how DASH’s services, including the DMP Preparation Guidance and Template Document and DMP Checklist for Awarded Proposals, and how the Data Curation & Stewardship Coordinator could help in enhancing your data quality, please contact us at datahelp@ucar.edu. This information is provided as part of the Love Your Data (LYD) Week 2017 series.

Feb. 13, 2017

Major system upgrades to Cheyenne are scheduled for Tuesday, February 14, and will require an all-day system outage. Preliminary tuning and testing continues on Cheyenne’s companion test platform, Laramie. Please be aware that if CISL encounters any last-minute problems on Laramie that are deemed serious enough to jeopardize users’ work or the Cheyenne system’s integrity, the upgrade could be delayed by several days.

Critical system updates to detect out-of-memory (OOM) events on batch nodes have been completed and are performing well in initial testing on Laramie. As noted in earlier Daily Bulletin items, preventing OOM events benefits both Cheyenne and Yellowstone users. Because the two systems share the GLADE disk resource, an OOM event on one cluster would likely cause file system hangs on both systems.

Production jobs for Accelerated Scientific Discovery (ASD) projects will continue to have priority on Cheyenne through the end of March, as announced previously. After Cheyenne is released, non-ASD users should initially plan to work on porting code, preparing job scripts, and migrating files as needed to the new GLADE scratch space.  Please contact the CISL Help Desk for assistance in any of these tasks.

Feb. 10, 2017

Registration is now open for a Linux Cluster Institute (LCI) workshop in Laramie, Wyoming, for system administrators who are new to high-performance computing (HPC). Participants will learn HPC system administration concepts and technologies and how to apply them. They will also get hands-on skills by building a small test cluster, and hear real-life stories and interact with experts in panel discussions.

The May 22-26 LCI introductory workshop is presented by the University of Wyoming in collaboration with UCAR. Staff from the CISL Supercomputer Systems Group will provide the training. Those interested can register online at http://www.linuxclustersinstitute.org/workshops/. The registration fee is $495 through April. The fee will be $600 for participants who register May 1 or later.

Feb. 10, 2017

Graduate students and postdoctoral scholars from institutions in the United States, Canada, Europe, and Japan are invited to apply for the eighth International Summer School on HPC Challenges in Computational Sciences, to be held June 25 to 30, 2017, in Boulder.

The expense-paid program will benefit scholars who use advanced computing in their research. Applications are due March 6. See the IHPCSS2017 event page for more information and an application link.

The summer school is sponsored by Compute/Calcul Canada and the Extreme Science and Engineering Discovery Environment (XSEDE) with funds from the U.S. National Science Foundation, the Partnership for Advanced Computing in Europe (PRACE) and the RIKEN Advanced Insti­tute for Computational Science (RIKEN AICS).

Feb. 10, 2017
CISL plans to make the Cheyenne system available to the general user community after the completion and testing of system updates that are scheduled for February 14. Once the planned updates have been thoroughly tested, which may take up to two weeks, we will open the system to other users. 
 
The most critical update is code to detect out-of-memory (OOM) events on batch nodes. Preventing OOM events benefits both Cheyenne and Yellowstone users. Because the two systems share the GLADE disk resource, an OOM event on one cluster would likely cause file system hangs on both systems.
 
Production jobs for Accelerated Scientific Discovery (ASD) projects will continue to have priority through the end of March, as announced previously. Other users should initially plan to work on porting code, preparing job scripts, and migrating files as needed to the new GLADE scratch space.
Feb. 10, 2017

In support of Love Your Data (LYD) Week starting Monday, February 13, NCAR will share a data-related post each day by Sophie Hou, Data Curation & Stewardship Coordinator for the UCAR/NCAR Digital Asset Services Hub (DASH).

LYD Week 2017 is an international event coordinated by academic libraries and data archives to promote research data as “the foundation of the scholarly record and crucial for advancing our knowledge of the world around us.” The special posts will appear in the CISL Daily Bulletin as well as UCAR’s Staff Notes Daily and address these topics:

  • Monday (2/13): Defining Data Quality

  • Tuesday (2/14): Documenting, Describing, Defining

  • Wednesday (2/15): Good Data Examples

  • Thursday (2/16): Finding the Right Data

  • Friday (2/17): Rescuing Unloved Data

While DASH's resources are designed primarily for UCAR/NCAR digital assets, our collaborators and high-performance computing (HPC) users are welcome to view the data management guidance, including FAQs and sample data management plans, and additional information provided that is part of the DASH service.

Pages