Daily Bulletin Archive

May. 24, 2017

The CISL User Services Section will present an in-person and online tutorial at 1:30 p.m. MDT on Thursday, May 25, at the NCAR Mesa Lab in Boulder to help users prepare to work with the new Cheyenne HPC system. The 60-minute tutorial will cover typical workflows in the Cheyenne environment as well as performance and operational differences between the Yellowstone and Cheyenne systems.

Topics to be covered include:

  • Technical specifications for Cheyenne and the expanded GLADE file systems

  • The Cheyenne computing environment

  • Accessing software, including compilers and MPI libraries

  • Submitting batch jobs using the PBS scheduler

The tutorial will conclude with a Q&A session, so please bring other general questions and concerns not covered above. Register to attend in person—at the VisLab in NCAR’s Mesa Lab (ML4) in Boulder—or via webcast by selecting a link below:

May. 19, 2017

Ensemble runs, data assimilation runs, and other jobs run on Cheyenne and Yellowstone can generate tens or hundreds of thousands of output files, log files, and others over time. Such large numbers of files can be difficult to manage and remove from GLADE file spaces when they are no longer needed. Configuring jobs to place no more than 2,000 to 3,000 files in a single directory will make them easier to manage.

See Removing large numbers of files for how to remove massive accumulations of files and see this page for more best practices.

May. 9, 2017

Users are asked to log in directly to individual login nodes when using the Cheyenne, Yellowstone, Geyser, and Caldera systems on Tuesday, May 9, while CISL makes changes to some critical infrastructure components. The changes are needed to improve the stability of these environments and will be done in a rotation so users will continue to have access and jobs can continue to run throughout the day.

Rather than log in with your normal procedures during the times below, use one of the node IDs shown in place of “cheyenne” or “yellowstone.”

8 a.m. to Noon MDT

Cheyenne - cheyenne1, cheyenne2 or cheyenne3

Yellowstone - Use yslogin1, yslogin2 or yslogin3

 

Noon to 5 p.m. MDT

Cheyenne — Use cheyenne4, cheyenne5 or cheyenne6

Yellowstone — Use yslogin4, yslogin5 or yslogin6

May. 8, 2017

The deadline for submitting poster abstracts, Visualization Showcase proposals and Birds-of-a-Feather proposals for PEARC17—the Practice and Experience in Advanced Research Computing conference in New Orleans, July 9-13, 2017—has been extended to Monday, May 8.

Submissions should emphasize experiences and lessons derived from the operation and use of advanced research computing on campuses or provided for the academic and open science communities. Submissions that align with the conference theme—Sustainability, Success, and Impact—are particularly encouraged. See the Call for Participation for more information.

Students whose posters are accepted are eligible to apply for financial support to cover the costs of airfare, shared lodging, and registration fees. Here’s more information on the Student Program.

May. 5, 2017

GLADE project space user quotas were reset at noon MDT on Friday, April 28, to prevent the /glade/p space from hitting the 95% full mark again as it did earlier that week. Some data can be lost if the file system reaches 95% full and a downtime and remount of the file system become necessary.

To help ensure the file system’s stability and continued availability, users’ project space quotas were set to a level that accommodates their file holdings as of the morning of Wednesday, April 26. The new quotas will remain in effect until early June when /glade/p is expanded with the old GLADE scratch disk.

Jobs that direct output to project space that is at capacity will fail. Project space users are advised to immediately review their workflows so that job output is written to the recently expanded /glade/scratch file space rather than /glade/p. CISL also again advises users to delete files from project space that are no longer needed. For files that need to be retained but are not required for current processing, please work with your Lab System Administrator(s) and Data Manager(s) to sort out a viable long-term archival plan.

Project space is not intended for use as a long-term data repository. Users who need to remove thousands or hundreds of thousands of files from a GLADE directory should review Removing large numbers of files for how to do that most efficiently.

Apr. 27, 2017

GLADE project space user quotas will be reset at noon MDT on Friday, April 28, to prevent the /glade/p space from hitting the 95% full mark again as it did earlier this week. If the file system reaches 95% full and a downtime and remount of the file system become necessary, some data may be lost.

To help ensure the file system’s stability and continued availability, users’ project space quotas will be set to  a level that accommodates their file holdings as of the morning of Wednesday, April 26. Jobs that run after the new quotas are established will fail if output is directed to project space that is at capacity.

Project space users are advised to immediately review their workflows so that job output is written to the recently expanded /glade/scratch file space rather than /glade/p. CISL also again advises users to delete files from project space that are no longer needed. The new quotas will remain in effect until early June when /glade/p is expanded with the old GLADE scratch disk.

Project space is not intended for use as a long-term data repository. Users who need to remove thousands or hundreds of thousands of files from a GLADE directory should review Removing large numbers of files for how to do that most efficiently.

Apr. 27, 2017

An important deadline is coming Monday, May 1, for anyone interested in submitting poster abstracts, Visualization Showcase proposals or Birds-of-a-Feather proposals for PEARC 17—the Practice and Experience in Advanced Research Computing conference in New Orleans, July 9-13, 2017.

Submissions should emphasize experiences and lessons derived from operation and use of advanced research computing on campuses or provided for the academic and open science communities. Submissions that align with the conference theme—Sustainability, Success, and Impact—are particularly encouraged. See the Call for Participation for more information.

Students whose posters are accepted are eligible to apply for financial support to cover the costs of airfare, shared lodging, and registration fees.

Apr. 25, 2017

A workshop geared toward new NCL users is scheduled for June 6-9 at the Corporate Technical Training Center on the Center Green Campus (CG-2) in Boulder. The workshop will include a combination of introductory lectures on NCL and scientific data formats, with hands-on labs in the afternoon. Instructors will work with students during the labs to help them write NCL programs for analyzing their own data.

Registration is limited and the summer workshop tends to fill up quickly, so register as soon as possible. The registration deadline is May 19.

Travel support is available on a first-come, first-served basis for qualified students from EPSCoR states or minority-serving institutions. The deadline for applying for funds is April 28.

See this page for full details and a link to the registration form.

Apr. 24, 2017

HPSS Downtime Tuesday, April 25 from 7:00 am - 9:00 am

No Downtime: Yellowstone, Geyser_Caldera, GLADE

Apr. 19, 2017

Users’ /glade/scratch file spaces for the Yellowstone, Geyser, and Caldera clusters have been integrated with the new, larger GLADE scratch system. In this second phase of the GLADE transition, the old scratch space remains available in read-only mode as /glade/scratch_old until June 1. Yellowstone users who have not already done so should copy any scratch files that they want to keep from /glade/scratch_old to /glade/scratch.

As announced previously, /glade/scratch_old will be removed from all systems on June 1. The disk space will be repurposed for use as project space. Please see GLADE File Spaces for more information.

Pages