Daily Bulletin Archive

May 15, 2014

Following the GLADE outage yesterday, Yellowstone was returned to service around 4:30 p.m. MT with only the /glade/u (home directories) and /glade/scratch file systems mounted on the Yellowstone, Geyser and Caldera clusters.

There is currently a tremendous opportunity for users to make use of Yellowstone. User jobs should run as usual, as long as they do not try to access files in /glade/p project spaces or the /glade/p/work directories.

Attempts to access files in /glade/p will return error messages such as "No such file or directory" until /glade/p is remounted.

CISL is working with IBM, which has staff on site, to resolve the file system issue as soon as possible. At this time we have no estimate for when /glade/p will be available.

May 9, 2014

CISL recently asked HPSS users who had data stored on media called "B-tapes" to review those data to consider if any could be deleted rather than migrated to new tape library media. If you have already reviewed such holdings, thank you. If you have not yet done your review, please do so. Removing unnecessary files reduces your ongoing storage charges, accelerates the migration to new storage media, and lowers overall data storage and management costs.

To determine if any of your data are stored on B-tapes, see HPSS B-tape files. Because of the high cost of updating the B-tape lists, deletions that you have done already will not be reflected in the B-tape listings.

Contact cislhelp@ucar.edu if you need help moving or deleting large numbers of files.

May 6, 2014

The WRF Users' Workshop will take place June 23-27. Papers focusing on development and testing in all areas of model applications are especially encouraged. The early registration deadline is June 8. The deadline for submitting short abstracts is May 2 and extended abstracts will be due June 16. Authors may request either a poster or oral presentation, although posters are encouraged due to time constraints for oral sessions. The workshop will open June 23 with a half-day session on best practices for applying WRF, WRFDA, and WRF Chem and will close on June 27 with six tutorials. See WRF Users' Workshop for details.

May 6, 2014

Due to the number of users submitting production jobs to Yellowstone's 'small' queue -- which is intended for interactive use, debugging, and testing only -- the charging factor for the small queue will be increased to 1.5 on May 2. That is, 'small' queue jobs will be charged 1.5 times their standard core-hour cost.

The small queue will remain available for its intended purposes. Users not requiring such capabilities will be better served by the 'premium' queue, which is also charged 1.5 times the standard core-hour cost.

May 2, 2014

The default settings of the sort program on many Linux systems, including Yellowstone, cause it to ignore many non-alphanumeric characters. This can cause unexpected behavior, especially when you are sorting directory/file paths. To prevent this from happening, set the LC_COLLATE environment variable to C as follows; note that doing so may affect other Linux programs.

  • For tcsh users: setenv LC_COLLATE C
  • For bash users: export LC_COLLATE=C

Users who receive lists of orphan files from CISL do not need to do this because those lists are properly sorted to begin with.

April 21, 2014

An XSEDE workshop May 7 and 8 will give C and Fortran programmers a hands-on introduction to MPI programming. Attendees will leave with a working knowledge of how to write scalable codes using MPI – the standard programming tool of scalable parallel computing. The workshop is not available via webcast but will be telecast to several satellite sites. See the XSEDE portal for details.

April 21, 2014

A new data-sharing service enables users of NCAR's Yellowstone HPC system for scientific computing to share files with colleagues and others who do not have NCAR user accounts. Through the new Globus Plus service, users who have access to NCAR storage resources such as GLADE and HPSS can copy files to shareable Globus endpoints. Individuals with whom files are shared do not need NCAR user accounts or tokens to retrieve the shared data; they only need to have Globus accounts.

Globus Plus is an extension of the Globus file-transfer system, which CISL recommends for making large-scale data transfers into and out of GLADE.

If you are interested in using the data-sharing service, please contact us via cislhelp@ucar.edu to request access.

April 16, 2014

The upgrade work last week was successful, and the system is now running user jobs. We recommend that users recompile codes before running, though some applications may run without recompilation.

Along with the software upgrades, 5 PB of extra disks was installed in the GLADE racks. The GLADE team will be working over the next few weeks to integrate the new capacity into the file systems.

April 14, 2014

To ensure that Yellowstone is running the most current and supported versions of key system software, CISL staff will be upgrading the Yellowstone environment to Red Hat Enterprise Linux version 6.4 from the current version 6.2. Starting at 6 a.m. Mountain Time, April 7, the update is expected to take seven days due to the extensive nature of the upgrades, which include system software and firmware on Yellowstone, Geyser, Caldera, and the GLADE servers and firmware on the Mellanox InfiniBand switches, as well as the impacts to user applications and libraries.

We intend to release user jobs on the Yellowstone, Geyser, and Caldera clusters at 8 a.m. Monday, April 14. We expect to give users access to the Yellowstone login nodes over the weekend of April 12-13. HPSS will remain up throughout the week of the upgrade.

Because of the extent of the changes, we recommend that users recompile their codes before submitting jobs after the upgrade. There is also a chance that users who have saved custom module environments may experience problems. If you encounter issues with modules, please see the documentation at https://www2.cisl.ucar.edu/resources/yellowstone/access_userenvironment/modules.

CISL consultants will be taking the opportunity to remove older software versions to simplify the standard modules environment. Users with needs for older software versions will be supported outside the default environment.

We will make every effort to complete this upgrade ahead of schedule and to return services to users as quickly as possible.

April 11, 2014

Due to SEA workshop and Yellowstone, Geyser and Caldera upgrade this week consulting walk-in service will remain closed. You may continue to submit tickets and we will get to those as time permits from our SEA workshop engagement. We thank you for your understanding.