Daily Bulletin Archive

August 29, 2019

Users are reminded that they can use POSIX commands to manage their data holdings in the Campaign Storage file system by logging in to CISL’s data-access nodes

The Campaign Storage file system is mounted on the data-access nodes as /glade/campaign to enable users to manage file and directory permissions and to facilitate transfers of small files to and from GLADE spaces such as /glade/scratch and /glade/work. CISL still recommends using Globus for all other data transfers for its reliability, robustness, performance, and ability to validate the correctness of transfers. See our Globus documentation for more information on efficiently transferring files.

CISL has removed world read, write, and execute permissions on all project-level directories – i.e., the directories directly beneath the NCAR Lab and university level – to help protect them from unintended access. Contact cislhelp@ucar.edu to re-open permissions on the directories that you have the authority to do so.

The data-access nodes are intended for data transfers and lightweight tasks such as editing files. Tasks deemed to be consuming excessive resources on the nodes will be killed at the discretion of CISL system administrators.

August 28, 2019

Cheyenne and Casper users can request the addition of software packages on those systems by contacting cislhelp@ucar.edu. They can also install software for their individual use in their own GLADE directories. Users can install Python packages with the NCAR Package Library, for example, or install other software from source.

However, use of the sudo command to install software and perform other operations on Cheyenne and Casper is restricted to authorized users and CISL staff members. See Software for Cheyenne users for additional information.

August 27, 2019

Registration is now open for an NCAR/CISL series of five one-day Fortran workshops beginning Tuesday, September 10. Dan Nagle, CISL Consulting Services Group software engineer and a member of the U.S. Fortran Standards Technical Committee, will provide the training at the NCAR Mesa Lab (Chapman Room) in Boulder.

Participants are encouraged to bring their own laptop computers with recent releases of gfortran, mpich, and opencoarrays. Each workshop will begin at 9 a.m. and end at 4 p.m. with an hour break at noon.

  • Scalar Fortran - Tuesday, Sept. 10: Scope and definition of names, how a Fortran program interacts with the o/s, intrinsic types, inquiry procedures.

  • Vector Fortran - Monday, Sept. 16: Arrays and array operations, rank of an array, inquiry procedures, array intrinsics.

  • Object-Oriented Fortran - Tuesday, Sept. 24: Derived types, operators, assignments, polymorphism.

  • Parallel Fortran - Monday, Sept. 30: Coarrays, solutions to several problems explained in detail.

  • Interoperability with C and handling Floating Point data - Tuesday, Oct. 8: How to write and call libraries written in C  from Fortran; IEEE 754 floating point: rounding modes and exceptions.

Use this form to register to attend one or more workshops. The workshops will not be webcast or recorded.


August 26, 2019

No scheduled downtime: Cheyenne, Casper, Campaign Storage, GLADE, HPSS

August 23, 2019

CISL staff have reserved 144 Cheyenne compute nodes to help accelerate their system troubleshooting efforts. The reservation is scheduled to remain in place until 7 a.m. MDT on Monday but may be extended if necessary.

August 20, 2019

The number of known Cheyenne job failures has decreased significantly since we adjusted several system parameters on August 10, but CISL staff continue to work with HPE, Mellanox, and IBM Level-3 support teams to resolve some remaining performance issues. Please continue to report problems to cislhelp@ucar.edu, especially slow GLADE response times and jobs that fail with MPI_LAUNCH_TIMEOUT errors. If possible, please include job numbers and the full GLADE pathnames of the job standard error and output files. Thank you to everyone who has reported system problems recently.

August 20, 2019

CISL has installed an Arm Forge Pro trial license that enables PAPI-metric support for profiling CPU hardware counters. PAPI counters enable users to examine deep metrics on issues such as branch mispredictions and cache misses that can affect application performance. The trial license unlocks features that are available in Arm Forge 19.1, Cheyenne’s default version. If you find the new metrics are useful, CISL would appreciate your feedback to cislhelp@ucar.edu as we decide whether or not to purchase the features.

August 16, 2019

No scheduled downtime: Cheyenne, Casper, Campaign Storage, GLADE, HPSS

August 16, 2019

Determining the root cause of the recent poor Cheyenne system performance and job failures continues to be at the highest severity level with HPE, Mellanox, and IBM. As CISL staff and the vendors’ Level-3 support teams work to identify the remaining issues, users should continue to report system problems to cislhelp@ucar.edu, including jobs that fail due to MPT launch errors, MPI timeouts, and slow GLADE response times.

August 16, 2019

Use of the sudo command on Cheyenne and other systems that CISL manages is restricted to authorized users and CISL staff members. The command fails and raises a security alert to the system administrators when unauthorized users try to run it – for example, when attempting to install software packages system-wide or to act on other users’ files.

CISL logs such failed attempts and contacts users to offer assistance. If you need help with tasks that you think require sudo privileges, or if you aren’t sure, it is best to contact cislhelp@ucar.edu or call 303-497-2400 before running sudo yourself.