Daily Bulletin Archive

September 12, 2019

CISL has introduced new tools to support unattended workflows using the Globus command line interface: long-lived InCommon certificates and the Globus Campaign Storage interface (gci) utility. The gci utility streamlines transfers between the GLADE and Campaign Storage file systems. It automatically detects the presence of a valid certificate and reactivates the NCAR GLADE and Campaign Storage endpoints when necessary, eliminating the need for manual authentication. Another new CISL utility – gcert – simplifies the process of setting up the certificate. 

See Configuring Globus for unattended workflows for more information on the gci and gcert utilities and InCommon Certificates. Interested users can request an InCommon Certificate by contacting cislhelp@ucar.edu.

September 9, 2019

CISL will preview the new Jira Service Desk ticket system at 2 p.m. Tuesday, September 17, in the Main Seminar Room at the Mesa Lab in Boulder. Participants who are unable to attend in person can see the presentation and submit questions via webcast at this URL.

The presentation will include a brief overview followed by a live demonstration of how to use the NCAR Research Computing portal to get help with Cheyenne, Casper, and related data-storage systems such as GLADE and Campaign Storage.

The Staff Support portal will have similar features for use by CISL personnel and NCAR directorate staff who need workstation support and by UCAR staff who need support for enterprise IT services operated by CISL. UCAR staff already use it to request help with UCAR IT services and business applications.

The presentation will be recorded and published online. As announced previously, CISL will begin using the new system on Tuesday, October 1.

September 6, 2019

CISL is now accepting large-scale allocation requests from university-based researchers for the 5.34-petaflops Cheyenne supercomputer and the Casper data analysis and visualization cluster. Submissions are due September 10. Researchers are encouraged to review these allocation instructions before preparing their requests.

In addition to requesting computing allocations, university projects should request long-term space on the NCAR Campaign Storage resource instead of HPSS. Unlike HPSS, Campaign Storage has no default minimum amount; users are asked to justify the amount requested. The CISL HPC Allocations Panel (CHAP) continues to closely scrutinize data management plans and storage requests, especially when proposals request a substantial portion of the storage capacity available to allocate.

At the fall meeting, CISL will allocate up to 340 million core-hours on Cheyenne, up to 2 PB of Campaign Storage space, and up to 200 TB of GLADE project space. Large allocations on Cheyenne are those requesting more than 400,000 core-hours. CISL accepts requests from university researchers for these large-scale allocations every six months. Please contact cislhelp@ucar.edu if you have any questions.

September 4, 2019

CISL will transition to using the Jira Service Desk ticket system on Tuesday, October 1, to help users quickly find the information or assistance they need. Users of high-performance computing (HPC) systems and UCAR staff will get support through new “NCAR Research Computing” and “Staff Support” portals respectively.

NCAR Research Computing portal

Through the NCAR Research Computing portal, the CISL User Services Section and High-end Services Section will support staff and external HPC users who need help working with Cheyenne, Casper, and related data-storage systems such as GLADE and Campaign Storage.

Staff Support portal

UCAR staff who need support for enterprise IT services operated by CISL, as well as CISL personnel and NCAR directorate staff who need workstation support, will use the Staff Support portal. UCAR staff already use it to request help with UCAR IT services and business applications.

The new system features a friendly user interface, simple request forms, and knowledge base articles that answer common questions. It will replace the ExtraView ticketing system for all but a few internal purposes (including NETS requests that will still use netshelp@ucar.edu). Users will log in with their UCAR usernames and CIT passwords, but can continue to request help by emailing cislhelp@ucar.edu at this time. Those who do not have CIT passwords can request them by email or by calling 303-497-2400.

Additional information on implementation and training opportunities will be available soon.

August 29, 2019

CISL will be releasing a new version of the PBS Pro qstat command that is designed to give HPC users more information about job status while putting less strain on the job scheduler and workload manager. The fully functioning qstat command was disabled in 2018 because its heavy use adversely affected overall system performance. The reduced resource requirements of the new version allow us to provide complete job listings again, although users can still limit the command’s output by specifying a job ID or their username.

Information from the PBS server is cached every minute, so listings will be updated at least every minute. Using the -f option to get a full listing still queries the PBS scheduler, so CISL asks that users run such full-listing operations sparingly. Run qstat -h to see all supported options.

The new version of qstat will be released on Wednesday, September 4, and it will be available in Cheyenne’s default user environment – that is, when the ncarenv module is loaded. It will also be available on Casper, unlike other PBS commands.

August 29, 2019

Users are reminded that they can use POSIX commands to manage their data holdings in the Campaign Storage file system by logging in to CISL’s data-access nodes

The Campaign Storage file system is mounted on the data-access nodes as /glade/campaign to enable users to manage file and directory permissions and to facilitate transfers of small files to and from GLADE spaces such as /glade/scratch and /glade/work. CISL still recommends using Globus for all other data transfers for its reliability, robustness, performance, and ability to validate the correctness of transfers. See our Globus documentation for more information on efficiently transferring files.

CISL has removed world read, write, and execute permissions on all project-level directories – i.e., the directories directly beneath the NCAR Lab and university level – to help protect them from unintended access. Contact cislhelp@ucar.edu to re-open permissions on the directories that you have the authority to do so.

The data-access nodes are intended for data transfers and lightweight tasks such as editing files. Tasks deemed to be consuming excessive resources on the nodes will be killed at the discretion of CISL system administrators.

August 28, 2019

Cheyenne and Casper users can request the addition of software packages on those systems by contacting cislhelp@ucar.edu. They can also install software for their individual use in their own GLADE directories. Users can install Python packages with the NCAR Package Library, for example, or install other software from source.

However, use of the sudo command to install software and perform other operations on Cheyenne and Casper is restricted to authorized users and CISL staff members. See Software for Cheyenne users for additional information.

August 27, 2019

Registration is now open for an NCAR/CISL series of five one-day Fortran workshops beginning Tuesday, September 10. Dan Nagle, CISL Consulting Services Group software engineer and a member of the U.S. Fortran Standards Technical Committee, will provide the training at the NCAR Mesa Lab (Chapman Room) in Boulder.

Participants are encouraged to bring their own laptop computers with recent releases of gfortran, mpich, and opencoarrays. Each workshop will begin at 9 a.m. and end at 4 p.m. with an hour break at noon.

  • Scalar Fortran - Tuesday, Sept. 10: Scope and definition of names, how a Fortran program interacts with the o/s, intrinsic types, inquiry procedures.

  • Vector Fortran - Monday, Sept. 16: Arrays and array operations, rank of an array, inquiry procedures, array intrinsics.

  • Object-Oriented Fortran - Tuesday, Sept. 24: Derived types, operators, assignments, polymorphism.

  • Parallel Fortran - Monday, Sept. 30: Coarrays, solutions to several problems explained in detail.

  • Interoperability with C and handling Floating Point data - Tuesday, Oct. 8: How to write and call libraries written in C  from Fortran; IEEE 754 floating point: rounding modes and exceptions.

Use this form to register to attend one or more workshops. The workshops will not be webcast or recorded.


August 26, 2019

No scheduled downtime: Cheyenne, Casper, Campaign Storage, GLADE, HPSS

August 23, 2019

CISL staff have reserved 144 Cheyenne compute nodes to help accelerate their system troubleshooting efforts. The reservation is scheduled to remain in place until 7 a.m. MDT on Monday but may be extended if necessary.