Daily Bulletin Archive

February 19, 2013

The GLADE file spaces that were mounted on Bluefire, Lynx, and Mirage/Storm are accessible via the Mirage nodes through March 31. Users are responsible for moving files to new locations in the meantime.

The file spaces are mounted on Mirage/Storm with read/write access to permit users to complete some final analysis tasks. They will be set to read-only mode on March 1 to prevent new data from being generated. The Storm cluster will be retired March 1.

Note these details regarding the various file spaces:

* /glade/home :: CISL will retain an off-line copy of the data in home directories for six months after March 31, during which period users will need to contact cislhelp@ucar.edu to access their files.

* /glade/scratch :: The current 30-day retention policy remain in effect. Files will continue to be removed 30 days after last access.

* /glade/user, /glade/proj2, /glade/proj3 :: Files in these spaces will be available until March 31. Users are responsible for migrating files they wish to retain.

On April 1, CISL will remove all remaining data in /glade/scratch, /glade/user, /glade/proj2, /glade/proj3. The bfft.ucar.edu service for transferring files will be turned off at the same time.

For information about how to migrate files to the Yellowstone GLADE file spaces, please see http://www2.cisl.ucar.edu/resources/yellowstone/transition.

If you have questions about the transition, the schedule, or the new systems at NWSC, please contact cislhelp@ucar.edu.

February 8, 2013

Bluefire's /ptmp file system will remain available through February 8. Users can log into Bluefire to access their files; however, Bluefire is no longer accepting or running user jobs. Please note that if Bluefire crashes or goes down unexpectedly in the next week, CISL will not return the system to service.

This opportunity became possible when CISL identified a need to keep some portion of the system powered up temporarily to maintain a minimum heat load for the chillers in the Mesa Lab data center.

Files in the GLADE file spaces on Bluefire will remain accessible via the Mirage cluster nodes through March 31, 2013.

For more information about migrating files to the Yellowstone GLADE file spaces, please see:

·       Transition from Bluefire

·       Bluefire in last week of service

February 1, 2013

The Research Data Archive is now available on the GLADE system for Yellowstone users.

It can be accessed here: /glade/p/rda/data as documented at: Research Data Archive.

February 1, 2013

Bluefire's last day of service will be January 31, 2013. The Bluefire /ptmp file system became read-only on January 14 and will no longer be available after January 31. Users should migrate any files they wish to keep from /ptmp to another location.

Users of the Bluefire, Mirage/Storm, and GLADE disk system in the Mesa Lab should keep the following decommissioning schedule in mind and plan their work accordingly.

For information about making the switch from Bluefire and migrating files to the Yellowstone GLADE file spaces, please see http://www2.cisl.ucar.edu/resources/yellowstone/transition.

MIRAGE & STORM

The Mirage and Storm data analysis and visualization clusters also are being decommissioned. As described below, they will be available for users to wrap up their final analysis tasks in February, and Mirage can be used to migrate data to the Yellowstone environment through the end of March.

Mirage will be shut down April 1. Storm will be shut down March 1.

GLADE FILE SPACES at Mesa Lab

The GLADE file spaces mounted on Bluefire, Lynx, and Mirage/Storm will be accessible until March 31. Users are responsible for moving files to new locations in the meantime.

During February, Bluefire's GLADE file systems will be mounted on the Mirage nodes with read/write access to permit users to complete some final analysis tasks. On March 1, the file systems will be set to read-only mode to prevent new data from being generated. The Mirage nodes will be available to allow users to migrate data.

* /glade/home :: Home directories will be available until March 31. After that point, CISL will retain an off-line copy of the data for six months, during which period users will need to contact cislhelp@ucar.edu to access their files.

* /glade/scratch :: The current 30-day retention policy will remain in effect. Files will continue to be removed 30 days after last access.

* /glade/user, /glade/proj2, /glade/proj3 :: Files in these spaces will be available until March 31. Users are responsible for migrating files they wish to retain.

On April 1, CISL will remove all remaining data in /glade/scratch, /glade/user, /glade/proj2, /glade/proj3. The bfft.ucar.edu service for transferring files will be turned off at the same time.

Please contact cislhelp@ucar.edu if you have questions about the transition, the schedule, or the new systems at NWSC.

February 1, 2013

CISL has deployed the new System Accounting Manager (SAM) application for managing allocations, user preferences, and accounting for use of resources in the Yellowstone environment.

You can visit SAM at http://sam.ucar.edu/ and log in with your UCAR token or password.

Select User -> Preferences to view and set your primary group across CISL resources, your default project for HPSS, and your preferred login shell. These changes typically propagate to the systems the next morning.

Select Reports -> Account Statement to view project information, allocations, and resource activity, including job-level details. Yellowstone and Janus use is reported daily; weekly HPSS usage will begin appearing soon.

SAM is a work in progress. CISL is actively working on improving the user interface and expanding the reporting features, including 30/90 day reporting. If you encounter any errors or if you have any feedback and feature requests, please send them to cislhelp@ucar.edu.

January 25, 2013

After a short outage on Monday morning, Bluefire will be returned to service with the /ptmp file system in read-only mode.

Users should use the rest of January to migrate any files they wish to keep from /ptmp to another location. When Bluefire is shut down at the end of the month, the /ptmp file system will no longer be available.

Please see the following item for more details of the Bluefire transition.

January 25, 2013

With the Yellowstone system now in full production and available to all users, users of the Bluefire, Mirage/Storm, and GLADE disk system in the Mesa Lab should keep the following decommissioning schedule in mind and plan their work accordingly.

Please see http://www2.cisl.ucar.edu/resources/yellowstone/transition for information about making the switch from Bluefire and the various ways to migrate files to the Yellowstone GLADE file spaces.

Please contact cislhelp@ucar.edu if you have questions about the transition, the schedule, or the new systems at NWSC.

BLUEFIRE

Bluefire's last day of service will be January 31, 2013. Users should plan their work accordingly. For making the switch to Yellowstone, CISL has provided Yellowstone transition documentation at https://www2.cisl.ucar.edu/resources/yellowstone/transition.

IMPORTANT: Bluefire's /ptmp file system will only be available through January 31, 2013, when Bluefire is shut down. Users with data in /ptmp must be sure to move files before the end of January. The /ptmp will be made read-only on January 14 to prevent new data from being stored there.

MIRAGE & STORM

The Mirage and Storm data analysis and visualization clusters will be retired on February 28, 2013. The Mirage and Storm clusters will be available for users to wrap up their final analysis tasks in February and to migrate data to the Yellowstone environment through March.

GLADE FILE SPACES at Mesa Lab

The GLADE file spaces mounted on Bluefire, Lynx, and Mirage/Storm will be accessible until March 31, 2013. Users are responsible for ensuring that files are migrated to new locations before the end of this period.

During February 2013, Bluefire's GLADE file systems will be mounted on the Mirage nodes with read/write access to permit users to complete some final analysis tasks. On March 1, 2013, the file systems will be set to read-only mode, to prevent new data from being generated. The Mirage nodes will be available to allow users to migrate data.

* /glade/home :: Home directories will be available until March 31, 2013. After that point, CISL will retain an off-line copy of the data for six months, during which period users will need to contact cislhelp@ucar.edu to access their files.

* /glade/scratch :: The current 30-day retention policy will remain in effect. Files will continue to be removed 30 days after last access.

* /glade/user, /glade/proj2, /glade/proj3 :: Files in these spaces will be available until March 31, 2013. Users are responsible for migrating files they wish to retain.

On April 1, CISL will remove all remaining data in /glade/scratch, /glade/user, /glade/proj2, /glade/proj3. The bfft.ucar.edu service for transferring files will be turned off at the same time.

January 24, 2013

Bluefire users are responsible for migrating any files they need from the Mesa Lab GLADE file system or Bluefire's /ptmp file system to the appropriate Yellowstone GLADE file space.

Currently users must use scp to move files; instructions are available at http://www2.cisl.ucar.edu/resources/yellowstone/quick_start#copy_files. We are working to provide alternate mechanisms before Bluefire is decommissioned.

Please see the GLADE File Spaces for Yellowstone documentation (http://www2.cisl.ucar.edu/resources/glade_yellowstone) when considering where to place files on the new GLADE resource.

If your files are already in HPSS, you can access the files via HSI or HTAR from Yellowstone as well. IMPORTANT: Please do NOT use HPSS as temporary staging area for migrating files, because it is difficult to recover tape space even if the files are deleted.

January 24, 2013

CISL will present a Yellowstone training session from 10 a.m. to noon MST on Friday, Nov. 30. NCAR users can attend in person in the Small Seminar Room at Foothills Lab 2 (FL2-1001). Remote users can attend either via Adobe Connect or webcast. Because of limits on the number of Adobe Connect attendees, NCAR personnel are encouraged to attend in person.

Links for remote participants:

    Adobe Connect: http://meet93561595.adobeconnect.com/ys_nov30
    Live webcast: http://www.fin.ucar.edu/it/mms/fl2-live.htm

Remote participants can submit questions or comments during the session through Adobe Connect or by email to cislhelp@ucar.edu.

January 11, 2013

With Yellowstone now in full production, we wanted to remind all users of Yellowstone, Geyser, and Caldera about the 90-day file retention policy for the NWSC /glade/scratch file space.

Each user has a /glade/scratch/username space by default, with an individual quota of 10 TB. The scratch file space is intended to support output from large-scale capability runs as well as computing and analysis workflows across CISL-managed resources. It is a temporary space for data that will be analyzed and removed within a short amount of time.

Files that have not been accessed in more than 90 days are removed from /glade/scratch/username automatically.

To help us avoid the need to shorten the 90-day retention period, please use this space conscientiously. Delete files that you no longer need as soon as you're done with them rather than leave large amounts of data sitting untouched for the full 90 days.

If /glade/scratch remains significantly above 50% full for more than a week, CISL will review and potentially shorten the 90-day retention period.

Information about all the Yellowstone GLADE file spaces is provided at https://www2.cisl.ucar.edu/resources/glade_yellowstone

Pages