New Report from the Benchmarking Working Group

Posted by & filed under Reports.

I/O Characterization of Large-Scale HPC Centers — Benchmarking Working Group, OpenSFS (PDF)

The  OpenSFS  Benchmarking  Working  Group  (BWG)  was  created  with  the  intent  of  defining  an  I/O  benchmark suite to satisfy the requirements of the scalable parallel file system users and facilities. The  first step toward this end was identified as characterization of I/O workloads, from small scale to very large scale parallel file systems, deployed at various highCperformance and parallel computing (HPC) facilities  and  institutions.  The  characterization  will  then  drive  the  design  of  the  I/O  benchmarks  that  emulate  these workloads.

As part of the characterization, the BWG released a survey at the Supercomputing Conference in 2012,  to  solicit  participation  and  collect  data  on  file systems  and  workloads  in  HPC  centers.  This  paper  summarizes the data collected and our analysis.

Lustre Strategy Survey Open

Posted by & filed under Survey.

The OpenSFS Community Development Working Group is gathering data from organizations using Lustre in order to develop a long-term support strategy recommendation going forward. We want to ensure that future Lustre releases are well-aligned with the needs of the Lustre community.

Please complete this short survey to make sure that your organization’s voice is heard!
https://www.surveymonkey.com/s/P3HFY7R

Note that all questions are optional you may submit a partially completed survey if you prefer.

SuperComputing 2013

Posted by & filed under Events.

OpenSFS and the Lustre Community were at Supercomputing 2013 (SC’13) in Denver, November 18-21.

Presentations from our BoF session and related talks on the SC’13 show floor will be posted shortly.

More…

Lustre 2.5.0

Posted by & filed under Releases.

The Lustre® Community Development Working Group (CDWG) is pleased to announce that the Lustre 2.5.0 Release is now available for download. The source code is also available from git.
This major release includes a number of new features:

  • Hierarchal Storage Management (HSM) (LU-3608) – allows data to be transferred between different storage types
  • Extended Attribute Cache (Xattr Cache) (LU-2869) – improved performance when reading extended attributes

Fuller details can be found in the change log, the scope statement and the test matrix. The following are known issues in the Lustre 2.5.0 Release:

  • LU-3833 : HSM does not check whether a file is sparse before archiving which could lead to unexpected results
  • LU-4152 : Under rare access patterns while re-exporting NFS it is possible that MDT threads might block until external action is performed on a file
  • LU-4159 : Lustre 2.4.x clients are unable to access a released file

Work is in progress for these issues and it is likely that these will be addressed in the 2.5.1 release scheduled for Q1 2014.

Please log any issues found in this release at the issue tracking website

We would like to thank OpenSFS for their contributions towards the cost of this release, and also to all Lustre community members who have contributed to the release with code and/or testing.

— October 30, 2013

LUG 2014 Miami

Posted by & filed under Events, User Group.

OpenSFS is happy to announce that LUG 2014 will be held in Miami, Florida, from April 8-10, 2014.

Read the complete announcement here.