Long and Short: PAID - Neural Networks

Ivan Soltesz, Stanford University

Usage Details

Ivan Soltesz, Ivan Raikov, Aaron Milstein
The HDF Group has a long and mutually beneficial history with NCSA and the University of Illinois helping to improve the I/O performance of large-scale applications.  In order to optimize the use of the HDF software on the Blue Waters system, the Blue Waters project selected the HDF Group to:
  • Make assessments and improvements for serial and parallel versions of HDF5.
  • Provide expedited resolution of high priority HDF5 defects and performance requirements.
  • Provide active engagement by dedicated HDF5 experts with science teams as they enhance their applications to improve I/O performance.
  • Perform an assessment of an application's needs, consisting of an audit of an application's current I/O use, planning and assessments of potential improvements, and recommendations for further improvements.
  • Support development efforts based on specific applications needs of the science teams on improving the performance of HDF software to meet their application's needs, ranging from providing simple but extremely useful advice, such as better organization of HDF5 files to improve I/O, to extensive projects involving teams of developers.
  • Research and implement trace-based I/O autotuning support with science teams, as appropriate for their needs.
Further information about the project, including information about using HDF5 on Blue Waters, science team support, and science team highlights using HDF5, can be found at: https://ncsa-bw.atlassian.net/wiki/display/HDFBW

 

HDF Survey

Please sign into the portal in order to particiapte in the HDF survery or you will not be able to see the survey URL. All Blue Waters Science and Engineering teams are eligible to participate. 

A survey addressing the I/O usage and needs on Blue Waters of the science and engineering teams was developed by the HDFGroup for the PAID project. This survey is aimed at current and future Blue Waters partnerts in order to assess the current level of knowledge and satisfaction of I/O on Blue Waters. All teams are encourged to fill out the survey. The survey can be found at http://goo.gl/forms/py2k5Xgw4d.  If you experience any problems while completing the survey, please contact help@hdfgroup.org.