Dec. 17, 2021 — The HDF Group, a non-profit organization with the mission of advancing open source data management technologies, announced the general availability of HDF5 1.13.0, an experimental release of its high performance data software library. The following is an excerpt from a blog post from the HDF Group.
Last week we released HDF5 1.13.0, our first experimental release. You may be wondering what an experimental release means to the community.
We are excited to announce a new strategy of delivering HDF5 features: Experimental Releases. Experimental releases allow us to get major new features into the hands of our users so that they can test the features and provide feedback before we integrate them into a subsequent maintenance release. Our first experimental release, HDF5 version 1.13.0, is now available and features support for VOL connectors, a GPU direct I/O driver, and access to data in Distributed Asynchronous Object Storage (DAOS).
Moving forward, our release schedule will include both experimental and maintenance releases. Under this new approach, odd-numbered minor releases (e.g., HDF5 1.13.x) will be considered experimental releases, while even-numbered minor releases (e.g., HDF5 1.10.x, 1.12.x, 1.14.x) are maintenance releases as you know them now.
Experimental releases allow us to test new features with our users and get feedback while we are working on the development of the next major maintenance release. These experimental releases can include substantial updates, such as changes to the file format, API signatures, or public header files. All HDF5 experimental releases will go through the usual rigorous testing and release process, including the generation of binaries. All features will be complete, tested, stable, and integrated in our development branch. Unlike maintenance releases, binary compatibility should not be expected in an experimental release series (e.g., HDF5 1.13.1 is unlikely to be binary compatible with HDF5 1.13.0). While uncommon, users may also encounter forward/backward file format incompatibility when using new features.
Our future experimental releases are:
- HDF5 1.13.1 (targeted release date mid-2022): Includes new “VFD SWMR” feature that will extend the single-writer/multiple-readers I/O pattern support to all HDF5 API calls (not just dataset I/O, as in the current SWMR implementation) and an improved parallel compression feature that addresses known bugs and scalability issues.
- HDF5 1.13.2: Includes the selection I/O feature that passes the complete I/O requests to the VFD layer, the “sub-filing” feature, which distributes I/O across a collection of sub-files and I/O concentrators in parallel HDF5, and the “onion” VFD, which allows users to track modifications to an HDF5 file and access previous states.
Our next maintenance release, HDF5 1.14.0, starts new series of maintenance releases. It is targeted for release in late 2022 and will contain all the major features listed above. At that time we would like to drop support for 1.8, 1.10 and 1.12. series.
To make HDF5 1.14.0 the best for our users, we would appreciate your feedback (both positive and negative) on the HDF5 1.13.x releases and how they perform for your application. Please send your feedback to [email protected].
Don’t Forget to Tune into Call the Doctor for Free HDF5 Help Each Tuesday
Every Tuesday at 1:00 p.m. CST, The HDF Group hosts Call the Doctor, a session to answer attendee questions and, as time allows, provide helpful tips and tricks for using HDF5 or go over the previous week’s HDF Forum posts. google doc. One-time registration required. If you’ve already registered, no need to register again but consider this your reminder for tomorrow. You can also catch up on all past Call the Doctor sessions on youtube.The HDF Clinics are free sessions intended to help users tackle real-world HDF problems from a common cold to severe headaches and offer relief where that’s possible. As time permits, we will include how-tos, offer advice on tool usage, review your code samples, teach you survival in the documentation jungle, and discuss what’s new or just around the corner in the land of HDF. To participate, please submit questions and topics in this
Tutorial: Constructing a Simple Terminal VOL Connector – January 14, 11:00 a.m – 1:00 p.m. CT. Register here.
About The HDF Group
The HDF Group is a non-profit organization with the mission of advancing state-of-the-art open source data management technologies, ensuring long-term access to the data, and supporting our dedicated and diverse user community. We do this by ensuring the creation of high quality software that addresses user needs and takes advantage of innovations in data management. The HDF Group is the developer of HDF5, a high-performance software library and data format that has been adopted across multiple industries and is the de facto standard in the scientific and research community.
Source: The HDF Group