High Performance Computing

HPC and parallel filing systems: How is data transfer possible with large amounts of data?

Parallel filing systems like Lustre are champions of processing huge amounts of data extremely fast. But every champion has a weak spot: For parallel filing systems, it is long-term storage of data. They have been developed for highest parallel performance which requires fast – and therefore expensive – systems. Storing data there for a long time would be very expensive and inefficient. However, this weakness is compensated by the Parallel Data Mover (PDM) by GRAU DATA: It is tailored specifically to the high performance requirements of parallel filing systems and maximizes the copy capacity to backend technologies. By doing this, it allows efficient HSM archives and extremely fast data transfer even with extremely large files.

Advantages of Parallel Data Mover (PDM) at a glance:

Maximizes copy capacity between parallel filing systems and the backend
Unlimited data throughput
Parallel data processing
Not dependent on hardware
High fault tolerance and error handling without disturbing processes
Easy administration

You want to maximize the performance of your parallel filing system? Find out more about the advantages of Parallel Data Mover.

Parallel Data Mover for Lustre

Parallel data transfer from ultra-scalable data sources for maximum data throughput

Discover more

High Performance Computing: Solutions for Storage and Data Migration

Can your data perform better than your IT system allows? Standard filing systems tend to reach their limits when it comes to large data quantities: They do not have the capacities to process the data throughput. The solution: High Performance Computing (HPC). Powerful HPC systems allow you to maximize your IT performance for storing and migrating large amounts of data.

What is High Performance Computing?

Companies and institutions in natural sciences, engineering, medicine or industrial areas deal with enormous amounts of data that would simply demand too much of standard filing systems: The number of files per filing system is limited and the goodput does not suffice when it comes to large files. Filing systems reach their limits and therefore avert effective work with the data. Organizations need High Performance Computing (HPC), especially high-performance computer systems, to overcome these boundaries.

HPC and Storage: How can you archive huge amounts of data?

Standard filing systems are long overchallenged with the large amounts of data in companies and institutions these days. To burst all limits of data storage, high-performance filing systems have become necessary. The Parallel Data Mover (PDM) was developed to save data in extremely high speed from parallel file systems to backend archives at extremely high speeds.

Do you want to overcome the boundaries of your data storage and use the full potential of your data? Find out more about Parallel Data Mover.

- HIGH PERFORMANCE COMPUTING -