Performance Evaluation of High-Performance and Flexible Protocol on Data Mover Challenge

Pavarangkoon, Praphan; Murata, Ken T.; Yamamoto, Kazunori; Fujita, Naoyuki; Ohkawa, Hirofumi; Mikai, Hidekazu; Ikehata, Yosuke; Muranaga, Kazuya; Mizuhara, Takamichi; Takaki, Ayahiro; Kakizawa, Yasunori

doi:10.1109/InCIT50588.2020.9310956

Performance Evaluation of High-Performance and Flexible Protocol on Data Mover Challenge

Author(s)

Pavarangkoon, Praphan

Murata, Ken T.

Yamamoto, Kazunori

Fujita, Naoyuki

Ohkawa, Hirofumi

Mikai, Hidekazu

Ikehata, Yosuke

Muranaga, Kazuya

Mizuhara, Takamichi

Takaki, Ayahiro

Kakizawa, Yasunori

Date Issued

October 21, 2020

Type

Conference Paper

DOI

10.1109/InCIT50588.2020.9310956

Abstract

Data mover challenge (DMC) for Supercomputing Asia organized by the National Supercomputing Centre (NSCC), Singapore is a competition for data transfer node (DTN) architecture. This challenge invites experts from academia and industry to test their software and products on advanced 100G research and education networks. The theme for DMC20 is data for science, which focuses on moving the large amounts of data between multiple sites with DTNs and between high performance computing (HPC) centers around the world. In this paper, we present performance evaluation of data transfer protocol, called high-performance and flexible protocol (HpFP), on DMC20. The data transfer tests are done using high-performance copy (HCP), which is an enhanced HpFP-based file transfer tool. The results show that the HpFP outperforms the traditional protocol on scenario with high packet loss. Tuning parameters and problems are discussed to improve the performance of our file transfer tool as well.

Citation

Incit 2020 5th International Conference on Information Technology, 265-269, 2020