HPSS Prod2 Setup
hpss prod2 is a new HPSS setup that employs 1TB T10K data cartridges. The prod2 setup has
- four tape drives
- two data movers each
- 1Gb Ethernet per mover
- Fibre Channel connection to tape drives
- About a total of 5TB
disk cache.
The data movers use 1GbE to connect to the network and Fibre Channel to connect to the tape drives.
Transferring a single
About 100GB of single files were transfered from one data server to HPSS. The transfer rate is about 55MB/s for larger files (> 100MB/s). For files below 100 MB rate measurement was accurate as the time resolution was only 1s.
Transfer 8TB of data (test 20090909)
About 8TB of data was transfered from eight servers (~1TB/server). After about 10h transfers started to fail because the disks on the movers were filled. At that time 6.5 TB were transfered.
FGST servers used |
8 |
total number of files |
3359 |
total size |
8.09 TiB |
transfers failed |
534 |
The average transfer rate from disk to tape was about 78MB/s. Only one tape drive at a time was allowed for writing
and therefore files cold not be copied fas enough to tape and the cache disks filled up.
Transfer 8TB of data (test 20091007)
Another test transferring about 8TiB of data was done. This time three out of the four HPSS tape drivers were allowed for writing. The 8TiB of data were spread over eight data servers and the migration to HPSS was running in parallel on all eight servers. Below are some stats for the transfers:
FGST servers used |
8 |
total number of files |
3664 |
total size |
8.06 TiB |
time of transfer |
13:50 h |
rate |
~169 MiB/s |
transfers failed |
0 |
While the transfers were running the network IO and (for some time) the disk IO on the two HPSS movers were recorded.
The HPSS instance has two disk arrays that are accessed by both movers and show up as devices sdc and sdd.
The disk IO was not monitored during the first 7:30 hours therefore no data are shown for this time in the disk IO plots.