Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.
Table of Contents
maxLevel2
outlinetrue
stylenone

HPSS Prod2 Setup

hpss prod2 is a new HPSS setup that employs 1TB T10K data cartridges. The prod2 setup has

...

 

first access

second access

delta

<ac:structured-macro ac:name="unmigrated-wiki-markup" ac:schema-version="1" ac:macro-id="43845d0a274718fc-92d86d5e-4e564962-b321a803-65f56519b2b35378e64cdc1c"><ac:plain-text-body><![CDATA[

file size

elapsed [s]

elapsed [s]

[s]

]]></ac:plain-text-body></ac:structured-macro>

31680

115

2

113

555840

107

2

105

1167944991

122

13

109

28304089310

600

307

293

23764091017

488

257

231

...

Four files were read from the same tape. All file were between 1.1GB to 1.5 GB large. For the first file (most likely) the tape had to be remounted. The file was read twice the first time from disk and the second time from the disk cache. The figure below shows the effective transfer rates for the transfers and the time difference between reading from tape and disk (first-second). The position of the files on tape is also shown.

Reading sequentially all files from a tape

All 377 files were read from the tape H0000700, except the first file as this one was split across two tapes. One client was used to read the file sequentially. The checksum and size of the transfered files matched the ones obtained from the xrootd cluster.
The lower figure below shows the elapsed time for each transfer versus the file size. The blue line shows the relation between elapsed time and file size to be:

elap = 1.5s * sizeMB / 45MB/s

The 1.5 as well as the 45 approximate values.
The upper figure shows the elapsed time subtracted by the expected transfer time. The expected transfer time was assumed to be the file size divided by 45MB/s.

Image Added