LTO2 and LTO3
Author
Discussion

nick heppinstall

Original Poster:

9,108 posts

311 months

Thursday 21st June 2007
quotequote all
We have just replaced the LTO2 drive in our library with a LTO3 hoping to reduce the number of tapes used and speed up the backup.

It has certaintly reduced the number of tapes with the daily differential ( around 700GB )going from 4 tapes to just 2 but the speed does not have seem to have improved at all. Their maybe an hour or so shaved off but with double to data rate of LTO3 ( around 80mb/s ) we were hoping for more.

Were running Backup Exec 9. Could Bup exec be the cause of the slow backups ? Bit of a long shot really .....

Any help appreciated.

Edited by nick heppinstall on Thursday 21st June 16:53

Agent006

12,058 posts

295 months

Thursday 21st June 2007
quotequote all
How are you getting the data to the backup server? We get just over 3GB/min over 1gbps LAN onto LTO2. Have had issues in the past with insuficcient RAM in the server causing a bottleneck.

spivvy

1,535 posts

285 months

Thursday 21st June 2007
quotequote all
i bought an LTO3 drive and as long as it is backing up from the local machine you get good throughput
but over the network very little improvment over an LTO2, i am using arcserve

their support tried everything but couldn't get the speed any better

if you do tape tests and diags you get the throughput but it doesn't transpose to a network

pcameron

101 posts

313 months

Thursday 21st June 2007
quotequote all
You are lucky, a lot of people replace LTO2 with LTO3 and find the performance is worse! wobble

The problem is that to get the full performance out of modern tape drives you need to keep pumping data to the drive at the rate that will keep the drive streaming. If you drop even 1% below that rate, the drive will "shoe-shine" where the tape has to be stopped, moved back and the drive started up again, which kills the performance. You may be able to tune the backups to get better performance from the LTO3 drive, but unless you are driving it directly from a fast server you are unlikely to get the maximum performance out of the drive. Don't worry about it, even the guys with big IT departments rarely manage to run these drives at full speed.

mph999

2,780 posts

251 months

Thursday 21st June 2007
quotequote all
pcameron said:
You are lucky, a lot of people replace LTO2 with LTO3 and find the performance is worse! wobble

The problem is that to get the full performance out of modern tape drives you need to keep pumping data to the drive at the rate that will keep the drive streaming. If you drop even 1% below that rate, the drive will "shoe-shine" where the tape has to be stopped, moved back and the drive started up again, which kills the performance. You may be able to tune the backups to get better performance from the LTO3 drive, but unless you are driving it directly from a fast server you are unlikely to get the maximum performance out of the drive. Don't worry about it, even the guys with big IT departments rarely manage to run these drives at full speed.
Beaten to it ... but if I may contribute ...

Top of my head, LTO 3's need to write at a min of 24MB/s, below that they shoe-shine as descripbed above.
Not only does this kill the performance, but also the tape and drive heads, sometimes in a very short time.

We have LTO3s drives, but I'm running LTO2 media in some of them, as I know those systems are unable to write quick enough for LTO3 media.

Interestingly, data from 40ish companies who use StorSentry found that thay the utilisation of the drives was often <20% of what they are capable of.

Fix that, (eg. get your drive writing quicker) and you actually need less drives ...

M

Edited by mph999 on Thursday 21st June 22:51

nick heppinstall

Original Poster:

9,108 posts

311 months

Friday 22nd June 2007
quotequote all
Thanks guys. Food for thought their...

theboss

7,555 posts

250 months

Friday 22nd June 2007
quotequote all
nick heppinstall said:
Thanks guys. Food for thought their...
Just to echo the comments above, these drives rarely achieve the stated trasfer rate, to do so requires really very optimal circumstances, in my experience this means backing up large files from a fast, unfragmented, local or FC connected disk system.

Also differential jobs will run more slowly as the server is seeking changed files, so the time taken for the job to complete is more determined by the speed of the disks and amount of files rather than the actual volume of changed data.

ThePassenger

6,962 posts

266 months

Friday 22nd June 2007
quotequote all
Sounds to me, having read the above, the best way to get the most out of your LTO3 unit(s) would be a big server with large fast disks in an array backed up with as much RAM as you can shoe-horn in to it to act as cache for the tape units. I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).

Or use LTO2 media which is slower speed smile

Marki

15,763 posts

301 months

Friday 22nd June 2007
quotequote all
nick heppinstall said:
We have just replaced the LTO2 drive in our library with a LTO3 hoping to reduce the number of tapes used and speed up the backup.
Dont worry Mate LTO4 is shipping now hehe

Puggit

49,832 posts

279 months

Friday 22nd June 2007
quotequote all
There is some software that uses disk cache to help buffer the drives and remove shoe-shining.

Veritas NBU and Atempo TimeNavigator are 2 I can think of (and have sold in the past wink).

Gateway Networks

89 posts

236 months

Friday 22nd June 2007
quotequote all
why not get one of these
http://www.inphase-technologies.com/products/media...

and give us all some feedback on how it performs smile

Holographic data storage, and potentially 1.6TB of uncompressed data per disk smile

ChristianZS

2,640 posts

244 months

Friday 22nd June 2007
quotequote all
We have an LTO3 autoloader which is running at half speed currently. Its due to the raid card in the server. It maybe worth checking to see if yours is a 180 as thats the slower one.. Try a 320 controller, Might be much faster.

mph999

2,780 posts

251 months

Friday 22nd June 2007
quotequote all
ThePassenger said:
Sounds to me, having read the above, the best way to get the most out of your LTO3 unit(s) would be a big server with large fast disks in an array backed up with as much RAM as you can shoe-horn in to it to act as cache for the tape units. I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).

Or use LTO2 media which is slower speed smile
We have the arrays etc ... and still can't always drive the buggers at the required speed.

Most of our data is on EMC / XP or HDS arrays, all fibre connected incl the drives ...
One solution is to use virtual tape libraries, these work well but are expensive.
The other issue is what you backing up, if it's small files, these go slow anyway.

M

Agent006

12,058 posts

295 months

Friday 22nd June 2007
quotequote all
ThePassenger said:
I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).
If it's designed properly and maintained well then there's no reason for it not to. See my continuing employment as evidence of ours doing 24MB+ every night for 5 hours.

The Griffalo

72,863 posts

270 months

Friday 22nd June 2007
quotequote all
How is the drive connected? A dedicated adapter or shared?

ThePassenger

6,962 posts

266 months

Friday 22nd June 2007
quotequote all
Agent006 said:
ThePassenger said:
I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).
If it's designed properly and maintained well then there's no reason for it not to. See my continuing employment as evidence of ours doing 24MB+ every night for 5 hours.
As I said, sods law, you're backups are rocking along nicely and another machine's cron entry jumps up and starts flinging data around (or two or three hundred... depends on how many are still running the boss build image).
Been there, seen it happen, laughed at the ensuing chaos. It literally took them years of head scratching and all levels of management involvement to fix that one.

Agent006

12,058 posts

295 months

Saturday 23rd June 2007
quotequote all
Like i said, a properly maintained network won't have amateurish issues like that.

ThePassenger

6,962 posts

266 months

Saturday 23rd June 2007
quotequote all
Agent006 said:
Like i said, a properly maintained network won't have amateurish issues like that.
Amateur night, pretty much. Funny as hell, most definitely.
Yet another lesson in not blindly following procedures as given by IBM's server farms.

Even if the network could have taken the beating, disks are only so fast, even high end SCSI arrays.

tvrforever

3,196 posts

296 months

Sunday 24th June 2007
quotequote all
ThePassenger said:
even high end SCSI arrays.
No such thing.... 4Gb FC disk loops as a minimum with high end arrays - with a share-nothing crossbar architecture... That said monolitic arrays (eg DMX4500, USP-V 1100 etc) are on the way out - vast grid cluster object based storage (4000+ storage nodes) is the way forward - and boy can they drive stunning IO. But the networking boys are in for a shock smile

That said we still struggle to drive our LOT3 SL8500 silos from storagenodes as servers simply don't have the IO throughput and control. Just don't get me started on VTLs and the rubbish spouted about them frown but at least a VTL can drive an LTO3.