Discussion
We have just replaced the LTO2 drive in our library with a LTO3 hoping to reduce the number of tapes used and speed up the backup.
It has certaintly reduced the number of tapes with the daily differential ( around 700GB )going from 4 tapes to just 2 but the speed does not have seem to have improved at all. Their maybe an hour or so shaved off but with double to data rate of LTO3 ( around 80mb/s ) we were hoping for more.
Were running Backup Exec 9. Could Bup exec be the cause of the slow backups ? Bit of a long shot really .....
Any help appreciated.
It has certaintly reduced the number of tapes with the daily differential ( around 700GB )going from 4 tapes to just 2 but the speed does not have seem to have improved at all. Their maybe an hour or so shaved off but with double to data rate of LTO3 ( around 80mb/s ) we were hoping for more.
Were running Backup Exec 9. Could Bup exec be the cause of the slow backups ? Bit of a long shot really .....
Any help appreciated.
Edited by nick heppinstall on Thursday 21st June 16:53
i bought an LTO3 drive and as long as it is backing up from the local machine you get good throughput
but over the network very little improvment over an LTO2, i am using arcserve
their support tried everything but couldn't get the speed any better
if you do tape tests and diags you get the throughput but it doesn't transpose to a network
but over the network very little improvment over an LTO2, i am using arcserve
their support tried everything but couldn't get the speed any better
if you do tape tests and diags you get the throughput but it doesn't transpose to a network
You are lucky, a lot of people replace LTO2 with LTO3 and find the performance is worse! 
The problem is that to get the full performance out of modern tape drives you need to keep pumping data to the drive at the rate that will keep the drive streaming. If you drop even 1% below that rate, the drive will "shoe-shine" where the tape has to be stopped, moved back and the drive started up again, which kills the performance. You may be able to tune the backups to get better performance from the LTO3 drive, but unless you are driving it directly from a fast server you are unlikely to get the maximum performance out of the drive. Don't worry about it, even the guys with big IT departments rarely manage to run these drives at full speed.

The problem is that to get the full performance out of modern tape drives you need to keep pumping data to the drive at the rate that will keep the drive streaming. If you drop even 1% below that rate, the drive will "shoe-shine" where the tape has to be stopped, moved back and the drive started up again, which kills the performance. You may be able to tune the backups to get better performance from the LTO3 drive, but unless you are driving it directly from a fast server you are unlikely to get the maximum performance out of the drive. Don't worry about it, even the guys with big IT departments rarely manage to run these drives at full speed.
pcameron said:
You are lucky, a lot of people replace LTO2 with LTO3 and find the performance is worse! 
The problem is that to get the full performance out of modern tape drives you need to keep pumping data to the drive at the rate that will keep the drive streaming. If you drop even 1% below that rate, the drive will "shoe-shine" where the tape has to be stopped, moved back and the drive started up again, which kills the performance. You may be able to tune the backups to get better performance from the LTO3 drive, but unless you are driving it directly from a fast server you are unlikely to get the maximum performance out of the drive. Don't worry about it, even the guys with big IT departments rarely manage to run these drives at full speed.
Beaten to it ... but if I may contribute ...
The problem is that to get the full performance out of modern tape drives you need to keep pumping data to the drive at the rate that will keep the drive streaming. If you drop even 1% below that rate, the drive will "shoe-shine" where the tape has to be stopped, moved back and the drive started up again, which kills the performance. You may be able to tune the backups to get better performance from the LTO3 drive, but unless you are driving it directly from a fast server you are unlikely to get the maximum performance out of the drive. Don't worry about it, even the guys with big IT departments rarely manage to run these drives at full speed.
Top of my head, LTO 3's need to write at a min of 24MB/s, below that they shoe-shine as descripbed above.
Not only does this kill the performance, but also the tape and drive heads, sometimes in a very short time.
We have LTO3s drives, but I'm running LTO2 media in some of them, as I know those systems are unable to write quick enough for LTO3 media.
Interestingly, data from 40ish companies who use StorSentry found that thay the utilisation of the drives was often <20% of what they are capable of.
Fix that, (eg. get your drive writing quicker) and you actually need less drives ...
M
Edited by mph999 on Thursday 21st June 22:51
nick heppinstall said:
Thanks guys. Food for thought their...
Just to echo the comments above, these drives rarely achieve the stated trasfer rate, to do so requires really very optimal circumstances, in my experience this means backing up large files from a fast, unfragmented, local or FC connected disk system.Also differential jobs will run more slowly as the server is seeking changed files, so the time taken for the job to complete is more determined by the speed of the disks and amount of files rather than the actual volume of changed data.
Sounds to me, having read the above, the best way to get the most out of your LTO3 unit(s) would be a big server with large fast disks in an array backed up with as much RAM as you can shoe-horn in to it to act as cache for the tape units. I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).
Or use LTO2 media which is slower speed
Or use LTO2 media which is slower speed

why not get one of these
http://www.inphase-technologies.com/products/media...
and give us all some feedback on how it performs
Holographic data storage, and potentially 1.6TB of uncompressed data per disk
http://www.inphase-technologies.com/products/media...
and give us all some feedback on how it performs

Holographic data storage, and potentially 1.6TB of uncompressed data per disk

ThePassenger said:
Sounds to me, having read the above, the best way to get the most out of your LTO3 unit(s) would be a big server with large fast disks in an array backed up with as much RAM as you can shoe-horn in to it to act as cache for the tape units. I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).
Or use LTO2 media which is slower speed
We have the arrays etc ... and still can't always drive the buggers at the required speed.Or use LTO2 media which is slower speed

Most of our data is on EMC / XP or HDS arrays, all fibre connected incl the drives ...
One solution is to use virtual tape libraries, these work well but are expensive.
The other issue is what you backing up, if it's small files, these go slow anyway.
M
ThePassenger said:
I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).
If it's designed properly and maintained well then there's no reason for it not to. See my continuing employment as evidence of ours doing 24MB+ every night for 5 hours.Agent006 said:
ThePassenger said:
I can't see a network sustaining 24MB/s for an extended period of time (well, I can, but I'm well versed in sods law).
If it's designed properly and maintained well then there's no reason for it not to. See my continuing employment as evidence of ours doing 24MB+ every night for 5 hours.Been there, seen it happen, laughed at the ensuing chaos. It literally took them years of head scratching and all levels of management involvement to fix that one.
Agent006 said:
Like i said, a properly maintained network won't have amateurish issues like that.
Amateur night, pretty much. Funny as hell, most definitely. Yet another lesson in not blindly following procedures as given by IBM's server farms.
Even if the network could have taken the beating, disks are only so fast, even high end SCSI arrays.
ThePassenger said:
even high end SCSI arrays.
No such thing.... 4Gb FC disk loops as a minimum with high end arrays - with a share-nothing crossbar architecture... That said monolitic arrays (eg DMX4500, USP-V 1100 etc) are on the way out - vast grid cluster object based storage (4000+ storage nodes) is the way forward - and boy can they drive stunning IO. But the networking boys are in for a shock 
That said we still struggle to drive our LOT3 SL8500 silos from storagenodes as servers simply don't have the IO throughput and control. Just don't get me started on VTLs and the rubbish spouted about them
but at least a VTL can drive an LTO3.Gassing Station | Computers, Gadgets & Stuff | Top of Page | What's New | My Stuff





).