what is the fastest possible upload connection???

what is the fastest possible upload connection???

Author
Discussion

sonic_2k_uk

4,007 posts

207 months

Friday 2nd July 2010
quotequote all
Jpg files are already compressed so you're not going to save much if any space compressing them before hand. The compression process would also take quite a while without some beefy servers.

As for upload, in a rural location you're realistically looking at bonded DSL without spending a considerable amount of money.

Someone mentioned checking that your host will provide the disk space requirements, this is a *very* good idea if you're looking to upload and process ~8GB per day.

Do you need the original 1.5mb image files on the server then, or are they just there to be processed by the scripts and output smaller image? If so, as other people have recommended, i'd look to resize them locally and then upload. This will save a considerable amount of time and remote server requirements.

We provide a colo VM backup solution for several customers. This started with them bringing in physical media with several hundred GB of data every week, and then moved onto an automatic backup process through their leased line, uploading at ~30mb/s.

The result of this was a very expensive additional bandwidth bill from the data centre for going way over the agreed 95th percentile bandwidth figure agreed, so i'd check with the host what any additional charge would be for uploading at 8mb/s for 8 or more hours on a daily basis.

leeb

Original Poster:

1,074 posts

243 months

Friday 2nd July 2010
quotequote all
Some definate food for thought in there, thank you. I know what my weekend is now going to consist of. Lots of research and conversations with developers.


mrmr96

13,736 posts

204 months

Friday 2nd July 2010
quotequote all
I pay £24.99 pcm for this:

It's "BT Infinity" which is basically fibre to the cabinet and then copper to my door. See here: http://www.bt.com/infinity

HTH.

RobCrezz

7,892 posts

208 months

Friday 2nd July 2010
quotequote all
Also look into BTNet. Up to 100mb if its in your area.

ukwill

8,911 posts

207 months

Friday 2nd July 2010
quotequote all
mrmr96 said:
I pay £24.99 pcm for this:

It's "BT Infinity" which is basically fibre to the cabinet and then copper to my door. See here: http://www.bt.com/infinity

HTH.
That's a decent offering from BT, however you have to consider the contention ratio (50:1) if you are intending to do continuous uploading over an extended period.

dilbert

7,741 posts

231 months

Friday 2nd July 2010
quotequote all
I don't think it's possible to upload 500 1.5Mbyte images in 15 mins on a 300Kbit link. That's an order of magnitude, and perhaps two orders of magnitude, out.

You must already have your numbers wrong, or you have a better connection than you are saying.

The sorts of rates you want are the preserve of backbone technologies.

DVD's, CD's and other physical media are quite effective for the price.

To get a 100Mbit connection it's all about where you are in the country, and I don't mean rural. More, it's where exactly in the city you are. You can extend this yourself by putting up a private microwave link. Typically it joins your rural area to the prime city location. It's cost effective. You merely rent space for an antenna and transmitter, rather than a whole office.

The only other alternative is multiple DSL lines and software to pump the data automatically over longer time periods.

Satellite is out. It takes a whole small satellite to offer just a single channel of this kind of capability. In practical terms you're talking hundreds of millions of pounds. If one were to offer such a service widely the satellite would have to be bigger, and much more expensive. The cost doesn't work out.

Satellite communications like this are the preserve of the military. Broadcast is one way only. Voice channels (telephone) are very narrow.

Long term, a radio link makes most sense, but the initial cost is high, perhaps tens of thousands. Then there's software and ADSL which is thousands. Finally DVD/CD which is hundreds.


bogie

16,386 posts

272 months

Friday 2nd July 2010
quotequote all
ukwill said:
mrmr96 said:
I pay £24.99 pcm for this:

It's "BT Infinity" which is basically fibre to the cabinet and then copper to my door. See here: http://www.bt.com/infinity

HTH.
That's a decent offering from BT, however you have to consider the contention ratio (50:1) if you are intending to do continuous uploading over an extended period.
that would be throttled within about 1 day if the OP used it as intended, and the "fair usage policy" card would come out frown

lestag

4,614 posts

276 months

Friday 2nd July 2010
quotequote all
dilbert said:
Long term, a radio link makes most sense, but the initial cost is high, perhaps tens of thousands.
Two netgear access points
two yagi aerials
some low loss cable

== 20km line of site radio link
prob 5k

plus whatever service it hooks into at the other end
Done this twice

dilbert

7,741 posts

231 months

Friday 2nd July 2010
quotequote all
lestag said:
dilbert said:
Long term, a radio link makes most sense, but the initial cost is high, perhaps tens of thousands.
Two netgear access points
two yagi aerials
some low loss cable

== 20km line of site radio link
prob 5k

plus whatever service it hooks into at the other end
Done this twice
Its the site rental that's the expensive bit. I think too that a WiFi system might have some availability/reliability/maintainability issues!

chris.mapey

4,778 posts

267 months

Friday 2nd July 2010
quotequote all
Are *you* generating 5000 images per day?

If they are generated from a network of photographers, surely it would be better to issue them with the software to batch process and upload locally rather than sending to you, and you uploading 5000 per day?

Could be an avenue to look at?

paddyhasneeds

51,214 posts

210 months

Friday 2nd July 2010
quotequote all
leeb said:
Currently takes e approx 15mins to upload 500 images, which is just too long to be honest.
That doesn't sound right.

Can you confirm 100% the numbers involved, both number of photos, and size of average photo (look at the properties and copy the exact size as displayed).

500 photos at 1.5mb each is 800mb and you're not going to be uploading 800mb in 15 minutes on any regular ADSL.

Also as I said, what does SamKnows say about your line/exchange?

mrmr96

13,736 posts

204 months

Friday 2nd July 2010
quotequote all
paddyhasneeds said:
leeb said:
Currently takes e approx 15mins to upload 500 images, which is just too long to be honest.
That doesn't sound right.

Can you confirm 100% the numbers involved, both number of photos, and size of average photo (look at the properties and copy the exact size as displayed).

500 photos at 1.5mb each is 800mb and you're not going to be uploading 800mb in 15 minutes on any regular ADSL.

Also as I said, what does SamKnows say about your line/exchange?
1.5 megabytes x 500 = 750 megabytes.
750 megabytes x 8 = 6,000 megabits.
To achieve upload in 15mins: 15min x 60 secs is 900 secs.
So 6,000 megabits / 900secs = 6.7 megabits per seccond upload.

I can do this on my line. :-)

paddyhasneeds

51,214 posts

210 months

Friday 2nd July 2010
quotequote all
mrmr96 said:
paddyhasneeds said:
leeb said:
Currently takes e approx 15mins to upload 500 images, which is just too long to be honest.
That doesn't sound right.

Can you confirm 100% the numbers involved, both number of photos, and size of average photo (look at the properties and copy the exact size as displayed).

500 photos at 1.5mb each is 800mb and you're not going to be uploading 800mb in 15 minutes on any regular ADSL.

Also as I said, what does SamKnows say about your line/exchange?
1.5 megabytes x 500 = 750 megabytes.
750 megabytes x 8 = 6,000 megabits.
To achieve upload in 15mins: 15min x 60 secs is 900 secs.
So 6,000 megabits / 900secs = 6.7 megabits per seccond upload.

I can do this on my line. :-)
Yes but regular (by which I mean "normal" ADSL) for someone isn't going to be 6mbps upstream, something doesn't add up in the numbers leeb has given.

lestag

4,614 posts

276 months

Saturday 3rd July 2010
quotequote all
dilbert said:
lestag said:
dilbert said:
Long term, a radio link makes most sense, but the initial cost is high, perhaps tens of thousands.
Two netgear access points
two yagi aerials
some low loss cable

== 20km line of site radio link
prob 5k

plus whatever service it hooks into at the other end
Done this twice
Its the site rental that's the expensive bit. I think too that a WiFi system might have some availability/reliability/maintainability issues!
only issues i had was:
1)airconditioning stack was backfeeding into the AC mains when switching on at 7am. a battery feed to access point fixed that.
2)had a netgear that would go on soft fault that required a power cycle to fix

And this was no kiddie setup. link designed by a radio engineer
As we used directional aerials there was no interference issues
Setup very useful for rural areas. and if you know people in your area rental is .. um .. low

leeb

Original Poster:

1,074 posts

243 months

Saturday 3rd July 2010
quotequote all
Looking at some of those figures above, then it seems somewhere the info i have been given isnt quite right. Yes there were definatelty 500 images, yes they are approx 1.4-1.5mb each and the guys in the lab, said that it took a bit over 15 mins from when they send from the printing software to when they could work again.

This could mean....the printing software is already reducing the size of the upploaded files, and compressing them somehow. Which I wasnt aware of, but is definately possible.

The only reason we want a solution to upload the full image, is because we want to offer the facility for parents to DOWNLOAD instantly after payment their image. This is in the developers hands at the moment to be built in at some point, so I am looking to put something in place sooner rather than later. I will have to look into EXACTLY how it sends them out and exports them though, so thanks for pointing that out.

With regards to the comment about the photographers sending them, we have a team of approx 20 photographers who all FTP the images into the office, currently using Logmein which is not the best way, and also on my list of things to setup, dedicated FTP. The images are then edited, composited, colour corrected, so that the parents see an exact copy of what they are ordering, and it also allocateds Photo ID and passwords to everything as a unique number per image. This just cant work any other way, and the photographers are just the first step in producing the final product.

A guy in the office mentioned about MICROWAVE technology, but i havent been able to find anything about it yet, so any more info on that would be great.

Appreciate all your input.

BliarOut

72,857 posts

239 months

Saturday 3rd July 2010
quotequote all
lestag said:
dilbert said:
lestag said:
dilbert said:
Long term, a radio link makes most sense, but the initial cost is high, perhaps tens of thousands.
Two netgear access points
two yagi aerials
some low loss cable

== 20km line of site radio link
prob 5k

plus whatever service it hooks into at the other end
Done this twice
Its the site rental that's the expensive bit. I think too that a WiFi system might have some availability/reliability/maintainability issues!
only issues i had was:
1)airconditioning stack was backfeeding into the AC mains when switching on at 7am. a battery feed to access point fixed that.
2)had a netgear that would go on soft fault that required a power cycle to fix

And this was no kiddie setup. link designed by a radio engineer
As we used directional aerials there was no interference issues
Setup very useful for rural areas. and if you know people in your area rental is .. um .. low
http://www.ubnt.com

paddyhasneeds

51,214 posts

210 months

Saturday 3rd July 2010
quotequote all
leeb said:
Appreciate all your input.
Lee for fear of sounding like an ahole, for the third time, what options do you actually have on your exchange?

lestag

4,614 posts

276 months

Saturday 3rd July 2010
quotequote all
leeb said:
A guy in the office mentioned about MICROWAVE technology, but i havent been able to find anything about it yet, so any more info on that would be great.

Appreciate all your input.
Thast what i (and blairout)were talking about using wifi access points and directional aerials.
WIFI is a public spectum, any thing else will likely require a radio licence

dilbert

7,741 posts

231 months

Saturday 3rd July 2010
quotequote all
lestag said:
dilbert said:
lestag said:
dilbert said:
Long term, a radio link makes most sense, but the initial cost is high, perhaps tens of thousands.
Two netgear access points
two yagi aerials
some low loss cable

== 20km line of site radio link
prob 5k

plus whatever service it hooks into at the other end
Done this twice
Its the site rental that's the expensive bit. I think too that a WiFi system might have some availability/reliability/maintainability issues!
only issues i had was:
1)airconditioning stack was backfeeding into the AC mains when switching on at 7am. a battery feed to access point fixed that.
2)had a netgear that would go on soft fault that required a power cycle to fix

And this was no kiddie setup. link designed by a radio engineer
As we used directional aerials there was no interference issues
Setup very useful for rural areas. and if you know people in your area rental is .. um .. low
I hate to be confused but I think the maths is against you.
To get a 20km range, at 5GHz you're going to need a tower that's at least 45 meters high.
That's 150 feet high.

You must know people in high places.
hehe

lestag

4,614 posts

276 months

Saturday 3rd July 2010
quotequote all
dilbert said:
I hate to be confused but I think the maths is against you.
To get a 20km range, at 5GHz you're going to need a tower that's at least 45 meters high.
That's 150 feet high.

You must know people in high places.
hehe
I do... but it was 11g stuff so 2.4 GHz
the stuff i got done was 5km
I am not a radio engineer, but my guy did do a 20km link. it *may* of had a repeater in it