What to do with a stack of computer hardware....
What to do with a stack of computer hardware....
Author
Discussion

scared but happy

Original Poster:

24,147 posts

259 months

Saturday 4th February 2006
quotequote all
1xCompaq raid server crammed with hard drives. (2x1ghz CPUS etc)
1xDell raid server crammed with hard drives. (2x550 CPUS etc)
4xdesktop systems (1Ghz and above)
Various motherboards+CD+floppy drives - Diskless slaves?

I was thinking about a cluster computer. Has anyone tried this? My level of Linux/Unix is quite low but can it be done in a Windows/DOS enviroment?

I wondered if you can get an SMP emulator for a PC that looks like an X amount of CPU's in your machine?

Most of the systems I have been looking at just do sectonal chunks at the problem, like SETI.

any ideas/pointer

aldi

9,288 posts

267 months

Sunday 5th February 2006
quotequote all
Render farm?

scared but happy

Original Poster:

24,147 posts

259 months

Sunday 5th February 2006
quotequote all
Err....Whats one of them?
Added: Had a good Google about. That is amazing! You may be onto something here.

any more ideas?

>> Edited by scared but happy on Sunday 5th February 09:02

annodomini2

6,971 posts

281 months

Tuesday 7th February 2006
quotequote all
scared but happy said:
I was thinking about a cluster computer. Has anyone tried this? My level of Linux/Unix is quite low but can it be done in a Windows/DOS enviroment?


Yes but you need supporting software, I would guess you're more likely to find 'freeware' for linux than you are for windows.

And if you have to pay it will definitely not be cheap!

deckster

9,631 posts

285 months

Tuesday 7th February 2006
quotequote all
Blimey, not asking for much are you? Cluster computing is in its infancy and is therefore a complete nightmare in the real world (and what would you actually use it for? I'm intrigued - is there some practical application or is it purely to keep you off the streets?)

Look up Linux Beowulf clustering, but it's really not for the faint-hearted!

scared but happy

Original Poster:

24,147 posts

259 months

Tuesday 7th February 2006
quotequote all
deckster said:
purely to keep you off the streets?
Look up Linux Beowulf clustering, but it's really not for the faint-hearted!

I had a look at that. Quite intresting. I see Microsoft are doing a Compute Cluster this is out sometime this year.
www.microsoft.com/windowsserver2003/ccs/overview.mspx
BUT I have not got any 64bit machines to try the Beta version on
I can see the point of splitting up the problem and attacking it at various points, like rendering as posted before and I will have a go at that.
It just seems a shame to have a load of hardware around and not find a good use for it.

zcacogp

11,239 posts

274 months

Friday 10th February 2006
quotequote all
scared but happy said:
It just seems a shame to have a load of hardware around and not find a good use for it.
Quite agree.

Which is why my old DX2-486 machine is doing excellent service as a shoe rack at the bottom of my wardrobe. And has done for the last 8 years or so ....


Oli.

lotusfan

593 posts

296 months

Friday 10th February 2006
quotequote all
clustering is not to bad to get going on linux, drbd works well

Plotloss

67,280 posts

300 months

Friday 10th February 2006
quotequote all
Beowulf.

Theres a gardener in America running a Beowulf cluster out of hundreds of PII machines.

Its one of the fastest computers on earth...

Nutter without doubt.

jamieboy

5,929 posts

259 months

Friday 10th February 2006
quotequote all
lotusfan said:
drbd
Isn't drbd just high-availability / fault-tolerance, though, rather than 'proper' cluster computing that the OP is talking about? Might be wrong - plenty of Windows clustering experience, none for Linux.

lotusfan

593 posts

296 months

Friday 10th February 2006
quotequote all
jamieboy said:
lotusfan said:
drbd
Isn't drbd just high-availability / fault-tolerance, though, rather than 'proper' cluster computing that the OP is talking about? Might be wrong - plenty of Windows clustering experience, none for Linux.


yes its high availablity, is it application / load balancing clustering we are talking about here?
what is the cluster for?
I know the windows version requires a two node system with external storage (shared) or a multi node that can use internal storage but more than 50% of the cluster must be operational at any time, therefore at least 3 to a cluster and 2 must be running.
The alternative is load balancing, which tried to spread an application load across more than one server
for LB you can do it any recent windows server, clustering requires datacenter, advanced or enterprise versions.

jamieboy

5,929 posts

259 months

Friday 10th February 2006
quotequote all
lotusfan said:
for LB you can do it any recent windows server, clustering requires datacenter, advanced or enterprise versions.
Yep, as I say, I've got plenty of Windows clustering experience. I think the OP was talking about symmetrical processing, or grid computing, or whatever term to describe running the same processing task over multiple machines.

lotusfan

593 posts

296 months

Friday 10th February 2006
quotequote all
jamieboy said:
lotusfan said:
for LB you can do it any recent windows server, clustering requires datacenter, advanced or enterprise versions.
Yep, as I say, I've got plenty of Windows clustering experience. I think the OP was talking about symmetrical processing, or grid computing, or whatever term to describe running the same processing task over multiple machines.


ah yes, that does sound like load balancing

jamieboy

5,929 posts

259 months

Friday 10th February 2006
quotequote all
lotusfan said:
ah yes, that does sound like load balancing
Not to me it doesn't.

To me (although I've done more with high-availabiltiy than load-balancing) load-balancing involves sending new task requests to whichever server is best able to cope with them.

Cluster computing, in this context, involves processing a single task across multiple machines.

These are not the same thing.

Maybe I've misunderstood the original post, but I think we're talking about something a lot more complex and interesting than simple load-balancing.

_dobbo_

14,619 posts

278 months

Friday 10th February 2006
quotequote all
scared but happy said:

It just seems a shame to have a load of hardware around and not find a good use for it.


A pile of kit that size will use at least a kilowatt of power, so unless there is some practical application for this, it would be cheaper to keep a kettle permanently boiling 24x7.

Have a play, set up your cluster, then once it's working give the kit to charideeeeeeeeee......

maddog-uk

2,392 posts

276 months

Friday 10th February 2006
quotequote all
Actually be careful what you do with the kit. The european waste dispoal laws are now in effect so you need to dispose of it ethically and show a transfer of ownership. We are doing some amazing things with grids, but all on 64bit boxes.

lotusfan

593 posts

296 months

Friday 10th February 2006
quotequote all
jamieboy said:
lotusfan said:
ah yes, that does sound like load balancing
Not to me it doesn't.

To me (although I've done more with high-availabiltiy than load-balancing) load-balancing involves sending new task requests to whichever server is best able to cope with them.

Cluster computing, in this context, involves processing a single task across multiple machines.

These are not the same thing.

Maybe I've misunderstood the original post, but I think we're talking about something a lot more complex and interesting than simple load-balancing.


I see, i've not tried to use it for that before, its always been as a failover system when in cluster format and power access in LB format, didn't nasa use a cluster of this type for modelling meteor strikes or similar, something like a thousand servers with four procs each to crunch the data as one supercomputer?

sp60

524 posts

289 months

Friday 10th February 2006
quotequote all
Stick it all on ebay, give someone else the job of working out what to do with it, fill the liberated space with something pretty and have a night out on the proceeds.
Your life will be so much better this way