Beowulf clusters

Thread view:

Kenneth P. Turvey - 02 Jul 2006 05:34 GMT

I need to do some parameter optimization on a long running job so I'm
planning to use the Beowulf cluster on the UMSL campus. Ideally I would
like to be able to kick off threads using the executor interface and have
them run on available nodes on the cluster. I know that things probably
aren't this simple, but that would be the ideal case.

Does anyone have any experience with this? Any help would be appreciated.

- --
Kenneth P. Turvey <kt-usenet@squeakydolphin.com>

XMPP IM: kpturvey@jabber.org
Yahoo IM: kpturvey2

Reply to this Message

Filip Larsen - 02 Jul 2006 09:08 GMT

> I need to do some parameter optimization on a long running job so I'm
> planning to use the Beowulf cluster on the UMSL campus. Ideally I would
[quoted text clipped - 3 lines]
>
> Does anyone have any experience with this? Any help would be appreciated.

If you are looking for ways to deploy and run computation jobs on your
cluster using Java, you may find the following interesting:

http://sourceforge.net/projects/aglets
http://sourceforge.net/projects/jcgrid/

Regards,

Signature

Filip Larsen

Reply to this Message

Filip Larsen - 02 Jul 2006 09:50 GMT

I wrote

> If you are looking for ways to deploy and run computation jobs on your
> cluster using Java, you may find the following interesting:
>
> http://sourceforge.net/projects/aglets
> http://sourceforge.net/projects/jcgrid/

I mistakenly listed The Java Grid Computing project, which seems dead,
instead of the Java Parallal Processing Framework project which is much
more
alive and kicking:

http://sourceforge.net/projects/jppf-project

Regards,

Signature

Filip Larsen

Reply to this Message

Kenneth P. Turvey - 02 Jul 2006 23:46 GMT

> I mistakenly listed The Java Grid Computing project, which seems dead,
> instead of the Java Parallal Processing Framework project which is much
> more
> alive and kicking:
>
> http://sourceforge.net/projects/jppf-project

The links you provided are quite interesting, particularly the one above,
but they don't seem to take advantage of the existing Beowulf
architecture. I can't really run programs on the nodes except through the
existing architecture since I'm not an administrator of the cluster. It
would be nice if there was something that had an interface like the JPPF
project but used the existing task submission and execution architecture.
Does something like this exist? It would be somewhat surprising if it
didn't with the number of Beowulf clusters out in the wild.

I really did enjoy reading the information at the link above. I was
talking to my wife the other night about how cool it would be if the
computer labs on campus joined the cluster when not in use. The project
above could make implementing this quite easy.

- --
Kenneth P. Turvey <kt-usenet@squeakydolphin.com>

XMPP IM: kpturvey@jabber.org
Yahoo IM: kpturvey2

Reply to this Message

Oliver Wong - 03 Jul 2006 16:07 GMT

> I was
> talking to my wife the other night about how cool it would be if the
> computer labs on campus joined the cluster when not in use.

And how'd that go? ;)

- Oliver

Reply to this Message

Kenneth P. Turvey - 03 Jul 2006 20:51 GMT

>> I was
>> talking to my wife the other night about how cool it would be if the
>> computer labs on campus joined the cluster when not in use.
>
> And how'd that go? ;)

Haha... you must have met my wife. She often looks at me with wonder....
that is wonder about why I'm telling her this stuff.

- --
Kenneth P. Turvey <kt-usenet@squeakydolphin.com>

XMPP IM: kpturvey@jabber.org
Yahoo IM: kpturvey2

Reply to this Message

vjg - 03 Jul 2006 15:52 GMT

> -----BEGIN PGP SIGNED MESSAGE-----
> Hash: SHA1
[quoted text clipped - 19 lines]
> =yvvl
> -----END PGP SIGNATURE-----

Am I the only one here who hasn't a clue what "the Beowolf cluster" is?
You referenced UMSL and I'm assuming that's the University of Missouri
at St. Louis. I happen to live in St. Louis so it caught my eye.

Reply to this Message

Oliver Wong - 03 Jul 2006 16:06 GMT

> Am I the only one here who hasn't a clue what "the Beowolf cluster" is?
> You referenced UMSL and I'm assuming that's the University of Missouri
> at St. Louis. I happen to live in St. Louis so it caught my eye.

http://en.wikipedia.org/wiki/Beowulf_cluster

- Oliver

Reply to this Message

vjg - 03 Jul 2006 19:22 GMT

> > Am I the only one here who hasn't a clue what "the Beowolf cluster" is?
> > You referenced UMSL and I'm assuming that's the University of Missouri
> > at St. Louis. I happen to live in St. Louis so it caught my eye.
>
> http://en.wikipedia.org/wiki/Beowulf_cluster

Thanks... I went out and did some reading after I posted that question.
I should have mentioned I was off to do a little research.

- Virgil

Reply to this Message

Daniel Dyer - 03 Jul 2006 17:08 GMT

>> -----BEGIN PGP SIGNED MESSAGE-----
>> Hash: SHA1
[quoted text clipped - 25 lines]
> You referenced UMSL and I'm assuming that's the University of Missouri
> at St. Louis. I happen to live in St. Louis so it caught my eye.

My news reader seems to have lost the last day's posts, including the
original post in this thread, so forgive me if this has already been
mentioned, but how about using Java Spaces?

http://java.sun.com/developer/technicalArticles/tools/JavaSpaces/
http://today.java.net/pub/a/today/2005/04/21/farm.html
http://www.javaworld.com/jw-11-1999/jw-11-jiniology.html

Dan.

Signature

Daniel Dyer
http://www.dandyer.co.uk

Reply to this Message

Beowulf clusters

Free Magazines