JMS experience?
Anyone out there used the Java Messaging System? I have a project where I need to coordinate several systems. One system is accumulating data and storing it for archival purposes. As the archival system writes information to disk, it needs to alert another system that will read back the data to do some analysis on it.
I'm thinking of using JMS for this purpose -- send a message to a controller box that says "hey, new data archived for server foo.com". Then the analysis boxes can consume those messages to start various analysis tasks on the data.
Anyone have experience in something like this? I mean, just the message-passing part (I have a handle on the rest). I'm assuming JMS is the right approach, but I'm open to other suggestions.
Some data points:
I expect a very large number of messages being generated. There are 2000 hosts feeding me data, and the data gets cached to disk every 5-10 minutes, with a pretty even spread over that time. So maybe on the order of 100-200 messages per minute being generated?
I expect to have 4-5 boxes looking for incoming messages; essentially each "worker" box is just waiting for a command to go do a data analysis, then it returns to a wait state afterwards.
This all has to run on both Windows and Linux. Performance on Windows doesn't matter, but that's where we do development so I need it to at least sort of work enough for testing.
I'm thinking of using JMS for this purpose -- send a message to a controller box that says "hey, new data archived for server foo.com". Then the analysis boxes can consume those messages to start various analysis tasks on the data.
Anyone have experience in something like this? I mean, just the message-passing part (I have a handle on the rest). I'm assuming JMS is the right approach, but I'm open to other suggestions.
Some data points:
I expect a very large number of messages being generated. There are 2000 hosts feeding me data, and the data gets cached to disk every 5-10 minutes, with a pretty even spread over that time. So maybe on the order of 100-200 messages per minute being generated?
I expect to have 4-5 boxes looking for incoming messages; essentially each "worker" box is just waiting for a command to go do a data analysis, then it returns to a wait state afterwards.
This all has to run on both Windows and Linux. Performance on Windows doesn't matter, but that's where we do development so I need it to at least sort of work enough for testing.
