Hello
I've been given a new project to attempt which involves developing a java application which takes real time data from the internet, stores this data in a database and then allows manipulation of this data. Any info about how this could be acheived would greatly appreciated.
Many Thanks
> I've been given a new project to attempt which
> involves developing a java application which takes
> real time data from the internet, stores this data in
> a database and then allows manipulation of this data.
> Any info about how this could be acheived would
> greatly appreciated.
>
more specifically like? with your overview, you already said how you plan to achieve this . btw, when you store in a database to process later, can you call it precisely real time processing?
I intend to design a system which takes seismic data from specifc web sites and calculate the risk of a tsuinami occuring from this. I would like to know which database software would be the best to use. Also how can i set up the data transfer, could this be done with the java.net api using the url resource.
Many thanks
> I intend to design a system which takes seismic data
> from specifc web sites and calculate the risk of a
So you have a program that runs periodically to collect the data from
different places, transform it to your format and store it to a database.
and your sources are Webservices OR you plan to get an html pages and
filter out what you want OR a mix of both.
the second program can take the data present in the database at that
moment and give the tsunami probability
> tsuinami occuring from this. I would like to know
> which database software would be the best to use.
That depends on your design constraints. Firstly you need to decide what
kind of a database you want ( RDBMS, obj dbs, ..) and then lock on a db.
A relational db may be what you decide on and in the free domain you have
say MySQL
> Also how can i set up the data transfer, could this
> be done with the java.net api using the url
> resource.
In case you are picking htmls, yes. If webservices are available, check out
stuff like apache AXIS..
Ok thanks
I intend to go the html route i think. How can i filter out the data i require as the url class just provides the full page.
Also would i be better creating this as a web application using jsf.
Finally i intend to provide a email alert to all subscribers, how would i go about setting this up in java
Cheers
> I intend to go the html route i think. How can i
> filter out the data i require as the url class just
> provides the full page.
it must not be 'intend'. If you are having to(because there is no webservice),
then i agree. Unlike an XML, parsing an HTML page is error prone(even
without error from your side). Also what will you do, if one of your source
change their presentation layer.
>
> Also would i be better creating this as a web
> application using jsf.
That is ok. But do expose a webservice for the same. Why? Just think about
another guy like you thinking of desiging a program to take tsunami warning
probability from different sites like yours and doing something with it
>
> Finally i intend to provide a email alert to all
> subscribers, how would i go about setting this up in
> java
Rest assured, all this you can achieve in the Java space. How, you need to
read and figure out stuff. If you've specific issues, all here would be glad to
help.
