Site Search, Search Engines and the like

[jjones]

I haven't really any experience at working with search and I'm looking for places to at least begin acquiring information.

This is a personal project but it will consist of searching the content of thousands of locally hosted web pages and an extensive database. Anyone have experience with search engine programs and programming that can point me to some sources to begin researching a search solution?

 

[jjones]

Anyone?

 

[MrChad]

Apache's Lucene search is pretty easy to set up.

 

[tfinch2]

Originally posted by: jjones
I haven't really any experience at working with search and I'm looking for places to at least begin acquiring information.

This is a personal project but it will consist of searching the content of thousands of locally hosted web pages and an extensive database. Anyone have experience with search engine programs and programming that can point me to some sources to begin researching a search solution?

The search engine is only as good as your indexing method for the database.

I've yet to find a good tutorial or anything on something like this, so what I've had to do was study source code of existing open source solutions.

 

[jjones]

Originally posted by: tfinch2

Originally posted by: jjones
I haven't really any experience at working with search and I'm looking for places to at least begin acquiring information.

This is a personal project but it will consist of searching the content of thousands of locally hosted web pages and an extensive database. Anyone have experience with search engine programs and programming that can point me to some sources to begin researching a search solution?

The search engine is only as good as your indexing method for the database.

I've yet to find a good tutorial or anything on something like this, so what I've had to do was study source code of existing open source solutions.

Yeah, I was guessing that would be the case. I've worked with fairly simplistic databases but realized that with effective search, it's going to be in a whole different realm. Is there anything you can point me to that might help in evaluating how I might approach this in regards to search? Doing as you did such as studying open source solutions is something I'd like to do but I know of none that I could use for this. I'm really in the dark about it at this point.

 

[jjones]

Originally posted by: MrChad
Apache's Lucene search is pretty easy to set up.

Thanks very much, looked at it briefly and it looks interesting. I'll take a closer look at it later today.

 

[tfinch2]

Check out Swish-e

http://swish-e.org/

 

[jjones]

Thanks again for the info. I also ran across Nutch (based on Lucene) and a few others.

I also found (and remembered) that Google and others offers enterprise search solutions at reasonable costs if I decide not to go the open source route, and instead have search "handled" for me. I may actually end up doing something like this.

Any more comments on this subject are very welcome.