How does one build a search engine?

[goodone]

What does it take to build a good search engine? If you wanted to build a search engine where would you first start? Is there any script out there that I can start off with? Is there any free scripts anywhere that I can use for now until I can buy one or pay someone to write one for me?

Come on guys please let me know what are your thoughts on this?

[paul]

I think you try on searching in hotscripts site ( widely used resource web portal ) that have bunch of script.

[Cassie]

Is this a search facility for a website or a new Google?

If it is the first one I would be really interested in any ideas too.

[kev woodman]

I did some research into building search engines a couple of years ago and it is really interesting stuff (actually I should qualify that with the observation that I have been known to stretch the term interesting way beyond breaking point).

A lot of the theory is tied up with Artificial Intelligence so if you're thinking of writing your own a good place to start is deciding on your basic decision making algorithm. Or you could start by looking at how you are going to index Web pages and write a basic software agent to start harvesting data for you.

if you're just looking to build a search engine for your site you could try having a look at devarticles.com/c/a/HTML/Building-A-Search-Engine/

[Cassie]

Wow - perhaps I won't bother

[goodone]

I'm talking about a internet search engine, not just a search engine that can search a website but a search engine that can search the entire world of millions and millions of webpages. I know it will take alot of work but I will be very glad to own an internet search engine some day.

The ony thing is I don't know where to start. Can you guys help with any suggestions or any ideas please?

[kev woodman]

Already have I think - there are a few books/sites which describe search engine theory but you might also want to look into data mining techniques and you'll certainly need to get up to speed on regular expressions.

Cassie - it doesn't have to be complicated for your site - don't Google do a sort of mini search engine that you can add to your own site?

[paul]

I am not sure but it seems complicated to me, I think best to get a programmer if your budget allow for that.

[kev woodman]

For a custom search engine for your site you could use this from Google. If you want to write the next Google then I'd suggest a couple of programmers at least, not to mention some pretty substantial hardware to handle your indices

[paul]

Sound good google is providing technique to create custom search engine! thanks for the link kev.