Archive for February, 2009
Wednesday, February 25th, 2009
Vertical Search Engine Template - Home Directory
It has become apparent that a sort of template is needed - an explanation of what is happening plus an example of the commands in a generic form. First, an outline of the project, we want to keep in mind the eventual process to follow once we progress past the initial stage of making sure [...]
No Comments » - Posted in Search by admin
Wednesday, February 11th, 2009
Distributed Search Engine
Nutch (the program we use to create our search sites) is capable of acting in “distributed” fashion. Nutch is integrated with a program called “Hadoop” that provides the “distributed” functionality. In the case of the geocentric search engines there exists the possibility that Nanaimo along with another 10 cities on Vancouver Island might be approached [...]
No Comments » - Posted in Search by admin
Sunday, February 8th, 2009
Search Engine Terms and Concepts
After this post there won’t be any explanation of the following terms or explanation of the following general concepts. Nutch is an open-source search engine. It is programmed using the JAVA language and makes use of a program called “Tomcat” (”Apache Tomcat” actually).
Nutch consists of a crawler, a parser, a database to store webpages, an [...]
No Comments » - Posted in Search by admin
Thursday, February 5th, 2009
Intelligent Crawling
The normal behavior of an agent that crawls (fetches) web pages is to get the webpage, extract the links on that page to other webpages and then go and get those linked pages, extract the links from them, repeat. The goal of Google, Yahoo, et al is to have crawled and indexed every page that [...]
No Comments » - Posted in Search by admin
Tuesday, February 3rd, 2009
Flavored Search Results
When we say that the search results of our vertical search engine are better than Google et al what we mean is that there is a “flavor” to the results. Our results will never be more comprehensive than theirs because we don’t index anywhere near the number of webpages that they do. A vertical search [...]
No Comments » - Posted in Search by admin
Sunday, February 1st, 2009
Vertical Search Engine For NanaimoSearch.com
We are in the process of introducing some technologies for geogeneric sites, for the most part right now those technologies are WordPress plugins for general use over all geo-generics, but also a few generic-specificic ones and specifically one for the “search” generic. We will be demonstrating eventually at “NanaimoSearch(dot)com. We are in the process of [...]