Apache Nutch is an open source web-search software project. Stemming from Apache Lucene, it now builds on Apache Solr adding web-specifics, such as a crawler, a link-graph database and parsing support handled by Apache Tika for HTML and array other document formats.
Nutch can run on a single machine, but gains a lot of its strength from running in a Hadoop cluster.
- Prior exposure to JAVA /J2EE, Database skills
- Some knowledge about IDE, Ant build tool
- Some knowledge about Hadoop