Archive for November, 2012

YaCy 1.2 Release with embedded Solr

Donnerstag, November 8th, 2012

Today we released YaCy 1.2. This is a major change in the architecture of YaCy since Search functions now use primary Solr as indexing engine instead our Peer-to-Peer optimized distributed indexing algorithms. This step also means that YaCy gives up the attempt to create it’s own indexing technology in favor of the much more advanced Solr/Lucene library.

While we will still do Peer-to-Peer search, we will now consider YaCy also as a Crawling and Search Framework for Solr. Today we presented „YaCy as Search Appliance“ at the ApacheCon 2012 with great success:

YaCy Tweets at ApacheCon 2012

Notable new features in YaCy 1.2 are:

  • Embedded Solr 4.0.0 with standard Solr XML search interface integrated
  • Enhanced crawling with live link structure visualization
  • A Host Browser to explore the file structure of crawled hosts: this shows loaded pages, pages with errors and pending files in the same way as a file browser would show the content of a host.

We believe that the new features are also valuable for Web Administration and Search Engine Optimization (i.e. to find dead links etc). Please have a look to the screen shots at the YaCy ApacheCon 2012 Talk Slides.

YaCy is available as Windows, Mac and debian package and also as tarball. To download YaCy, visit the YaCy Home Page.

tl;dr

Use Solr, but dont home-brew your own code around it if you do web-, file- or intranet-search, its all inside YaCy. And dont buy a commercial appliance, this is free and better!