26 July 2010

0.9.0 Released

By Shay Banon

ElasticSearch version 0.9.0 has just been released. You can download it here. This is a major release for elasticsearch, both in terms of feature set as well as stability.

Major partial list of features include:

Facets Support

Facets allow to provide aggregated data view correlating to the search query executed. ElasticSearch now comes with several facets implementations, including the typical “terms” facets (allowing to get the most popular terms, and how often they occur), statistical facets providing statistical information on numeric fields including count, total, mean, min, max, variance, sum of squares, and standard deviation. And, the coolest facet type, histogram facets, which based on a field, break it into buckets and provide data on the relevant buckets derived from the same field, another field, or a script.

Scripting Support

Added as a general feature within elasticsearch, scripting allows to define scripts that are evaluated at runtime and can be used in different elasticsearch features, such as facets, script search fields, script filter, and so on.

More Queries and Filters

Additional queries and filters have been added. Thanks to the Query DSL of elasticsearch, adding queries is a snap. Queries include fuzzy query, custom score query (based on scripts), script filter, and/or/not filters, and more.

Improved Gateway Recovery

A major feature in elasticsearch, allowing to reuse existing index files when recovering from the gateway after a full cluster restart significantly reducing the time it takes to recover from the gateway. This include additions to the gateway behavior including the ability to control when the initial recovery will happen as a factor of the number of nodes in the cluster and time. Also, the shutdown API has been enhanced to better handle full cluster shutdown.

Script Search Fields

The ability to load custom data (based on non stored fields) as part of the search request.

Improves Fluent Java / Groovy API

The Java / Groovy API has been greatly enhanced to provide more fluent API execution.

AWS Cloud Specific Plugin

The cloud API has been rewritten to use directly the amazon AWS API, providing better stability and features when using AWS. The cloud plugin now only works with Amazon AWS.

Stability, Bug Squashing, and Memory Usage Improvements

A lot of work has going into improved stability of elasticsearch, better memory management, and major bugs squashing. ElasticSearch is being used by several companies to index very large amount of data with large cluster size successfully with snapshot versions of 0.9.