26 May 2015

This Week in Elasticsearch and Apache Lucene: Lucene 5.2.0 is coming

By Alexander Reelsen

Welcome to This Week in Elasticsearch and Apache Lucene! With this weekly series, we're bringing you an update on all things Elasticsearch and Apache Lucene at Elastic, including the latest on commits, releases and other learning resources.

Top News

Elasticsearch Core

  • Networking: Default value for socket reuse should not be null (#11255, 2.0.0, 1.6.0)
  • Build: Remove useless outdated forbidden-api version in -Pdev config. (#11273, 2.0.0)
  • Transport: Fix NPE when streaming commit stats (#11266, 2.0.0)
  • Mappings: Cleanup names handling (#11272, 2.0.0)
  • Shard: Check if the index can be opened and is not corrupted on state listing (#11269, 2.0.0, 1.6.0)
  • Internal: Uid#createTypeUids to accept a collection of ids rather than a list (#11263, 2.0.0)
  • Transport: remove support for reading/writing list of strings, use arrays instead (#11276, 2.0.0)
  • Renaming reducers to Pipeline Aggregators (#11275, 2.0.0)
  • Transport: Add profile name to TransportChannel (#11261, 2.0.0)
  • Mappings: Remove generics from FieldMapper (#11292, 2.0.0)
  • Startup: Allow disabling of sigar via settings (#11293, 2.0.0, 1.6.0)
  • Allocation: Async fetch of shard started and store during allocation (#11262, 1.6.0)
  • Dependencies: Upgrade to lucene-5.2.0-snapshot-1681024 (#11296, 2.0.0)
  • Mappings: Remove the compress/<code>compress_threshold options of the BinaryFieldMapper. (#11280, 2.0.0)
  • Logging: Add logging for failed TTL purges (#11302, 2.0.0)
  • Dependencies: Upgrade to Netty 3.10.3 (#11304, 2.0.0, 1.6.0)
  • Search: Minor refactor of MultiValueMode removing apply and reduce (#11290, 2.0.0)
  • Plugins: Only load a plugin once from the classpath (#11301, 2.0.0, 1.6.0)
  • Refactoring: Make some sec mgr / bootup classes package private and final. (#11312, 2.0.0)
  • Build: Remove build duplication (#11315, 2.0.0)
  • Internal: Absorb ImmutableSettings into Settings (#11321, 2.0.0)
  • Refactoring: Rename TransportShardReplicationOperationAction to <code>TransportReplicationAction (#11332, 2.0.0)
  • Search: Don't truncate TopDocs after rescoring (#11342, 2.0.0, 1.6.0, 1.5.3)
  • Build: Fix paths for final artifact (#11319, 2.0.0)
  • Mapping: custom analyzers names and aliases must not start with _ (#11303, 2.0.0, 1.6.0)
  • Recovery: Seal indices for faster recovery (#11179, 2.0.0, 1.6.0)
  • Search: Make FilteredQuery a forbidden API. (#11224, 2.0.0)
  • Allocator: Ensure we mark store as corrupted if we fail to read the segments info (#11230, 2.0.0, 1.6.0)
  • Mappings: Remove SmartNameFieldMappers (#11216, 2.0.0)
  • Cleanup: Removed generic types from ContextAndHeaderHolder and HasHeaders#putHeader() (#11231, 1.6.0)
  • Core: Don't allow indices containing too-old segments to be opened (#11072, 2.0.0)
  • Internal: Fix CompressedString.equals. (#11233, 2.0.0, 1.6.0, 1.5.3)
  • Mappings: Remove document parse listener (#11243, 2.0.0)
  • Cleanup: Remove generics need in ContextAndHeaderHolder (#11222, 2.0.0)
  • Pre sync flush cleanups (#11252, 2.0.0)
  • Recovery: Add engine failure on recovery finalization corruption back (#11241, 2.0.0)
  • Async fetch of shard started and store during allocation (#11101, 1.6.0)
  • Snapshot/Restore: Fix FSRepository location configuration (#11157, 2.0.0)
  • Mappings: Make mapping updates atomic wrt document parsing. (#11205, 2.0.0)
  • Aggregation fix: sampler agg could not be used with Terms agg’s order. (#10785, 2.0.0)
  • Snapshot/Restore: check that reading indices is allowed before creating their snapshots (#11133, 2.0.0, 1.6.0)
  • Snapshot/Restore: Batching of snapshot state updates (#10295, 2.0.0, 1.6.0)
  • Build: Use elasticsearch-parent project (#9735, 2.0.0, 1.6.0)
  • Packaging: Use of default CONF_DIR/CONF_FILE in plugin install (#10721, 2.0.0, 1.6.0)
  • Aggregations: new sampler provides a filter for top-scoring docs (#8191, 2.0.0, 1.6.0)

Apache Lucene

Watch This Space

Stay tuned to this blog, where we'll share more news on the whole ELK ecosystem including news, learning resources and cool use cases!