Downloads

Elasticsearch 1.5.0

See issues on GitHub

Release Notes

Breaking changes

  • Aliases:
    • Aliases: Throw exception if index is null or missing when creating an alias #8240 (issues: #7863, #7976)
  • Benchmark:
    • Benchmark api: removed leftovers #10180
  • Core:
    • Resiliency: Throw exception if the JVM will corrupt data #7580
  • Engine:
    • [ENGINE] Remove full flush / FlushType.NEW_WRITER #9559
  • Index APIs:
    • Change behaviour of indices segments api to allow no indices #9219 (issue: #5856)
  • Plugins:
    • Plugins: Don't overwrite plugin configuration when removing/upgrading plugins #7890 (issue: #5064)
  • Recovery:
    • Recovery: RecoveryState clean up #9811 (issue: #6644)
  • Scripting:
    • Scripting: cleanup ScriptService & friends in preparation for #6418 #9992 (issue: #6418)
    • Disable dynamic Groovy scripting by marking Groovy as not sandboxed [ISSUE] #9655
    • Scripting: Script with _score: remove dependency of DocLookup and scorer #7819 (issues: #7043, #7487)

Deprecations

  • CRUD:
  • Core:
    • Core: deprecate index.fail_on_merge_failure #10084
  • Mapping:
    • Mappings: Deprecate _analyzer and per query analyzers #9383 (issue: #9279)
  • More Like This:
    • Deprecation: MLT Field Query #8253
  • Network:
    • Deprecated the thrift and memcached transports #10167 (issue: #10166)
  • Search:
    • Core: add deprecation messages for delete-by-query #10082

New features

  • Aggregations:
    • New aggregations feature - “PercentageScore" heuristic for significant_terms #9747 (issue: #9720)
    • significant terms: add scriptable significance heuristic #7850
  • CAT API:
    • Cat API: show open and closed indices in _cat/indices #7936 (issue: #7907)
  • Circuit Breakers:
    • Circuit Breakers: Add NoopCircuitBreaker used in NoneCircuitBreakerService #8063
  • Engine:
    • Shadow replicas on shared filesystems #9727 (issue: #8976)
  • More Like This:
    • MLT Query: Support for artificial documents #7725
  • Query DSL:
    • Add time_zone setting for query_string #8164 (issue: #7880)
    • Search: add format support for date range filter and queries #7821 (issue: #7189)
    • Add min_score parameter to function score query to only match docs above this threshold #7814 (issue: #6952)
  • Search:
    • Add inner hits to nested and parent/child queries #8153 (issues: #3022, #3152)
  • Store:
  • Term Vectors:
    • Term Vectors/MLT Query: support for different analyzers than default at the field #7801

Enhancements

  • Aggregations:
    • Aggregations: deprecate pre_zone and <code>post_zone in date_histogram #9722 (issue: #9062)
    • Aggregations: Add 'offset' option to date_histogram #9614 (issue: #9062)
    • Aggregations: Numeric metric aggregations are now formattable #9032 (issue: #6812)
    • Aggregations: Adds methods to get to/from as Strings for Range Aggs #9026 (issue: #9003)
    • Made the nested, <code>reverse_nested and children aggs ignore unmapped nested fields or unmapped child / parent types. #8808 (issue: #8760)
    • Fixed #6061 size parsing consistent for strings #8645
    • Aggregations: Do not take deleted documents into account in aggregations filters. #8540
    • Aggs - support for arrays of numeric values in include/exclude clauses #7727 (issue: #7714)
    • Aggregations: Adds ability to sort on multiple criteria #7662 (issues: #6917, #7588)
    • Aggregations: Properly support top_hits aggregation in a nested and reverse_nested aggregations. #7164 (issue: #3022)
  • Allocation:
    • Allocation: Speed-up disk-threshold decider #8803 (issue: #6372)
    • Allocation: DiskThresholdDecider#remain(...) should take shards relocating away into account #8659 (issue: #8538)
    • Allocation: Take percentage watermarks into account for reroute listener #8382 (issues: #8367, #8368)
    • Allocation: Reroute shards automatically when high disk watermark is exceeded #8270 (issue: #8146)
    • Add option to take currently relocating shards' sizes into account #7785 (issues: #6168, #7753)
  • CAT API:
    • Mark shadow replicas with 's' in _cat/shards output #10023 (issue: #9772)
    • Admin: add total index memory in _cat/indices #7824 (issue: #7008)
    • Add file descriptor details to cat/nodes #7655 (issue: #7652)
  • Circuit Breakers:
    • Circuit Breakers: Log if CircuitBreaker is tripping #8050
  • Core:
    • Core: don't rethrow already handled merge exceptions #10083
    • [ENV] NodeEnv should lock all shards for an index #9799
    • [CORE] Allow primary promotion on shadow replica without failing the shard #9786
    • [INDICES] Retry if shard deletes fail due to IOExceptions #9784
    • Core: only do a single listAll from FileSwitchDir #9666 (issue: #6636)
    • Core: Remove ability to run optimize and upgrade async #9640 (issue: #9638)
    • Update joda-time to v2.7 #9610
    • [CORE] Consolidate index / shard deletion in IndicesService #9605
    • Minor hygiene, Removed Redundant inheritance #9427
    • Core: don't throttle recovery indexing operations #9396 (issue: #9394)
    • Core: increase default xlog flush size from 200mb to 512 mb #9341 (issue: #9265)
    • Pass through all exceptions in IndicesLifecycleListeners #9330
    • Pass index settings to IndicesLifecycle#beforeIndexCreated and #afterIndexShardClosed #9245
    • Core: Fix Store.checkIntegrity() for lucene 3.x index files. #9234
    • Core: Don't verify adler32 for lucene 3.x terms dict/terms index. #9142
    • [CORE] Delete shard content under lock #9083 (issues: #8608, #9009)
    • [SEARCH] close active contexts on SearchService#close() #8947 (issue: #8940)
    • Core: use Lucene's defaults for compound file format #8934 (issue: #8919)
    • [CORE] Remove explicit .cleanUp() on cache clear #8924
    • Core: clarify index removal log message #8641
    • [CORE] Ensure shards are deleted under lock on close #8579
    • [INDEX] Add before/after indexDeleted callbacks to IndicesLifecycle #8569 (issue: #8551)
    • [CORE] Free pending search contexts if index is closed #8551
    • [CORE] Ban all usage of Future#cancel(true) #8494
    • Core: set bloom default to false even when Directory doesn't have a codecService #8442
    • [CORE] Introduce shard level locks to prevent concurrent shard modifications #8436
    • Discovery: Don't wait joinThread when stopping #8359 (issue: #8327)
    • [STATE] Observe cluster state on health request #8350
    • [UTILITIES] Introduce a RefCounted interface and basic impl #8210
    • Use 1 instead of 0 as filler version value for nested docs #8145
    • [CORE] Add cluster and index state checksums #8010 (issue: #7586)
    • Resiliency: Perform write consistency check just before writing on the primary shard #7873
    • [CORE] Add ThreadPool.terminate to streamline shutdown #7868
    • [CORE] Add ActionRunnable support to ThreadPool to simplify async operation on bounded threadpools #7765
    • Internal: Add missing cluster blocks handling for master operations #7763 (issue: #7740)
  • Discovery:
    • [Discovery] Prevent stale master nodes from sharing dated cluster states to nodes that have moved to a different master node #9632
    • Discovery: publishing timeout to log at WARN and indicate pending nodes #9551
    • Discovery: Concurrent node failures can cause unneeded cluster state publishing #8933 (issue: #8804)
    • [CLIENT] Only fetch the node info during node sampling #8685
    • Discovery: don't accept a dynamic update to min_master_nodes which s larger then current master node count #8321
    • Discovery: Improve handling of multicast binding exceptions #8243 (issue: #8225)
    • Discovery: Simplify discovery node initialization if version is unknown #8055 (issue: #8051)
    • Discovery: Close ping handler's executor service properly #7903
  • Engine:
    • [CORE] move InternalEngine.segmentStats() into abstract Engine #9728 (issue: #9727)
    • [ENGINE] Move more methods into abstract Engine #9717
    • [CORE] Move as much as possible into abstract Engine #9678
    • [ENGINE] Factor out settings updates from Engine #9625
    • [ENGINE] Close Engine immediately if a tragic event strikes. #9616 (issue: #9517)
    • [CORE] Refactor InternalEngine into abstract Engine and classes #9585
    • [ENGINE] Remove FlushType and make resources final in InternalEngine #9565
    • [ENGINE] Simplify Engine construction and ref counting #9211
    • [CORE] Fold engine into IndexShard #9181
    • Core: Don't acquire Engine's readLock in segmentsStats #8910 (issue: #8905)
    • [ENGINE] Remove engine related command classes #8900
    • Internal: allow InternalEngine to be stopped and started #8784 (issue: #8720)
    • [ENGINE] Flush IndexWriter to disk on close and shutdown #7563
  • Geo:
    • Revert "[GEO] Update GeoPolygonFilter to handle ambiguous polygons" #9463 (issues: #5968, #9304, #9339, #9462)
    • Geo: Update GeoPolygonFilter to handle polygons crossing the dateline #9339 (issues: #5968, #8672, #9304)
    • Geo: GeoPolygonFilter not properly handling dateline and pole crossing #9171 (issue: #5968)
    • Geo: Removing unnecessary orientation enumerators #9036 (issues: #8978, #9035)
    • Geo: Add optional left/right parameter to GeoJSON #8978 (issue: #8764)
    • Geo: Feature/Fix for OGC compliant polygons failing with ambiguity #8762 (issue: #8672)
    • Geo: Fixes BoundingBox across complete longitudinal range #7340 (issue: #5218)
  • Index Templates:
    • Provide template usage information on index creation #8646 (issue: #7421)
  • Internal:
    • Core: fix typo when primary is not available to index a document (UnavailableShardsException) #10140
    • [SHARD] make assert less strict to ensure local node is not null #10076
    • Use provided cluster state for indices service validations #10014
    • some more simple fs cleanups. #9827
    • Removed 'Master' from names.txt #9698 (issue: #9687)
    • Internal: Introduce TimedPrioritizedRunnable base class to all commands that go into InternalClusterService.updateTasksExecutor #9671 (issues: #8077, #9354)
    • Update Groovy dependency to 2.4.0 #9520
    • Add beforeIndexAddedToCluster callback #9514
    • [CACHE] Use a smaller expected size when serializing query results #9485
    • [CACHE] Use correct number of bytes in query cache accounting #9479
    • Internal: add AliasesRequest interface to mark requests that manage aliases #9460
    • Internal: ClusterInfoService should wipe local cache upon unknown exceptions #9449
    • Internal: fix shard state tranport action names #9440 (issue: #7105)
    • Mappings: Remove includeExisting flag from adding ObjectMapper and FieldMapper listeners #9184
    • Internal: assert that we do not call blocking code from transport threads #9164
    • [EXEC] Remove reduced stack size #9158 (issue: #9135)
    • Search: parse terms filters on a single term as a term filter. #9014
    • Internal: remove IndexCloseListener & Store.OnCloseListener #9009 (issues: #8436, #8608)
    • Core: add ignore_idle_threads (default: true) to hot threads #8985 (issue: #8908)
    • Remove circular dependency between IndicesService and IndicesStore #8918
    • Remove some Internal* abstractions #8904
    • [HEALTH] Don't mark health as timed out if desired state is reached #8683
    • Internal: Use a 1024 byte minimum weight for filter cache entries #8304 (issues: #8249, #8268)
    • Immediately remove filter cache entries on cache clear #8289 (issue: #8285)
    • Internal: Make indexQueryParserService available from ParseContext #8252 (issue: #8248)
    • Internal: Allow to configure custom thread pools #8247
    • Internal: Expose concurrency_level setting on all caches #8112 (issue: #7836)
    • Resiliency: Be more conservative if index.version.created is not set #8018
    • Internal: split internal fetch request used within scroll and search #7870 (issues: #6933, #7319, #7856)
    • Internal: split internal free context request used after scroll and search #7856 (issues: #6933, #7319)
    • Internal: Clarify when a shard search request gets created to be only used locally #7855
    • Internal: Add a listener thread pool #7837
    • Internal: remove ForceSyncDirectory #7804
    • Internal: Check if from + size don't cause overflow and fail with a better error #7778 (issue: #7774)
    • Internal: make sure that internally generated percolate request re-uses the original headers and request context #7767
    • Internal: make sure that update internal requests share the same original headers and request context #7766
    • Internal: Nest original exception while creating NoShardAvailableActionException #7757 (issue: #7756)
    • Internal: make sure that all delete mapping internal requests share the same original headers and context #7736
    • Internal: make sure that original headers are used when executing search as part of put warmer #7711
  • Java API:
    • Java API: package private getters to become public if there have corresponding public setters #9273
    • java: QueryBuilders cleanup (add and deprecate) #8667
    • Added utility method #8594
    • Java API: Enabled overriding the request headers in the clients #8258
    • Internal: add indices setter to IndicesRequest interface #7734
  • Logging:
    • Store: renaming temp files should log errors of delete in trace #9933
    • Fix logging a RoutingNode object, log an object with a good .toString instead #9863
    • Logging: improve logging messages added in #9562 #9603
    • Logging: add logging around gateway shard allocation #9562
    • Logging: Log byte and doc size for slow merges #8855 (issue: #8853)
    • Core: separately log file deletions #8662 (issue: #8603)
    • Logging: Add log4j-extras dependency #8464 (issue: #7927)
    • Core: log how long IW.rollback took, and when MockFSDir starts its check index #8388
    • Logs: Change log level for mpercolate #8306
    • Logging: suppress long mapping logging during mapping updates (unless in TRACE) #7949
    • Add log4j-extras dependency #7947 (issue: #7927)
    • Core: Add EnhancedPatternLayout to logging.yml options #4991
  • Mapping:
    • Mappings: Add enabled flag for _field_names to replace disabling through index=no #9893
    • [Mapper] Add ignore_missing option to <code>timestamp #9104 (issues: #8882, #9049)
    • Mapping: Include currentFieldName into ObjectMapper errors #9020
    • Mappings: Make lookup structures immutable. #7486
  • More Like This:
    • MLT Query: Support for when all fields are deprecated #8067
    • MLT Query: use minimum should match more extensive syntax #7898
  • NOT CLASSIFIED:
    • [LIFECYCLE] Add before/afterIndexShardDelete callback #10173
  • Network:
    • Netty HTTP Transport: Change access modifiers to protected #9724
    • Transport: added a simple request tracer, logging incoming and outgoing requests #9286
    • Netty Transport: Add profiles to transport infos #9134
    • Netty: Support binding on multiple host/port pair #8098
    • Internal: Chunk direct buffer usage by networking layer #7811
    • Netty: Make sure channel closing never happens on i/o thread #7726
  • Packaging:
    • Windows: makes elasticsearch.bat more friendly to automated processes #9160 (issue: #8913)
    • Shutdown: Add support for Ctrl-Close event on Windows platforms to grace... #8993
    • Packaging: Add java7/8 java-package paths to init script #8815 (issue: #7383)
    • Packaging: Check if proc file exists before calling sysctl #8793 (issue: #4978)
    • deb: add systemd service config for upcoming Jessie #8765 (issue: #8493)
    • bin/elasticsearch: add help, fix endless loop #8729 (issues: #2168, #7104)
    • Packaging: Introduce elasticsearch.in.bat (i.e. es.in for Windows) #8244 (issue: #8237)
    • add more checks to build_release.py #7913
    • Prevent init script from returning when the service isn't actually started #6909
    • Boostrap: Log startup exception to console if needed and to file as error #6581
    • Packaging: Use the new command line syntax in the init script #5033
    • Startup: Add ES_HOME to ES_INCLUDE search path #4958
  • Parent/Child:
    • Parent/child: Reduce memory usage in top children query #8165
  • Percolator:
    • Introduce index option named 'index.percolator.map_unmapped_fields_as_string' #9054 (issues: #9025, #9053)
  • Plugins:
    • [PLUGINS] Always send current ES version when downloading plugins #10131
  • Query DSL:
    • Add support for minimum_should_match to <code>simple_query_string #9864 (issue: #6449)
    • inner hits: Nested parent field should be resolved based on the parent inner hit definition #9251 (issue: #8153)
    • Raise an exception on an array of values being sent as the factor for a ... #9246 (issue: #7408)
    • inner_hits: Added another more compact syntax for inner hits. #8770
    • function_score: use query and filter together #8675 (issue: #8638)
    • Query: add option for analyzing wildcard/prefix to simple_query_strinq #8422 (issue: #787)
    • Query DSL: Expose max_determinized_states in regexp query, filter #8384 (issue: #8357)
    • FunctionScore: RandomScoreFunction now accepts long, as well a strings. #8311 (issue: #8267)
    • Be stricter parsing ids for ids query #7945 (issue: #7686)
    • Adding "min" score mode to parent-child queries #7771 (issue: #7603)
    • Query DSL: Throw parsing exception if terms filter or query has more than one field #5137 (issue: #5014)
    • Query DSL: Expose dist/pre/post options for SpanNotQuery #4452
  • REST:
    • [HTTP] add option to only return simple exception messages #10117
    • Rest: expose master_timeout flag on <code>GET _template & HEAD _template #9688
    • Rest: Adding support of multi-index query parameters for _cluster/state #9295 (issue: #5229)
    • Adds parameters to API endpoint cluster put settings specification #8769
    • Change IndexPrimaryShardNotAllocatedException from 409 to 500 #7987 (issue: #7632)
    • Percolator: Added missing percolate API parameters to the rest spec #7173
  • Recovery:
    • Recovery: add throttle stats #10097
    • Engine: update index buffer size during recovery and allow configuring version map size #10046 (issues: #6363, #6667)
    • Recovery: unify RecoveryState management to IndexShard and clean up semantics #9902 (issue: #9503)
    • [RECOVERY] Only iterate the files that we recovered from the commit #9761
    • Recovery: add a timeout to local mapping change check #9575
    • Recovery: flush immediately after a remote recovery finishes (unless there are ongoing ones) #9439
    • [RECOVERY] Release store lock before blocking on mapping updates #9102
    • [RECOVERY] Ensure shards are identical after recovery #8723
    • Recovery: be more resilient to partial network partitions #8720
    • [RECOVERY] Throw IndexShardClosedException if shard is closed #8648
    • Backport ShardRecoveryHandlerrefactorings to 1.x #8570
    • Recovery: refactor RecoveryTarget state management #8092 (issues: #7315, #7893)
  • Scripting:
    • Scripting: Add String to the default whitelisted receivers #9837 (issue: #8866)
    • Scripting: Make script.groovy.sandbox.method_blacklist_patch truly append-only #9473
    • Scripting: Make groovy sandbox method blacklist dynamically additive #9470
    • Scripting: Add explainable script again #8665 (issues: #7245, #8561)
    • Scripting: Created a parameter parser to standardise script options #7977
    • Provide more context variables in update scripts #5724 (issues: #1607, #2230, #2231)
  • Search:
    • Added nested scope to parse context that keeps track the current nested level during search request parsing #9692 (issue: #9305)
    • Search: Reduce memory usage during fetch source sub phase #8138
    • Internal: Don't let took be negative. #7968
    • Core: switch to Lucene QueryRescorer #7707 (issue: #6232)
  • Settings:
    • Add 'http.publish_port' setting to the HTTP module #8807 (issue: #8137)
    • Settings: Validates bool values in yaml for node settings #8186 (issue: #8097)
  • Snapshot/Restore:
    • [RESTORE] Refactor how restore cleans up files after snapshot was restored #9770
    • Snapshot/Restore: add support for changing index settings during restore... #9285 (issue: #7887)
    • Snapshot/Restore: Override write(byte[] b, int off, int len) in FilterOutputStream for better performance #8749 (issue: #8748)
    • Snapshot/Restore: Allow custom metadata to specify whether or not it sho... #7901 (issue: #7900)
  • Stats:
    • Recovery: add total operations to the _recovery API #10042 (issue: #9368)
    • API: add pending tasks count to cluster health #9877
    • Stats : Add time in index throttle to stats. #7896 (issue: #7861)
  • Store:
    • [INDICES] Schedule pending delete if index store delete fails #9856
    • [STORE] Improve safety when deleting files from the store #9801
    • [STORE] Add simple cache for StoreStats #9709 (issue: #9683)
    • [STORE] use Directory#fileLength() less during calculating checksums #9689
    • [STORE] Cache fileLength for fully written files #9683
    • [STORE] Synchronize operations that modify file mappings on DistributorDirectory #8408
    • [STORE] Cut over MetaDataStateFormat to NIO Path API #8297
    • [STORE] Remove special file handling from DistributorDirecotry #8276
    • [STORE] Fold two hashFile implemenation into one #7720
  • Term Vectors:
    • Term Vectors: requests are now timed #9583
    • Term Vectors: support for realtime #7846
  • Translog:
    • [CORE] Handle truncated translog gracefully #9797 (issue: #9699)
    • Internal: Write translog opSize twice #7735
  • Upgrade:
    • Core: upgrade to Lucene 4.10.4 bugfix release #9960
    • Internal: Log when upgrade starts and stops #9229 (issue: #9227)
    • Dependencies: Upgrade netty to 3.10.0.Final #9132
    • upgrade to lucene 4.10.3 release #9100
    • Internal: Upgrade to Jackson 2.4.2 #7934 (issue: #7932)
    • Internal: Upgrade to Lucene 4.10.1 snapshot #7844 (issue: #7905)

Bug fixes

  • Aggregations:
    • Aggregations: Be lenient when converting local to utc time in time zone roundings #10031 (issue: #10025)
    • Aggs: Fix rounding issue using date_histogram with <code>pre_zone_adjust_large_interval #9828 (issue: #8209)
    • Aggs: Fix rounding issues when using date_histogram and time zones #9790 (issues: #7673, #9491)
    • Aggregations: Prevent negative intervals in date_histogram #9690 (issue: #9634)
    • Aggs: Remove limitation on field access within aggs to the types provided in the search #9487
    • Aggs: nested agg needs to reset root doc between segments. #9441 (issues: #9436, #9437)
    • Aggs: Fix handling of multiple buckets being emitted for the same parent doc id in nested aggregation #9346 (issues: #8454, #9317)
    • Aggs: In reverse nested aggregation, fix handling of the same child doc id being processed multiple times. #9345 (issues: #9263, #9346)
    • Aggs: The parent filter of the nested aggregator isn't resolved correctly all the time #9335 (issue: #9280)
    • Aggs: post collection the children agg should also invoke that phase on its wrapped child aggs. #9291 (issue: #9271)
    • Aggs: Validate the aggregation order on unmapped terms in terms agg. #8952 (issue: #8946)
    • Aggregations: Fix date_histogram issues during a timezone DST switch #8655 (issue: #8339)
    • Fielddata: Fix iterator over global ordinals. #8627 (issue: #8580)
    • Aggregations: Fix geohash grid doc counts computation on multi-valued fields #8574 (issue: #8512)
    • Aggregations: Parser throws NullPointerException when Filter aggregation clause is empty #8527 (issue: #8438)
    • Aggregations: Fix geohash grid aggregation on multi-valued fields. #8513 (issue: #8507)
    • Aggregations: Change nested agg to execute in doc id order #8454
    • Aggregations: The children agg didn't take deleted document into account #8180
    • Aggregations: Fixes scripted metrics aggregation when used as a sub aggregation #8037 (issue: #8036)
    • Aggregations: Makes script params consistent with other APIs in scripted_metric #7969
    • Aggregations: Significant terms can throw error on index with deleted docs. #7960 (issue: #7951)
    • Aggregations: size property parsing inconsistent [ISSUE] #6061
  • Aliases:
    • Aliases: Take into account _default_ mapping in index template when parsing alias filter in index templates. #8577 (issue: #8473)
  • Allocation:
    • Allocation: Weight deltas must be absolute deltas #9149 (issue: #9023)
    • Allocation: Fix handling of dangling_timeout set to 0 and <code>auto_import_dangled true #8257
    • Allocation: Enable ClusterInfoService by default #8206
  • Bulk:
    • Bulk API: Handle failed request when auto create index is disabled #8163 (issue: #8125)
    • Bulk API: Bulk operation can create duplicates on primary relocation #7729
  • CAT API:
    • Stats: Fix NPE in /_cat/nodes #7815 (issue: #6297)
  • Circuit Breakers:
    • Circuit Breaker: Only set breaker when stats are retrieved #7721
  • Core:
    • Core: also throttle delete by query when merges fall behind #9986
    • Internal: promptly cleanup updateTask timeout handler #9621
    • Core: Disable auto gen id optimization #9468 (issue: #8788)
    • Core: Verify the index state of concrete indices after alias resolution #9057
    • Core: ignore_unavailable shouldn't ignore closed indices #9047 (issue: #7153)
    • Core: Terms filter lookup caching should cache values, not filters. #9027 (issues: #1, #2)
    • Core: Don't forcefully release IW lock (this can cause corruption) #8892 (issue: #8588)
    • Core: Hard wire utf-8 encoding, so unicode filenames work #8847
    • Gateway: GatewayService should register cluster state listener before checking for current state #8789
    • Core: Remove unnecessary index removal on index creation #8639
    • [GATEWAY] Remove _state directory if index has been deleted #8610
    • disable bloom filters #8572 (issues: #8564, #8571)
    • Core: Change default eager loading behaviour for nested fields and parent/child in bitset cache #8440
    • Core: Don't eagerly load NestedDocsFilter in bitset filter cache, because it is never used. #8414 (issue: #8394)
    • Internal: Extend refresh-mapping logic to the _default_ type #8413 (issue: #4760)
    • Internal: Translog leaks filehandles if it's corrupted or truncated #8372
    • Return 0 instead of -1 for unknown/non-exposed ramBytesUsed() #8291 (issue: #8239)
    • Resiliency: Don't catch FNF/NSF exception when reading metadata #8207
    • Internal: Don't handle FNF exceptions when reading snapshot #8086
  • Dates:
    • DateMath: Use time zone when rounding. #9885 (issue: #9814)
    • Query DSL: Resolve now in date ranges in percolator and alias filters at search time instead of parse time #8534 (issue: #8474)
  • Discovery:
    • Zen: Node receiving a cluster state with a wrong master node should reject and throw an error #9963
    • Discovery: check index uuid when merging incoming cluster state into the local one #9541 (issue: #9489)
    • Discovery: only retry join when other node is not (yet) a master #8979 (issue: #8972)
    • Discovery: Removed unnecessary DiscoveryService reference from LocalDiscovery #8415 (issue: #8539)
    • Discovery: Improve the lifecycle management of the join control thread in zen discovery. #8327
  • Engine:
    • [ENGINE] Upgrade 3.x segments on engine startup #9899
    • Core: SerialMergeScheduler never triggers index throttling #8405
    • Internal: Add current translog ID to commit meta before closing #8245
  • Geo:
    • [GEO] Fix validate_* merge policy for GeoPointFieldMapper [OPEN] #10165 (issue: #10164)
    • Geo: Correct bounding box logic for GeometryCollection type #9550 (issue: #9360)
    • Geo: Throw helpful exception for Polygons with holes outside of shell #9105 (issue: #9071)
    • Geo: GIS envelope validation #9091 (issues: #2544, #8672, #9067, #9079, #9080)
    • Geo: Fix for NPE enclosed in SearchParseException for a "geo_shape" filter or query #8785 (issue: #8432)
    • Geo: Fix for geohash neighbors when geohash length is even. #8529 (issue: #8526)
    • Geo: Fix for ArithmeticException[/ by zero] when parsing a polygon #8475 (issue: #8433)
    • geo sort: remove unnecessary code from geo distance builder #8338
    • Geo: Fix IndexedGeoBoundingBoxFilter to not modify the bits of other filters. #8325
  • Index APIs:
    • Indices API: Fix to make GET Index API consistent with docs #9178 (issue: #9148)
    • Indices API: Fixed backward compatibility issue #8387 (issue: #8364)
    • Internal: Fix optimize behavior with 'force' and 'flush' flags. #7920 (issues: #7886, #7904)
    • Indices API: fixes GET Alias API backwards compatibility #7892 (issue: #7793)
  • Indexed Scripts/Templates:
    • Scripting: ScriptService can deadlock entire nodes if script index is recovering #8901
    • Indexed Scripts/Templates: GetIndexedScript call can deadlock #8266
    • Make template params take arrays #8255
    • Indexed Scripts/Templates: Cleaned up various issues #7787 (issues: #7559, #7560, #7567, #7568, #7647)
  • Internal:
    • Internal: Fix PageCacheRecycler's max page size computation. #10087 (issue: #10077)
    • Ensure that we don't pass negative timeInQueue to writeVLong #9662 (issue: #8077)
    • Snapshot status api: make sure headers are handed over to inner nodes request #9409
    • fix equality check of timevalue after serialization #9218
    • Internal: AdapterActionFuture should not set currentThread().interrupt() #9141 (issue: #9001)
    • Internal: PlainTransportFuture should not set currentThread().interrupt() #9001
    • Internal: IndexService - synchronize close to prevent race condition with shard creation #8557
    • Index API: BWC layer for GetIndex should not block in a listener #8496
    • Internal: Don't pass acceptdocs down to nonNestedDocsFilter in ParentsFilter #8463 (issue: #8461)
    • Indices API: Fix GET index API always running all features #8452
    • Internal: When corruption strikes, don't create exceptions with circular references #8331
    • Internal: Fixed bitset filter cache leftover in nested filter #8303
    • Internal: Cleanup non nested filter to not flip the FixedBitSet returned by the wrapped filter. #8232 (issue: #8227)
    • Internal: Dynamic changes to max_merge_count are now picked up by index throttling #8136 (issue: #8132)
    • Internal: Only schedule another refresh if refresh_interval is positive #8087 (issue: #8085)
    • Internal: Fix serialization of PendingClusterTask.timeInQueue. #8077
    • Internal: dangling indices import ignores aliases #8059
    • Fix serialization of short[] arays. #8025 (issue: #7845)
    • Internal: Make close() synchronized during node shutdown #7885
  • Java API:
    • Mappings: Fix Get field mapping api with pretty flag #8806 (issue: #6552)
    • Settings: Ensure fields are overriden and not merged when using arrays #8381 (issue: #6887)
    • Fixing SearchRequestBuilder aggregations call to facets #8121 (issue: #8120)
    • Fixing copy/paste mistake in SearchRequest.extraSource's exception message #8118 (issue: #8117)
    • Aggregations: Added missing module registration in TransportClient for Significant Terms #7852 (issue: #7840)
  • Logging:
    • [STORE] Add filename to corruption message #10110 (issue: #10062)
    • Transport: fix potential NPE in new tracer log if request timeout #9994 (issue: #9286)
    • Fix example in logging daily rotate configuration #8550 (issue: #8464)
    • Internal: Fix location information for loggers #8052 (issue: #5130)
  • Mapping:
    • Fixes ignore_malformed behaviour for ip fields #10112
    • Mapping: Throw StrictDynamicMappingException exception #9445 (issue: #9444)
    • Mapping: Using default=null for _timestamp field creates a index loss on restart #9233 (issues: #9104, #9223)
    • Mapping: Reencode transformed result with same xcontent #8974 (issue: #8959)
    • Mapping: serialize doc values settings for _timestamp #8967 (issue: #8893)
    • mappings: update cluster state with type mapping also for failed indexin... #8692 (issue: #8650)
    • Mapping: Fix conflict when updating mapping with _all disabled #8426 (issues: #7377, #8423)
    • Mappings: Generate dynamic mappings for empty strings. #8329 (issue: #8198)
    • Mapping: Throw exception if null_value is set to null #7978 (issue: #7273)
    • Mapping: Posting a mapping with default analyzer fails #7902 (issue: #2716)
  • More Like This:
    • MLT Query: Fix exclude with artificial documents #8679
  • Network:
    • Netty: Add HTTP pipelining support #8299 (issue: #2665)
  • Packaging:
    • Packaging: Add antlr and asm dependencies #9696
    • Packaging: Added quotes to allow spaces in installation path #8428 (issue: #8441)
    • Packaging: Move forbidden api signature files to dev-tools. #7921 (issue: #7917)
    • Packaging: Export JAVA_HOME in RPM init script #5434
  • Parent/Child:
    • Parent/child: Fix concurrency issues of the _parent field data. #9030 (issue: #8396)
    • Parent/child: Fixed p/c filters not being able to be used in alias filters. #8649 (issues: #5916, #8628)
    • Bulk API: Missing parent routing causes NullPointerException #8506 (issue: #8365)
    • Parent/child: has_parent filter must take parent filter into account when executing the inner query/filter #8020 (issue: #7362)
  • Percolator:
    • Percolator: Support encoded body as query string param consistently #9628
    • Percolator: Take filters from aliases into account #9590 (issue: #6241)
    • Percolator: Fixed bug when using multi percolate api with routing #9161 (issue: #6214)
  • Plugins:
    • Plugins: Installation failed when directories are on different file systems #9011 (issue: #8999)
    • Plugins: NPE when plugins dir is inaccessible #8839 (issue: #8837)
    • Plugins: Support usage of ES_JAVA_OPTS in plugin commands #8288
    • PluginManager: Fix config path extraction from plugin handle #7935
  • Query DSL:
    • Query DSL: Fix wrong error messages in MultiMatchQueryParser #8597
    • DateMath: Fix semantics of rounding with inclusive/exclusive ranges. #8556 (issue: #8424)
    • Query DSL: Fix NumberFormatException in Simple Query String Query #7876 (issue: #7875)
  • REST:
    • REST: Add fielddata_fields to the REST spec #9399 (issues: #4492, #9398)
    • Search: Passing fieddata_fields as a non array causes OOM #8203
  • Recovery:
    • Gateway: improve assertion at the end of shard recovery #10028
    • Recovery: synchronize RecoveryState.timer methods #9943
    • [RECOVERY] Don't recover from buggy version #9925 (issues: #7210, #9922)
    • Engine: close snapshots before recovery counter #9760 (issue: #9439)
    • [ENGINE] Fix deadlock problems when API flush and finish recovery happens concurrently #9648
    • [RECOVERY] Handle corruptions during recovery finalization #9619
    • Core: Mapping update task back references already closed index shard #9607
    • Recovery: update access time of ongoing recoveries #9506 (issue: #8720)
    • Recovery: cleaner interrupt handling during cancellation #9000
    • Internal: harden recovery for old segments #8399
    • Gateway: Prefer recovering the state file that uses the latest format. #8343
    • Recovery: change check for finished to a ref count check #8271 (issue: #8092)
    • Recovery: RecoveriesCollection.findRecoveryByShard should call recoveryStatus.tryIncRef before accessing fields #8231 (issue: #8092)
  • Scripting:
    • Scripting: File scripts cache key to include language and prevent conflicts #10033
    • script_file does not work with _update [ISSUE] #10007
    • Internal: Avoid unnecessary utf8 conversion when creating ScriptDocValues for a string field. #9557 (issue: #6908)
    • Scripting: Disallow method pointer expressions in Groovy scripting #9509
    • Scripting: Make _score in groovy scripts comparable #9094 (issue: #8828)
    • Search: Function score and optional weight : avg score is wrong #9004 (issue: #8992)
    • Scripting: Return new lists on calls to getValues. #8591 (issue: #8576)
    • Scripting: Add score() back to AbstractSearchScript #8417 (issues: #8377, #8416)
    • Scripting: Clear the GroovyClassLoader cache before compiling #8062 (issues: #7658, #8073)
    • Scripting: Fix NPE in ScriptService when script file with no extension is deleted #7953 (issue: #7689)
  • Search:
    • inner hits: Don't fail if an object is specified as a nested value instead of an array. #9743 (issue: #9723)
    • Query cache: Remove query-cache serialization optimization. #9500 (issue: #9294)
    • inner_hits: Make sure inner hits on has_parent query resolve hits properly #9384
    • Query cache: Queries are never cached when date math expressions are used (including exact dates) #9269 (issue: #9225)
    • Search: Make sure that named filters/ queries defined in a wrapped query/filters aren't lost #9166 (issue: #6871)
    • Search: Fix paging on strings sorted in ascending order. #9157 (issue: #9136)
    • Refactor term analysis for simple_query_string prefix queries #8435
  • Settings:
    • Settings: Reset TieredMP settings only if the value actually changed #9497 (issue: #8890)
    • Settings: cluster.routing.allocation.disk.threshold_enabled accepts wrong values [ISSUE] #9309
    • Settings: Tab characters in YAML should throw an exception #8355 (issue: #8259)
    • Settings: LogConfigurator resolveConfig also reads .rpmnew or .bak files #7457
  • Snapshot/Restore:
    • Snapshot/Restore: delete operation should ignore finalizing shards on no... #9981 (issue: #9924)
    • Snapshot/Restore: Allow deletion of snapshots with corrupted snapshot files #9569 (issue: #9534)
    • Snapshot/Restore: better handling of index deletion during snapshot #9418 (issue: #9024)
    • Snapshot/Restore: add validation of restored persistent settings #9051 (issue: #8830)
    • Snapshot/Restore: restore with wait_for_completion=true should wait for succesfully restored shards to get started #8545 (issue: #8340)
    • Snapshot/Restore: keep the last legacy checksums file at the end of rest... #8358 (issue: #8119)
    • Snapshot/Restore: restore of indices that are only partially available i... #8341 (issue: #8224)
    • Snapshot/Restore: Fix snapshotting of a single closed index #8047 (issue: #8046)
    • Snapshot/Restore: Make it possible to delete snapshots with missing metadata file #7981 (issue: #7980)
    • Snapshot/Restore: Make sure indices cannot be renamed into restored aliases #7918 (issue: #7915)
  • Stats:
    • Translog: make sure stats's op count and size are in sync #10041
    • Nodes Stats: Fix open file descriptors count on Windows #9397 (issue: #1563)
    • Stats: Relax restrictions on filesystem size reporting in DiskUsage #9283 (issues: #9249, #9260)
    • Indices API: Fix wrong search stats groups #8950 (issue: #7644)
    • Stats: Fix Bloom filter ram usage calculation #8584 (issue: #8564)
    • Stats: _status with #shards >> queue capacity failing with BroadcastShardOperationFailedException [ISSUE] #7916
  • Store:
    • Internal: only ack index store deletion on data nodes #9672 (issue: #9605)
    • [Store] Only fail recovery if files are inconsistent #8779
    • Store: Use Lucene checksums if segment version is >= 4.9.0 #8599 (issue: #8587)
    • Store: Calculate Alder32 Checksums for legacy files in Store#checkIntegrity #8407
  • Suggesters:
    • return an HTTP error code when a suggest request failed instead of 200 #10104
    • Completion Suggester: Fix CompletionFieldMapper to correctly parse weight #8197 (issue: #8090)
  • Translog:
    • Translog: stats fail to serialize size #10105
    • [GATEWAY] copy translog file if rename fails after retries. #9980
    • Translog: Never delete translog file from a snapshot #8917
  • Tribe Node:
    • Tribe node: system properties and configuration settings must not be forwarded to tribe clients #9721 (issue: #9576)
    • Tribe node: remove closed indices from cluster state #9334
  • Upgrade:
    • Upgrade: Fix version check in bytes to upgrade that spans major versions #9340

Regression

  • Mapping:
    • Mapping: Mapping With a null Default Timestamp Causes NullPointerException on Merge #9205 (issue: #9204)

Docs

  • Geo:
    • [GEO] fix docs for geo_point "validate" option [OPEN] #10168 (issue: #9539)
  • Java API:
    • A getHits() was forgotten! #9320
    • [Doc] Java API: add search templates #8716 (issue: #7321)
    • Docs: Add java documentation for aggregations #8694
  • NOT CLASSIFIED:
    • Need additional line in config file, to work tutorial's example. [ISSUE] #10074
    • fix typo #10045
    • Fix some docs n typos #10029
    • Documented default value for node_initial_primaries_recoveries #9955
    • [DOCS] added a note for the default shard_size value #9873
    • [DOCS] Default units for Geo Distance Agg is meters not km [ISSUE] #9812
    • [doc] Link mapper-attachment type documentation to its repo #9756 (issue: #101)
    • Clarify no master block [ISSUE] #9739
    • Add warning to settings documentation because setting number_of_replicas on a closed can lead to index beeing not openable again #9591 (issue: #9566)
    • Docs: Use the new experimental annotation. #9563
    • Testing classes don't support Parameterized tests? [ISSUE] #9423
    • Updates the command to add the repo #9261
    • Fix typo in sample json of keyword marker tokenfilter #9253
    • [TEST] Add missing docs and tests for '_cat/segments' #9179 (issue: #5856)
    • [Doc] Java API: add information on JBoss EAP #8766 (issue: #3445)
    • [DOCS] Document ActionNames class and related tests #8759
    • Fix error in documentation #8605
    • Update DiskThresholdDecider javadoc #8585 (issue: #6201)
    • Docs: Fix a typo in a javadoc comment #8575
    • Missing quote in the example #8565
    • randomizedtesting jar versions mismatch [ISSUE] #8450
    • Docs: note about confusing disk threshold settings #8437
    • Docs: document action.replication_type setting #8290
    • MLT Query: use ParseField#withAllDeprecated for percent_terms_to_match #8241
    • Docs: Clarify that index.routing.allocation.total_shards_per_node applies to replica and primary #8002
    • Docs: rolling upgrade process seems incorrect [ISSUE] #7973
    • null_value and dynamic_templates not working correctly [ISSUE] #7874
    • Docs : Filtering based on exact values not working [ISSUE] #7807
    • Docs: Document the most important changes to zen discovery. #7746
    • Inconsistent ceiling round up in range search for "lt" (less than) [ISSUE] #7203
  • Packaging:
    • Packaging: Added a command to start elasticsearch on bootup. #8600

Tests

  • Aggregations:
    • Adding tests for TimezoneRounding in 1.x #9796
  • NOT CLASSIFIED:
    • [TEST] Add tests that triggers truncated files on recovery #10155
    • [TESTS] Make sure test end with ..Tests #9947 (issue: #9945)
    • [TEST] Work around URI encode limitations in RestClient #9946 (issue: #9769)
    • Tests: Add back tests.cluster #9916
    • [TEST] Fix NPE in ElasticsearchIntegrationTest if no indexer is provided #9909 (issue: #9907)
    • Tests: check node ports availability when using unicast discovery #9886
    • Tests: Use all found index files instead of static list for static bwc tests #9854
    • Tests: Remove thread leak filter #9843
    • [TEST] Don't reuse single node tests node instance across tests #9813
    • Kernel32LibraryTests creates JNA proxy classes [ISSUE] #9802
    • Tests: Remove global shared cluster #9781 (issue: #8854)
    • Test: Remove use of globalTempDir() and forbid it from future use. #9777
    • Testing: Added REST tests to check if expression scripting works #9750
    • Testing: Ensure RepeatOnException rule is available in test-jar #9675
    • [TEST] Introduce basic validation of our REST spec #9629
    • Tests: Add static indexes to fill out 0.20.x coverage. #9537
    • [TEST] support stashed values within property names in our REST tests #9533
    • Testing: Add test rule to repeat tests on binding exceptions #9527 (issue: #9010)
    • Tests: Add type-unrestricted version of field mapper getter to SearchContext #9490
    • Test: use local gateway by default #9476
    • Tests: Rename tests with the same name #9370
    • Internal: Change snapshot state for unreleased versions and add validation tests for constants #9228
    • Tests: Add upgrade step to static bwc tests #9207
    • Add 0.20.x index. #9146
    • Don't enable custom data_path for backwards compatibility tests #9119
    • Fix TransportNodesListShardStoreMetaData for custom data paths #9101
    • [TEST] Make sure we restart the suite cluster after each test failure #9015
    • [TEST] upgrade randomized runner to 2.1.11 #8930
    • [TEST] LoggingListener to restore the initial logger levels after any modification #8845 (issue: #8820)
    • Test: fix InternalEngineTest.testIndexWriterIFDInfoStream to pass in IntelliJ #8822
    • [TEST] Pass class level test logging to external nodes #8820 (issue: #8552)
    • [TEST] Add unit tests for DiskThresholdDecider settings #8816
    • [TEST] guarantee REST tests execution order #8745
    • [TEST] make sure rest tests info is printed for any @Rest annotated test #8680 (issue: #7795)
    • [TEST] split base settings in ClusterDiscoveryConfiguration between node and transport client #8653
    • [TEST] Extend unicast ports generation to support more concurrent clusters #8634
    • [TEST] Register data.path for all nodes on close in InternalTestCluster #8519
    • Tests: Skip bwc analysis tests if using turkish or azuri locale. #8492
    • Allow -SNAPSHOT versions to be parsed by Version.fromString #8379
    • [TEST] move ClusterDiscoveryConfiguration to org.elasticsearch.test.discovery #8337
    • Tests: Pass through locale and timezone to test runner, and print in repro command line. #8315
    • [TEST] Remove redundant call to setTemplateType() #8295
    • [TEST] initialize SUITE | GLOBAL scope cluster in a private random context #8250
    • [TEST] Scope.SUITE is not reproducible due to late cluster initialization #8220
    • [TEST] Add simple BWC tests that start from pre-build indices [ISSUE] #8065
    • Tests: dump all thread stacks on failure #8033
    • [TEST] fix CurrentTestFailedMarker to reset its state after each test #8008
    • [TEST] create client nodes using node.client: true #7911
    • [TEST] Use Shutdown API only if nodes are on 1.3.3 or newer to prevent shutdown problems #7910 (issue: #7885)
    • [TEST] add regular scroll REST test #7860
    • Internal: MulticastChannel should wait on receiver thread to stop during shutdown #7835
    • Tests: Add a more restrictive thread leaks filter #7825 (issue: #7833)
    • [TEST] move REST tests to their own test group #7795
    • [TEST] Only reset test cluster if a test actually failed #7775
    • [TEST] Improve HTTP support in TestClusters #7738
    • [TEST] Update REST client before each test in our REST tests #7737 (issues: #6734, #7723)
    • Test: always run CheckIndex after a test, and fail the test if it detects corruption #7730
    • Tests: always run CheckIndex on all shards created by the test [ISSUE] #7724
    • [TEST] Minor REST tests infra cleanup #7723
    • [TEST] Expose ability to provide http headers when sending requests in our REST tests #7710
    • Tools: Add script to grab ES version for BWC tests. #7653
    • Geo: [TEST] Adds tests for GeoUtils #7510
    • Benchmark: BenchmarkIntegrationTest failure fixed [ISSUE] #6094
    • Test: Integration tests for benchmark API. #6023 (issue: #6003)
    • Test: Start nodes using node.bench true to enable benchmark api #5920 (issue: #5910)
  • Recovery:
    • [RECOVERY] Make recovery delay configurable #8739
  • Snapshot/Restore:
    • Tests: Make sure snapshots created with old version of elasticsearch can... #8968

Not classified

  • NOT CLASSIFIED:
    • Core: check only call rate limiter every minPauseCheckBytes during recovery [OPEN] #10185 (issue: #6018)
    • Build: Check that all packages contain the same jar files #9757
    • Rename Maven repository id #9733
    • [BUILD] Add marvel and license to the release script #9697
    • ignore intellij project/workspace files #9044
    • Switch to forbidden-apis 1.7 #8620
  • Recovery:
    • Recovery: node shut down during the last phase of recovery needlessly fails shard [ISSUE] #9496