Breaking changes Aliases:
Aliases: Throw exception if index is null or missing when creating an alias #8240 (issues: #7863 , #7976 ) Benchmark:
Benchmark api: removed leftovers #10180 Core:Resiliency: Throw exception if the JVM will corrupt data #7580 Engine:
[ENGINE] Remove full flush / FlushType.NEW_WRITER #9559 Index APIs:
Change behaviour of indices segments api to allow no indices #9219 (issue: #5856 ) Plugins:
Plugins: Don't overwrite plugin configuration when removing/upgrading plugins #7890 (issue: #5064 ) Recovery:Recovery: RecoveryState clean up #9811 (issue: #6644 ) Scripting:
Scripting: cleanup ScriptService & friends in preparation for #6418 #9992 (issue: #6418 ) Disable dynamic Groovy scripting by marking Groovy as not sandboxed [ISSUE] #9655 Scripting: Script with _score: remove dependency of DocLookup and scorer #7819 (issues: #7043 , #7487 ) Deprecations CRUD:
Core:
Core: deprecate index.fail_on_merge_failure #10084 Mapping:
Mappings: Deprecate _analyzer and per query analyzers #9383 (issue: #9279 ) More Like This:
Deprecation: MLT Field Query #8253 Network:
Deprecated the thrift and memcached transports #10167 (issue: #10166 ) Search:
Core: add deprecation messages for delete-by-query #10082 New features Aggregations:
New aggregations feature - “PercentageScore" heuristic for significant_terms #9747 (issue: #9720 ) significant terms: add scriptable significance heuristic #7850 CAT API:
Cat API: show open and closed indices in _cat/indices #7936 (issue: #7907 ) Circuit Breakers:
Circuit Breakers: Add NoopCircuitBreaker used in NoneCircuitBreakerService #8063 Engine:
Shadow replicas on shared filesystems #9727 (issue: #8976 ) More Like This:
MLT Query: Support for artificial documents #7725 Query DSL:
Add time_zone setting for query_string #8164 (issue: #7880 ) Search: add format support for date range filter and queries #7821 (issue: #7189 ) Add min_score parameter to function score query to only match docs above this threshold #7814 (issue: #6952 ) Search:
Add inner hits to nested and parent/child queries #8153 (issues: #3022 , #3152 ) Store:
Term Vectors:
Term Vectors/MLT Query: support for different analyzers than default at the field #7801 Enhancements Aggregations:
Aggregations: deprecate pre_zone and <code>post_zone in date_histogram #9722 (issue: #9062 ) Aggregations: Add 'offset' option to date_histogram #9614 (issue: #9062 ) Aggregations: Numeric metric aggregations are now formattable #9032 (issue: #6812 ) Aggregations: Adds methods to get to/from as Strings for Range Aggs #9026 (issue: #9003 ) Made the nested, <code>reverse_nested and children aggs ignore unmapped nested fields or unmapped child / parent types. #8808 (issue: #8760 ) Fixed #6061 size parsing consistent for strings #8645 Aggregations: Do not take deleted documents into account in aggregations filters. #8540 Aggs - support for arrays of numeric values in include/exclude clauses #7727 (issue: #7714 ) Aggregations: Adds ability to sort on multiple criteria #7662 (issues: #6917 , #7588 ) Aggregations: Properly support top_hits aggregation in a nested and reverse_nested aggregations. #7164 (issue: #3022 ) Allocation:
Allocation: Speed-up disk-threshold decider #8803 (issue: #6372 ) Allocation: DiskThresholdDecider#remain(...) should take shards relocating away into account #8659 (issue: #8538 ) Allocation: Take percentage watermarks into account for reroute listener #8382 (issues: #8367 , #8368 ) Allocation: Reroute shards automatically when high disk watermark is exceeded #8270 (issue: #8146 ) Add option to take currently relocating shards' sizes into account #7785 (issues: #6168 , #7753 ) CAT API:
Mark shadow replicas with 's' in _cat/shards output #10023 (issue: #9772 ) Admin: add total index memory in _cat/indices #7824 (issue: #7008 ) Add file descriptor details to cat/nodes #7655 (issue: #7652 ) Circuit Breakers:
Circuit Breakers: Log if CircuitBreaker is tripping #8050 Core:
Core: don't rethrow already handled merge exceptions #10083 [ENV] NodeEnv should lock all shards for an index #9799 [CORE] Allow primary promotion on shadow replica without failing the shard #9786 [INDICES] Retry if shard deletes fail due to IOExceptions #9784 Core: only do a single listAll from FileSwitchDir #9666 (issue: #6636 ) Core: Remove ability to run optimize and upgrade async #9640 (issue: #9638 ) Update joda-time to v2.7 #9610 [CORE] Consolidate index / shard deletion in IndicesService #9605 Minor hygiene, Removed Redundant inheritance #9427 Core: don't throttle recovery indexing operations #9396 (issue: #9394 ) Core: increase default xlog flush size from 200mb to 512 mb #9341 (issue: #9265 ) Pass through all exceptions in IndicesLifecycleListeners #9330 Pass index settings to IndicesLifecycle#beforeIndexCreated and #afterIndexShardClosed #9245 Core: Fix Store.checkIntegrity() for lucene 3.x index files. #9234 Core: Don't verify adler32 for lucene 3.x terms dict/terms index. #9142 [CORE] Delete shard content under lock #9083 (issues: #8608 , #9009 ) [SEARCH] close active contexts on SearchService#close() #8947 (issue: #8940 ) Core: use Lucene's defaults for compound file format #8934 (issue: #8919 ) [CORE] Remove explicit .cleanUp() on cache clear #8924 Core: clarify index removal log message #8641 [CORE] Ensure shards are deleted under lock on close #8579 [INDEX] Add before/after indexDeleted callbacks to IndicesLifecycle #8569 (issue: #8551 ) [CORE] Free pending search contexts if index is closed #8551 [CORE] Ban all usage of Future#cancel(true) #8494 Core: set bloom default to false even when Directory doesn't have a codecService #8442 [CORE] Introduce shard level locks to prevent concurrent shard modifications #8436 Discovery: Don't wait joinThread when stopping #8359 (issue: #8327 ) [STATE] Observe cluster state on health request #8350 [UTILITIES] Introduce a RefCounted interface and basic impl #8210 Use 1 instead of 0 as filler version value for nested docs #8145 [CORE] Add cluster and index state checksums #8010 (issue: #7586 ) Resiliency: Perform write consistency check just before writing on the primary shard #7873 [CORE] Add ThreadPool.terminate to streamline shutdown #7868 [CORE] Add ActionRunnable support to ThreadPool to simplify async operation on bounded threadpools #7765 Internal: Add missing cluster blocks handling for master operations #7763 (issue: #7740 ) Discovery:
[Discovery] Prevent stale master nodes from sharing dated cluster states to nodes that have moved to a different master node #9632 Discovery: publishing timeout to log at WARN and indicate pending nodes #9551 Discovery: Concurrent node failures can cause unneeded cluster state publishing #8933 (issue: #8804 ) [CLIENT] Only fetch the node info during node sampling #8685 Discovery: don't accept a dynamic update to min_master_nodes which s larger then current master node count #8321 Discovery: Improve handling of multicast binding exceptions #8243 (issue: #8225 ) Discovery: Simplify discovery node initialization if version is unknown #8055 (issue: #8051 ) Discovery: Close ping handler's executor service properly #7903 Engine:
[CORE] move InternalEngine.segmentStats() into abstract Engine #9728 (issue: #9727 ) [ENGINE] Move more methods into abstract Engine #9717 [CORE] Move as much as possible into abstract Engine #9678 [ENGINE] Factor out settings updates from Engine #9625 [ENGINE] Close Engine immediately if a tragic event strikes. #9616 (issue: #9517 ) [CORE] Refactor InternalEngine into abstract Engine and classes #9585 [ENGINE] Remove FlushType and make resources final in InternalEngine #9565 [ENGINE] Simplify Engine construction and ref counting #9211 [CORE] Fold engine into IndexShard #9181 Core: Don't acquire Engine's readLock in segmentsStats #8910 (issue: #8905 ) [ENGINE] Remove engine related command classes #8900 Internal: allow InternalEngine to be stopped and started #8784 (issue: #8720 ) [ENGINE] Flush IndexWriter to disk on close and shutdown #7563 Geo:
Revert "[GEO] Update GeoPolygonFilter to handle ambiguous polygons" #9463 (issues: #5968 , #9304 , #9339 , #9462 ) Geo: Update GeoPolygonFilter to handle polygons crossing the dateline #9339 (issues: #5968 , #8672 , #9304 ) Geo: GeoPolygonFilter not properly handling dateline and pole crossing #9171 (issue: #5968 ) Geo: Removing unnecessary orientation enumerators #9036 (issues: #8978 , #9035 ) Geo: Add optional left/right parameter to GeoJSON #8978 (issue: #8764 ) Geo: Feature/Fix for OGC compliant polygons failing with ambiguity #8762 (issue: #8672 ) Geo: Fixes BoundingBox across complete longitudinal range #7340 (issue: #5218 ) Index Templates:
Provide template usage information on index creation #8646 (issue: #7421 ) Internal:
Core: fix typo when primary is not available to index a document (UnavailableShardsException) #10140 [SHARD] make assert less strict to ensure local node is not null #10076 Use provided cluster state for indices service validations #10014 some more simple fs cleanups. #9827 Removed 'Master' from names.txt #9698 (issue: #9687 ) Internal: Introduce TimedPrioritizedRunnable base class to all commands that go into InternalClusterService.updateTasksExecutor #9671 (issues: #8077 , #9354 ) Update Groovy dependency to 2.4.0 #9520 Add beforeIndexAddedToCluster callback #9514 [CACHE] Use a smaller expected size when serializing query results #9485 [CACHE] Use correct number of bytes in query cache accounting #9479 Internal: add AliasesRequest interface to mark requests that manage aliases #9460 Internal: ClusterInfoService should wipe local cache upon unknown exceptions #9449 Internal: fix shard state tranport action names #9440 (issue: #7105 ) Mappings: Remove includeExisting flag from adding ObjectMapper and FieldMapper listeners #9184 Internal: assert that we do not call blocking code from transport threads #9164 [EXEC] Remove reduced stack size #9158 (issue: #9135 ) Search: parse terms filters on a single term as a term filter. #9014 Internal: remove IndexCloseListener & Store.OnCloseListener #9009 (issues: #8436 , #8608 ) Core: add ignore_idle_threads (default: true) to hot threads #8985 (issue: #8908 ) Remove circular dependency between IndicesService and IndicesStore #8918 Remove some Internal* abstractions #8904 [HEALTH] Don't mark health as timed out if desired state is reached #8683 Internal: Use a 1024 byte minimum weight for filter cache entries #8304 (issues: #8249 , #8268 ) Immediately remove filter cache entries on cache clear #8289 (issue: #8285 ) Internal: Make indexQueryParserService available from ParseContext #8252 (issue: #8248 ) Internal: Allow to configure custom thread pools #8247 Internal: Expose concurrency_level setting on all caches #8112 (issue: #7836 ) Resiliency: Be more conservative if index.version.created is not set #8018 Internal: split internal fetch request used within scroll and search #7870 (issues: #6933 , #7319 , #7856 ) Internal: split internal free context request used after scroll and search #7856 (issues: #6933 , #7319 ) Internal: Clarify when a shard search request gets created to be only used locally #7855 Internal: Add a listener thread pool #7837 Internal: remove ForceSyncDirectory #7804 Internal: Check if from + size don't cause overflow and fail with a better error #7778 (issue: #7774 ) Internal: make sure that internally generated percolate request re-uses the original headers and request context #7767 Internal: make sure that update internal requests share the same original headers and request context #7766 Internal: Nest original exception while creating NoShardAvailableActionException #7757 (issue: #7756 ) Internal: make sure that all delete mapping internal requests share the same original headers and context #7736 Internal: make sure that original headers are used when executing search as part of put warmer #7711 Java API:
Java API: package private getters to become public if there have corresponding public setters #9273 java: QueryBuilders cleanup (add and deprecate) #8667 Added utility method #8594 Java API: Enabled overriding the request headers in the clients #8258 Internal: add indices setter to IndicesRequest interface #7734 Logging:
Store: renaming temp files should log errors of delete in trace #9933 Fix logging a RoutingNode object, log an object with a good .toString instead #9863 Logging: improve logging messages added in #9562 #9603 Logging: add logging around gateway shard allocation #9562 Logging: Log byte and doc size for slow merges #8855 (issue: #8853 ) Core: separately log file deletions #8662 (issue: #8603 ) Logging: Add log4j-extras dependency #8464 (issue: #7927 ) Core: log how long IW.rollback took, and when MockFSDir starts its check index #8388 Logs: Change log level for mpercolate #8306 Logging: suppress long mapping logging during mapping updates (unless in TRACE) #7949 Add log4j-extras dependency #7947 (issue: #7927 ) Core: Add EnhancedPatternLayout to logging.yml options #4991 Mapping:
Mappings: Add enabled flag for _field_names to replace disabling through index=no #9893 [Mapper] Add ignore_missing option to <code>timestamp #9104 (issues: #8882 , #9049 ) Mapping: Include currentFieldName into ObjectMapper errors #9020 Mappings: Make lookup structures immutable. #7486 More Like This:
MLT Query: Support for when all fields are deprecated #8067 MLT Query: use minimum should match more extensive syntax #7898 NOT CLASSIFIED:
[LIFECYCLE] Add before/afterIndexShardDelete callback #10173 Network:
Netty HTTP Transport: Change access modifiers to protected #9724 Transport: added a simple request tracer, logging incoming and outgoing requests #9286 Netty Transport: Add profiles to transport infos #9134 Netty: Support binding on multiple host/port pair #8098 Internal: Chunk direct buffer usage by networking layer #7811 Netty: Make sure channel closing never happens on i/o thread #7726 Packaging:
Windows: makes elasticsearch.bat more friendly to automated processes #9160 (issue: #8913 ) Shutdown: Add support for Ctrl-Close event on Windows platforms to grace... #8993 Packaging: Add java7/8 java-package paths to init script #8815 (issue: #7383 ) Packaging: Check if proc file exists before calling sysctl #8793 (issue: #4978 ) deb: add systemd service config for upcoming Jessie #8765 (issue: #8493 ) bin/elasticsearch: add help, fix endless loop #8729 (issues: #2168 , #7104 ) Packaging: Introduce elasticsearch.in.bat (i.e. es.in for Windows) #8244 (issue: #8237 ) add more checks to build_release.py #7913 Prevent init script from returning when the service isn't actually started #6909 Boostrap: Log startup exception to console if needed and to file as error #6581 Packaging: Use the new command line syntax in the init script #5033 Startup: Add ES_HOME to ES_INCLUDE search path #4958 Parent/Child:
Parent/child: Reduce memory usage in top children query #8165 Percolator:
Introduce index option named 'index.percolator.map_unmapped_fields_as_string' #9054 (issues: #9025 , #9053 ) Plugins:
[PLUGINS] Always send current ES version when downloading plugins #10131 Query DSL:
Add support for minimum_should_match to <code>simple_query_string #9864 (issue: #6449 ) inner hits: Nested parent field should be resolved based on the parent inner hit definition #9251 (issue: #8153 ) Raise an exception on an array of values being sent as the factor for a ... #9246 (issue: #7408 ) inner_hits: Added another more compact syntax for inner hits. #8770 function_score: use query and filter together #8675 (issue: #8638 ) Query: add option for analyzing wildcard/prefix to simple_query_strinq #8422 (issue: #787 ) Query DSL: Expose max_determinized_states in regexp query, filter #8384 (issue: #8357 ) FunctionScore: RandomScoreFunction now accepts long, as well a strings. #8311 (issue: #8267 ) Be stricter parsing ids for ids query #7945 (issue: #7686 ) Adding "min" score mode to parent-child queries #7771 (issue: #7603 ) Query DSL: Throw parsing exception if terms filter or query has more than one field #5137 (issue: #5014 ) Query DSL: Expose dist/pre/post options for SpanNotQuery #4452 REST:
[HTTP] add option to only return simple exception messages #10117 Rest: expose master_timeout flag on <code>GET _template & HEAD _template #9688 Rest: Adding support of multi-index query parameters for _cluster/state #9295 (issue: #5229 ) Adds parameters to API endpoint cluster put settings specification #8769 Change IndexPrimaryShardNotAllocatedException from 409 to 500 #7987 (issue: #7632 ) Percolator: Added missing percolate API parameters to the rest spec #7173 Recovery:
Recovery: add throttle stats #10097 Engine: update index buffer size during recovery and allow configuring version map size #10046 (issues: #6363 , #6667 ) Recovery: unify RecoveryState management to IndexShard and clean up semantics #9902 (issue: #9503 ) [RECOVERY] Only iterate the files that we recovered from the commit #9761 Recovery: add a timeout to local mapping change check #9575 Recovery: flush immediately after a remote recovery finishes (unless there are ongoing ones) #9439 [RECOVERY] Release store lock before blocking on mapping updates #9102 [RECOVERY] Ensure shards are identical after recovery #8723 Recovery: be more resilient to partial network partitions #8720 [RECOVERY] Throw IndexShardClosedException if shard is closed #8648 Backport ShardRecoveryHandlerrefactorings to 1.x #8570 Recovery: refactor RecoveryTarget state management #8092 (issues: #7315 , #7893 ) Scripting:
Scripting: Add String to the default whitelisted receivers #9837 (issue: #8866 ) Scripting: Make script.groovy.sandbox.method_blacklist_patch truly append-only #9473 Scripting: Make groovy sandbox method blacklist dynamically additive #9470 Scripting: Add explainable script again #8665 (issues: #7245 , #8561 ) Scripting: Created a parameter parser to standardise script options #7977 Provide more context variables in update scripts #5724 (issues: #1607 , #2230 , #2231 ) Search:
Added nested scope to parse context that keeps track the current nested level during search request parsing #9692 (issue: #9305 ) Search: Reduce memory usage during fetch source sub phase #8138 Internal: Don't let took be negative. #7968 Core: switch to Lucene QueryRescorer #7707 (issue: #6232 ) Settings:
Add 'http.publish_port' setting to the HTTP module #8807 (issue: #8137 ) Settings: Validates bool values in yaml for node settings #8186 (issue: #8097 ) Snapshot/Restore:
[RESTORE] Refactor how restore cleans up files after snapshot was restored #9770 Snapshot/Restore: add support for changing index settings during restore... #9285 (issue: #7887 ) Snapshot/Restore: Override write(byte[] b, int off, int len) in FilterOutputStream for better performance #8749 (issue: #8748 ) Snapshot/Restore: Allow custom metadata to specify whether or not it sho... #7901 (issue: #7900 ) Stats:
Recovery: add total operations to the _recovery API #10042 (issue: #9368 ) API: add pending tasks count to cluster health #9877 Stats : Add time in index throttle to stats. #7896 (issue: #7861 ) Store:
[INDICES] Schedule pending delete if index store delete fails #9856 [STORE] Improve safety when deleting files from the store #9801 [STORE] Add simple cache for StoreStats #9709 (issue: #9683 ) [STORE] use Directory#fileLength() less during calculating checksums #9689 [STORE] Cache fileLength for fully written files #9683 [STORE] Synchronize operations that modify file mappings on DistributorDirectory #8408 [STORE] Cut over MetaDataStateFormat to NIO Path API #8297 [STORE] Remove special file handling from DistributorDirecotry #8276 [STORE] Fold two hashFile implemenation into one #7720 Term Vectors:
Term Vectors: requests are now timed #9583 Term Vectors: support for realtime #7846 Translog:
[CORE] Handle truncated translog gracefully #9797 (issue: #9699 ) Internal: Write translog opSize twice #7735 Upgrade:
Core: upgrade to Lucene 4.10.4 bugfix release #9960 Internal: Log when upgrade starts and stops #9229 (issue: #9227 ) Dependencies: Upgrade netty to 3.10.0.Final #9132 upgrade to lucene 4.10.3 release #9100 Internal: Upgrade to Jackson 2.4.2 #7934 (issue: #7932 ) Internal: Upgrade to Lucene 4.10.1 snapshot #7844 (issue: #7905 ) Bug fixes Aggregations:
Aggregations: Be lenient when converting local to utc time in time zone roundings #10031 (issue: #10025 ) Aggs: Fix rounding issue using date_histogram with <code>pre_zone_adjust_large_interval #9828 (issue: #8209 ) Aggs: Fix rounding issues when using date_histogram and time zones #9790 (issues: #7673 , #9491 ) Aggregations: Prevent negative intervals in date_histogram #9690 (issue: #9634 ) Aggs: Remove limitation on field access within aggs to the types provided in the search #9487 Aggs: nested agg needs to reset root doc between segments. #9441 (issues: #9436 , #9437 ) Aggs: Fix handling of multiple buckets being emitted for the same parent doc id in nested aggregation #9346 (issues: #8454 , #9317 ) Aggs: In reverse nested aggregation, fix handling of the same child doc id being processed multiple times. #9345 (issues: #9263 , #9346 ) Aggs: The parent filter of the nested aggregator isn't resolved correctly all the time #9335 (issue: #9280 ) Aggs: post collection the children agg should also invoke that phase on its wrapped child aggs. #9291 (issue: #9271 ) Aggs: Validate the aggregation order on unmapped terms in terms agg. #8952 (issue: #8946 ) Aggregations: Fix date_histogram issues during a timezone DST switch #8655 (issue: #8339 ) Fielddata: Fix iterator over global ordinals. #8627 (issue: #8580 ) Aggregations: Fix geohash grid doc counts computation on multi-valued fields #8574 (issue: #8512 ) Aggregations: Parser throws NullPointerException when Filter aggregation clause is empty #8527 (issue: #8438 ) Aggregations: Fix geohash grid aggregation on multi-valued fields. #8513 (issue: #8507 ) Aggregations: Change nested agg to execute in doc id order #8454 Aggregations: The children agg didn't take deleted document into account #8180 Aggregations: Fixes scripted metrics aggregation when used as a sub aggregation #8037 (issue: #8036 ) Aggregations: Makes script params consistent with other APIs in scripted_metric #7969 Aggregations: Significant terms can throw error on index with deleted docs. #7960 (issue: #7951 ) Aggregations: size property parsing inconsistent [ISSUE] #6061 Aliases:
Aliases: Take into account _default_ mapping in index template when parsing alias filter in index templates. #8577 (issue: #8473 ) Allocation:
Allocation: Weight deltas must be absolute deltas #9149 (issue: #9023 ) Allocation: Fix handling of dangling_timeout set to 0 and <code>auto_import_dangled true #8257 Allocation: Enable ClusterInfoService by default #8206 Bulk:
Bulk API: Handle failed request when auto create index is disabled #8163 (issue: #8125 ) Bulk API: Bulk operation can create duplicates on primary relocation #7729 CAT API:
Stats: Fix NPE in /_cat/nodes #7815 (issue: #6297 ) Circuit Breakers:
Circuit Breaker: Only set breaker when stats are retrieved #7721 Core:
Core: also throttle delete by query when merges fall behind #9986 Internal: promptly cleanup updateTask timeout handler #9621 Core: Disable auto gen id optimization #9468 (issue: #8788 ) Core: Verify the index state of concrete indices after alias resolution #9057 Core: ignore_unavailable shouldn't ignore closed indices #9047 (issue: #7153 ) Core: Terms filter lookup caching should cache values, not filters. #9027 (issues: #1 , #2 ) Core: Don't forcefully release IW lock (this can cause corruption) #8892 (issue: #8588 ) Core: Hard wire utf-8 encoding, so unicode filenames work #8847 Gateway: GatewayService should register cluster state listener before checking for current state #8789 Core: Remove unnecessary index removal on index creation #8639 [GATEWAY] Remove _state directory if index has been deleted #8610 disable bloom filters #8572 (issues: #8564 , #8571 ) Core: Change default eager loading behaviour for nested fields and parent/child in bitset cache #8440 Core: Don't eagerly load NestedDocsFilter in bitset filter cache, because it is never used. #8414 (issue: #8394 ) Internal: Extend refresh-mapping logic to the _default_ type #8413 (issue: #4760 ) Internal: Translog leaks filehandles if it's corrupted or truncated #8372 Return 0 instead of -1 for unknown/non-exposed ramBytesUsed() #8291 (issue: #8239 ) Resiliency: Don't catch FNF/NSF exception when reading metadata #8207 Internal: Don't handle FNF exceptions when reading snapshot #8086 Dates:
DateMath: Use time zone when rounding. #9885 (issue: #9814 ) Query DSL: Resolve now in date ranges in percolator and alias filters at search time instead of parse time #8534 (issue: #8474 ) Discovery:
Zen: Node receiving a cluster state with a wrong master node should reject and throw an error #9963 Discovery: check index uuid when merging incoming cluster state into the local one #9541 (issue: #9489 ) Discovery: only retry join when other node is not (yet) a master #8979 (issue: #8972 ) Discovery: Removed unnecessary DiscoveryService reference from LocalDiscovery #8415 (issue: #8539 ) Discovery: Improve the lifecycle management of the join control thread in zen discovery. #8327 Engine:
[ENGINE] Upgrade 3.x segments on engine startup #9899 Core: SerialMergeScheduler never triggers index throttling #8405 Internal: Add current translog ID to commit meta before closing #8245 Geo:
[GEO] Fix validate_* merge policy for GeoPointFieldMapper [OPEN] #10165 (issue: #10164 ) Geo: Correct bounding box logic for GeometryCollection type #9550 (issue: #9360 ) Geo: Throw helpful exception for Polygons with holes outside of shell #9105 (issue: #9071 ) Geo: GIS envelope validation #9091 (issues: #2544 , #8672 , #9067 , #9079 , #9080 ) Geo: Fix for NPE enclosed in SearchParseException for a "geo_shape" filter or query #8785 (issue: #8432 ) Geo: Fix for geohash neighbors when geohash length is even. #8529 (issue: #8526 ) Geo: Fix for ArithmeticException[/ by zero] when parsing a polygon #8475 (issue: #8433 ) geo sort: remove unnecessary code from geo distance builder #8338 Geo: Fix IndexedGeoBoundingBoxFilter to not modify the bits of other filters. #8325 Index APIs:
Indices API: Fix to make GET Index API consistent with docs #9178 (issue: #9148 ) Indices API: Fixed backward compatibility issue #8387 (issue: #8364 ) Internal: Fix optimize behavior with 'force' and 'flush' flags. #7920 (issues: #7886 , #7904 ) Indices API: fixes GET Alias API backwards compatibility #7892 (issue: #7793 ) Indexed Scripts/Templates:
Scripting: ScriptService can deadlock entire nodes if script index is recovering #8901 Indexed Scripts/Templates: GetIndexedScript call can deadlock #8266 Make template params take arrays #8255 Indexed Scripts/Templates: Cleaned up various issues #7787 (issues: #7559 , #7560 , #7567 , #7568 , #7647 ) Internal:
Internal: Fix PageCacheRecycler's max page size computation. #10087 (issue: #10077 ) Ensure that we don't pass negative timeInQueue to writeVLong #9662 (issue: #8077 ) Snapshot status api: make sure headers are handed over to inner nodes request #9409 fix equality check of timevalue after serialization #9218 Internal: AdapterActionFuture should not set currentThread().interrupt() #9141 (issue: #9001 ) Internal: PlainTransportFuture should not set currentThread().interrupt() #9001 Internal: IndexService - synchronize close to prevent race condition with shard creation #8557 Index API: BWC layer for GetIndex should not block in a listener #8496 Internal: Don't pass acceptdocs down to nonNestedDocsFilter in ParentsFilter #8463 (issue: #8461 ) Indices API: Fix GET index API always running all features #8452 Internal: When corruption strikes, don't create exceptions with circular references #8331 Internal: Fixed bitset filter cache leftover in nested filter #8303 Internal: Cleanup non nested filter to not flip the FixedBitSet returned by the wrapped filter. #8232 (issue: #8227 ) Internal: Dynamic changes to max_merge_count are now picked up by index throttling #8136 (issue: #8132 ) Internal: Only schedule another refresh if refresh_interval is positive #8087 (issue: #8085 ) Internal: Fix serialization of PendingClusterTask.timeInQueue. #8077 Internal: dangling indices import ignores aliases #8059 Fix serialization of short[] arays. #8025 (issue: #7845 ) Internal: Make close() synchronized during node shutdown #7885 Java API:
Mappings: Fix Get field mapping api with pretty flag #8806 (issue: #6552 ) Settings: Ensure fields are overriden and not merged when using arrays #8381 (issue: #6887 ) Fixing SearchRequestBuilder aggregations call to facets #8121 (issue: #8120 ) Fixing copy/paste mistake in SearchRequest.extraSource's exception message #8118 (issue: #8117 ) Aggregations: Added missing module registration in TransportClient for Significant Terms #7852 (issue: #7840 ) Logging:
[STORE] Add filename to corruption message #10110 (issue: #10062 ) Transport: fix potential NPE in new tracer log if request timeout #9994 (issue: #9286 ) Fix example in logging daily rotate configuration #8550 (issue: #8464 ) Internal: Fix location information for loggers #8052 (issue: #5130 ) Mapping:
Fixes ignore_malformed behaviour for ip fields #10112 Mapping: Throw StrictDynamicMappingException exception #9445 (issue: #9444 ) Mapping: Using default=null for _timestamp field creates a index loss on restart #9233 (issues: #9104 , #9223 ) Mapping: Reencode transformed result with same xcontent #8974 (issue: #8959 ) Mapping: serialize doc values settings for _timestamp #8967 (issue: #8893 ) mappings: update cluster state with type mapping also for failed indexin... #8692 (issue: #8650 ) Mapping: Fix conflict when updating mapping with _all disabled #8426 (issues: #7377 , #8423 ) Mappings: Generate dynamic mappings for empty strings. #8329 (issue: #8198 ) Mapping: Throw exception if null_value is set to null #7978 (issue: #7273 ) Mapping: Posting a mapping with default analyzer fails #7902 (issue: #2716 ) More Like This:
MLT Query: Fix exclude with artificial documents #8679 Network:
Netty: Add HTTP pipelining support #8299 (issue: #2665 ) Packaging:
Packaging: Add antlr and asm dependencies #9696 Packaging: Added quotes to allow spaces in installation path #8428 (issue: #8441 ) Packaging: Move forbidden api signature files to dev-tools. #7921 (issue: #7917 ) Packaging: Export JAVA_HOME in RPM init script #5434 Parent/Child:
Parent/child: Fix concurrency issues of the _parent field data. #9030 (issue: #8396 ) Parent/child: Fixed p/c filters not being able to be used in alias filters. #8649 (issues: #5916 , #8628 ) Bulk API: Missing parent routing causes NullPointerException #8506 (issue: #8365 ) Parent/child: has_parent filter must take parent filter into account when executing the inner query/filter #8020 (issue: #7362 ) Percolator:
Percolator: Support encoded body as query string param consistently #9628 Percolator: Take filters from aliases into account #9590 (issue: #6241 ) Percolator: Fixed bug when using multi percolate api with routing #9161 (issue: #6214 ) Plugins:
Plugins: Installation failed when directories are on different file systems #9011 (issue: #8999 ) Plugins: NPE when plugins dir is inaccessible #8839 (issue: #8837 ) Plugins: Support usage of ES_JAVA_OPTS in plugin commands #8288 PluginManager: Fix config path extraction from plugin handle #7935 Query DSL:
Query DSL: Fix wrong error messages in MultiMatchQueryParser #8597 DateMath: Fix semantics of rounding with inclusive/exclusive ranges. #8556 (issue: #8424 ) Query DSL: Fix NumberFormatException in Simple Query String Query #7876 (issue: #7875 ) REST:
REST: Add fielddata_fields to the REST spec #9399 (issues: #4492 , #9398 ) Search: Passing fieddata_fields as a non array causes OOM #8203 Recovery:
Gateway: improve assertion at the end of shard recovery #10028 Recovery: synchronize RecoveryState.timer methods #9943 [RECOVERY] Don't recover from buggy version #9925 (issues: #7210 , #9922 ) Engine: close snapshots before recovery counter #9760 (issue: #9439 ) [ENGINE] Fix deadlock problems when API flush and finish recovery happens concurrently #9648 [RECOVERY] Handle corruptions during recovery finalization #9619 Core: Mapping update task back references already closed index shard #9607 Recovery: update access time of ongoing recoveries #9506 (issue: #8720 ) Recovery: cleaner interrupt handling during cancellation #9000 Internal: harden recovery for old segments #8399 Gateway: Prefer recovering the state file that uses the latest format. #8343 Recovery: change check for finished to a ref count check #8271 (issue: #8092 ) Recovery: RecoveriesCollection.findRecoveryByShard should call recoveryStatus.tryIncRef before accessing fields #8231 (issue: #8092 ) Scripting:
Scripting: File scripts cache key to include language and prevent conflicts #10033 script_file does not work with _update [ISSUE] #10007 Internal: Avoid unnecessary utf8 conversion when creating ScriptDocValues for a string field. #9557 (issue: #6908 ) Scripting: Disallow method pointer expressions in Groovy scripting #9509 Scripting: Make _score in groovy scripts comparable #9094 (issue: #8828 ) Search: Function score and optional weight : avg score is wrong #9004 (issue: #8992 ) Scripting: Return new lists on calls to getValues. #8591 (issue: #8576 ) Scripting: Add score() back to AbstractSearchScript #8417 (issues: #8377 , #8416 ) Scripting: Clear the GroovyClassLoader cache before compiling #8062 (issues: #7658 , #8073 ) Scripting: Fix NPE in ScriptService when script file with no extension is deleted #7953 (issue: #7689 ) Search:
inner hits: Don't fail if an object is specified as a nested value instead of an array. #9743 (issue: #9723 ) Query cache: Remove query-cache serialization optimization. #9500 (issue: #9294 ) inner_hits: Make sure inner hits on has_parent query resolve hits properly #9384 Query cache: Queries are never cached when date math expressions are used (including exact dates) #9269 (issue: #9225 ) Search: Make sure that named filters/ queries defined in a wrapped query/filters aren't lost #9166 (issue: #6871 ) Search: Fix paging on strings sorted in ascending order. #9157 (issue: #9136 ) Refactor term analysis for simple_query_string prefix queries #8435 Settings:
Settings: Reset TieredMP settings only if the value actually changed #9497 (issue: #8890 ) Settings: cluster.routing.allocation.disk.threshold_enabled accepts wrong values [ISSUE] #9309 Settings: Tab characters in YAML should throw an exception #8355 (issue: #8259 ) Settings: LogConfigurator resolveConfig also reads .rpmnew or .bak files #7457 Snapshot/Restore:
Snapshot/Restore: delete operation should ignore finalizing shards on no... #9981 (issue: #9924 ) Snapshot/Restore: Allow deletion of snapshots with corrupted snapshot files #9569 (issue: #9534 ) Snapshot/Restore: better handling of index deletion during snapshot #9418 (issue: #9024 ) Snapshot/Restore: add validation of restored persistent settings #9051 (issue: #8830 ) Snapshot/Restore: restore with wait_for_completion=true should wait for succesfully restored shards to get started #8545 (issue: #8340 ) Snapshot/Restore: keep the last legacy checksums file at the end of rest... #8358 (issue: #8119 ) Snapshot/Restore: restore of indices that are only partially available i... #8341 (issue: #8224 ) Snapshot/Restore: Fix snapshotting of a single closed index #8047 (issue: #8046 ) Snapshot/Restore: Make it possible to delete snapshots with missing metadata file #7981 (issue: #7980 ) Snapshot/Restore: Make sure indices cannot be renamed into restored aliases #7918 (issue: #7915 ) Stats:
Translog: make sure stats's op count and size are in sync #10041 Nodes Stats: Fix open file descriptors count on Windows #9397 (issue: #1563 ) Stats: Relax restrictions on filesystem size reporting in DiskUsage #9283 (issues: #9249 , #9260 ) Indices API: Fix wrong search stats groups #8950 (issue: #7644 ) Stats: Fix Bloom filter ram usage calculation #8584 (issue: #8564 ) Stats: _status with #shards >> queue capacity failing with BroadcastShardOperationFailedException [ISSUE] #7916 Store:
Internal: only ack index store deletion on data nodes #9672 (issue: #9605 ) [Store] Only fail recovery if files are inconsistent #8779 Store: Use Lucene checksums if segment version is >= 4.9.0 #8599 (issue: #8587 ) Store: Calculate Alder32 Checksums for legacy files in Store#checkIntegrity #8407 Suggesters:
return an HTTP error code when a suggest request failed instead of 200 #10104 Completion Suggester: Fix CompletionFieldMapper to correctly parse weight #8197 (issue: #8090 ) Translog:
Translog: stats fail to serialize size #10105 [GATEWAY] copy translog file if rename fails after retries. #9980 Translog: Never delete translog file from a snapshot #8917 Tribe Node:
Tribe node: system properties and configuration settings must not be forwarded to tribe clients #9721 (issue: #9576 ) Tribe node: remove closed indices from cluster state #9334 Upgrade:
Upgrade: Fix version check in bytes to upgrade that spans major versions #9340 Regression Mapping:
Mapping: Mapping With a null Default Timestamp Causes NullPointerException on Merge #9205 (issue: #9204 ) Docs Geo:
[GEO] fix docs for geo_point "validate" option [OPEN] #10168 (issue: #9539 ) Java API:
A getHits() was forgotten! #9320 [Doc] Java API: add search templates #8716 (issue: #7321 ) Docs: Add java documentation for aggregations #8694 NOT CLASSIFIED:
Need additional line in config file, to work tutorial's example. [ISSUE] #10074 fix typo #10045 Fix some docs n typos #10029 Documented default value for node_initial_primaries_recoveries #9955 [DOCS] added a note for the default shard_size value #9873 [DOCS] Default units for Geo Distance Agg is meters not km [ISSUE] #9812 [doc] Link mapper-attachment type documentation to its repo #9756 (issue: #101 ) Clarify no master block [ISSUE] #9739 Add warning to settings documentation because setting number_of_replicas on a closed can lead to index beeing not openable again #9591 (issue: #9566 ) Docs: Use the new experimental annotation. #9563 Testing classes don't support Parameterized tests? [ISSUE] #9423 Updates the command to add the repo #9261 Fix typo in sample json of keyword marker tokenfilter #9253 [TEST] Add missing docs and tests for '_cat/segments' #9179 (issue: #5856 ) [Doc] Java API: add information on JBoss EAP #8766 (issue: #3445 ) [DOCS] Document ActionNames class and related tests #8759 Fix error in documentation #8605 Update DiskThresholdDecider javadoc #8585 (issue: #6201 ) Docs: Fix a typo in a javadoc comment #8575 Missing quote in the example #8565 randomizedtesting jar versions mismatch [ISSUE] #8450 Docs: note about confusing disk threshold settings #8437 Docs: document action.replication_type setting #8290 MLT Query: use ParseField#withAllDeprecated for percent_terms_to_match #8241 Docs: Clarify that index.routing.allocation.total_shards_per_node applies to replica and primary #8002 Docs: rolling upgrade process seems incorrect [ISSUE] #7973 null_value and dynamic_templates not working correctly [ISSUE] #7874 Docs : Filtering based on exact values not working [ISSUE] #7807 Docs: Document the most important changes to zen discovery. #7746 Inconsistent ceiling round up in range search for "lt" (less than) [ISSUE] #7203 Packaging:
Packaging: Added a command to start elasticsearch on bootup. #8600 Tests Aggregations:
Adding tests for TimezoneRounding in 1.x #9796 NOT CLASSIFIED:
[TEST] Add tests that triggers truncated files on recovery #10155 [TESTS] Make sure test end with ..Tests #9947 (issue: #9945 ) [TEST] Work around URI encode limitations in RestClient #9946 (issue: #9769 ) Tests: Add back tests.cluster #9916 [TEST] Fix NPE in ElasticsearchIntegrationTest if no indexer is provided #9909 (issue: #9907 ) Tests: check node ports availability when using unicast discovery #9886 Tests: Use all found index files instead of static list for static bwc tests #9854 Tests: Remove thread leak filter #9843 [TEST] Don't reuse single node tests node instance across tests #9813 Kernel32LibraryTests creates JNA proxy classes [ISSUE] #9802 Tests: Remove global shared cluster #9781 (issue: #8854 ) Test: Remove use of globalTempDir() and forbid it from future use. #9777 Testing: Added REST tests to check if expression scripting works #9750 Testing: Ensure RepeatOnException rule is available in test-jar #9675 [TEST] Introduce basic validation of our REST spec #9629 Tests: Add static indexes to fill out 0.20.x coverage. #9537 [TEST] support stashed values within property names in our REST tests #9533 Testing: Add test rule to repeat tests on binding exceptions #9527 (issue: #9010 ) Tests: Add type-unrestricted version of field mapper getter to SearchContext #9490 Test: use local gateway by default #9476 Tests: Rename tests with the same name #9370 Internal: Change snapshot state for unreleased versions and add validation tests for constants #9228 Tests: Add upgrade step to static bwc tests #9207 Add 0.20.x index. #9146 Don't enable custom data_path for backwards compatibility tests #9119 Fix TransportNodesListShardStoreMetaData for custom data paths #9101 [TEST] Make sure we restart the suite cluster after each test failure #9015 [TEST] upgrade randomized runner to 2.1.11 #8930 [TEST] LoggingListener to restore the initial logger levels after any modification #8845 (issue: #8820 ) Test: fix InternalEngineTest.testIndexWriterIFDInfoStream to pass in IntelliJ #8822 [TEST] Pass class level test logging to external nodes #8820 (issue: #8552 ) [TEST] Add unit tests for DiskThresholdDecider settings #8816 [TEST] guarantee REST tests execution order #8745 [TEST] make sure rest tests info is printed for any @Rest annotated test #8680 (issue: #7795 ) [TEST] split base settings in ClusterDiscoveryConfiguration between node and transport client #8653 [TEST] Extend unicast ports generation to support more concurrent clusters #8634 [TEST] Register data.path for all nodes on close in InternalTestCluster #8519 Tests: Skip bwc analysis tests if using turkish or azuri locale. #8492 Allow -SNAPSHOT versions to be parsed by Version.fromString #8379 [TEST] move ClusterDiscoveryConfiguration to org.elasticsearch.test.discovery #8337 Tests: Pass through locale and timezone to test runner, and print in repro command line. #8315 [TEST] Remove redundant call to setTemplateType() #8295 [TEST] initialize SUITE | GLOBAL scope cluster in a private random context #8250 [TEST] Scope.SUITE is not reproducible due to late cluster initialization #8220 [TEST] Add simple BWC tests that start from pre-build indices [ISSUE] #8065 Tests: dump all thread stacks on failure #8033 [TEST] fix CurrentTestFailedMarker to reset its state after each test #8008 [TEST] create client nodes using node.client: true #7911 [TEST] Use Shutdown API only if nodes are on 1.3.3 or newer to prevent shutdown problems #7910 (issue: #7885 ) [TEST] add regular scroll REST test #7860 Internal: MulticastChannel should wait on receiver thread to stop during shutdown #7835 Tests: Add a more restrictive thread leaks filter #7825 (issue: #7833 ) [TEST] move REST tests to their own test group #7795 [TEST] Only reset test cluster if a test actually failed #7775 [TEST] Improve HTTP support in TestClusters #7738 [TEST] Update REST client before each test in our REST tests #7737 (issues: #6734 , #7723 ) Test: always run CheckIndex after a test, and fail the test if it detects corruption #7730 Tests: always run CheckIndex on all shards created by the test [ISSUE] #7724 [TEST] Minor REST tests infra cleanup #7723 [TEST] Expose ability to provide http headers when sending requests in our REST tests #7710 Tools: Add script to grab ES version for BWC tests. #7653 Geo: [TEST] Adds tests for GeoUtils #7510 Benchmark: BenchmarkIntegrationTest failure fixed [ISSUE] #6094 Test: Integration tests for benchmark API. #6023 (issue: #6003 ) Test: Start nodes using node.bench true to enable benchmark api #5920 (issue: #5910 ) Recovery:
[RECOVERY] Make recovery delay configurable #8739 Snapshot/Restore:
Tests: Make sure snapshots created with old version of elasticsearch can... #8968 Not classified NOT CLASSIFIED:
Core: check only call rate limiter every minPauseCheckBytes during recovery [OPEN] #10185 (issue: #6018 ) Build: Check that all packages contain the same jar files #9757 Rename Maven repository id #9733 [BUILD] Add marvel and license to the release script #9697 ignore intellij project/workspace files #9044 Switch to forbidden-apis 1.7 #8620 Recovery:
Recovery: node shut down during the last phase of recovery needlessly fails shard [ISSUE] #9496 