Elasticsearch Hadoop breaking changesedit
This list summarizes the most important breaking changes in Elasticsearch Hadoop 8.0.1. For the complete list, go to Elasticsearch Hadoop breaking changes.
The default scroll size is now 1000edit
We’ve increased the es.scroll.size default from 50 to 1000. If you deploy
ES-hadoop in a low memory environment, consider lowering es.scroll.size to
avoid issues.
Spark 1.x support is deprecatededit
Spark 1.x is no longer maintained. Spark 2 and Spark 3 are still supported.
Scala 2.10 support for Spark 2.x is deprecatededit
Spark deprecated support for Scala 2.10 in the Spark 2.0.0 release and removed it in the 2.3.0 release. Scala 2.11 and 2.12 are supported for Spark 2.x.
Hadoop 1.x support is deprecatededit
Hadoop 1.x is no longer maintained. Support for it has not been tested since {eh} 6.0. Support is now formally deprecated. Hadoop 2 and Hadoop 3 are supported.
Apache Pig support is deprecatededit
Apache Pig is no longer maintained.
Apache Storm support is deprecatededit
Apache Storm has not been a popular Elasticsearch integration.