WARNING: The 2.x versions of Elasticsearch have passed their EOL dates. If you are running a 2.x version, we strongly advise you to upgrade.
This documentation is no longer maintained and may be removed. For the latest information, see the current Elasticsearch documentation.
A document doesn’t consist only of its data. It also has metadata—information about the document. The three required metadata elements are as follows:
- Where the document lives
- The class of object that the document represents
- The unique identifier for the document
An index is a collection of documents that should be grouped together for a
common reason. For example, you may store all your products in a
while all your sales transactions go in
sales. Although it is possible to store
unrelated data together in a single index, it is often considered an anti-pattern.
Actually, in Elasticsearch, our data is stored and indexed in shards, while an index is just a logical namespace that groups together one or more shards. However, this is an internal detail; our application shouldn’t care about shards at all. As far as our application is concerned, our documents live in an index. Elasticsearch takes care of the details.
We cover how to create and manage indices ourselves in Index Management,
but for now we will let Elasticsearch create the index for us. All we have to
do is choose an index name. This name must be lowercase, cannot begin with an
underscore, and cannot contain commas. Let’s use
website as our index name.
Data may be grouped loosely together in an index, but often there are sub-partitions inside that data which may be useful to explicitly define. For example, all your products may go inside a single index. But you have different categories of products, such as "electronics", "kitchen" and "lawn-care".
The documents all share an identical (or very similar) schema: they have a title, description, product code, price. They just happen to belong to sub-categories under the umbrella of "Products".
Elasticsearch exposes a feature called types which allows you to logically partition data inside of an index. Documents in different types may have different fields, but it is best if they are highly similar. We’ll talk more about the restrictions and applications of types in Types and Mappings.
_type name can be lowercase or uppercase, but shouldn’t begin with an
underscore or period. It also may not contain commas,
and is limited to a length of 256 characters. We will use
blog for our type name.
The ID is a string that, when combined with the
uniquely identifies a document in Elasticsearch. When creating a new document,
you can either provide your own
_id or let Elasticsearch generate one for
There are several other metadata elements, which are presented in Types and Mappings. With the elements listed previously, we are already able to store a document in Elasticsearch and to retrieve it by ID—in other words, to use Elasticsearch as a document store.
Intro to Kibana
ELK for Logs & Metrics