<html><head></head><body><h2>Introduction</h2>My all-time favourite opening scene of a movie is in Trainspotting. A crazed Ewan McGregor (Renton) runs at top speed through the streets of Edinburgh to the kinetic beat of Iggy Pop. He dodges pursuers, jumps down staircases, and just when he thinks he&#x2019;s in the clear, he gets hit by a car. And then he just laughs it off. The world of enterprise software may be less exciting than the exploits of Renton, Begbie and friends, but an on-call rotation without backups can feel a lot like that &#x2014; running, dodging, and ultimately, getting blindsided. With our snapshot backup update in ECE 1.1 &#x2014; we&#x2019;re hoping we can help you laugh it off too.
In ECE, our support for snapshot backups to date has focused mainly on storage to the public cloud (AWS S3 and Google GCS). Many have asked for options for local snapshot storage to address privacy and security requirements. Starting in ECE 1.1, we have begun to address these queries with <a href="https://www.elastic.co/guide/en/cloud-enterprise/1.1/ece-configuring-minio.html">support for Minio </a>as an on-premise storage solution.
<a href="https://www.minio.io/" target="_blank">Minio</a> is a popular <a href="https://github.com/minio/minio" target="_blank">open source</a> object storage server that supports the AWS S3 API. It is intended to provide scalable persistent storage using your Docker infrastructure.
<h2>Installing a single Minio node</h2>We&#x2019;re going to assume you&#x2019;ve already installed ECE, so we will install Minio using the official Docker containers.
Many ECE customers run in an air-gapped environment where their servers are not connected to the public internet. It is possible to use a private Docker repository, but if you don&#x2019;t have one it is easy to download the Docker images and copy to your offline network, as we will illustrate below. Of course, if you are connected to the public internet you can just skip the first three steps.
<ol>
	<li>On an internet-connected machine, download the Minio image from Docker:
	 
	<pre class="prettyprint">~$ docker pull minio/minio
Using default tag: latest
latest: Pulling from minio/minio
ff3a5c916c92: Pull complete
65fb7fed439b: Pull complete
427cece328be: Pull complete
Digest: sha256:570421569de35d51ebd858fbdbec219f20d1b7b384cf6f228dc92f796574ccf7
Status: Downloaded newer image for minio/minio:latest
 </pre>
	</li>
	<li>Save the image to a tar file: 
	<pre class="prettyprint">~$ docker save -o minio.tar minio/minio
 </pre></li>
	<li>Copy the tar file to your air-gapped server and load it: 
	<pre class="prettyprint">~$ docker load &lt; minio.tar
 </pre>
	</li>
	<li>Install the Minio Docker image: 
	<pre class="prettyprint">docker run -p 9000:9000 -e &quot;MINIO_ACCESS_KEY=testkey&quot; \
 -e &quot;MINIO_SECRET_KEY=testsecret&quot; -v /mnt/minio/data:/data \
 -v /mnt/minio/config:/root/.minio minio/minio server /data
 </pre>
	There are many config options that can be passed to Minio (which are documented in the <a href="https://docs.minio.io/docs/minio-server-configuration-guide" target="_blank">Minio Server Configuration Guide</a>), but for our example:
	<ol>
		<li>Set a preconfigured S3 access key/secret of <code>testkey/testsecret</code></li>
		<li>Specify a location for the persistent data mount and configuration directory. It is a good idea to use a persistent data mount even if you&#x2019;re just evaluating Minio so that you maintain data after you restart the container.</li>
	</ol>
	</li>
	<li>When Minio starts up it will display some useful configuration information: 
	<pre class="prettyprint">Drive Capacity: 17 GiB Free, 19 GiB Total
Endpoint: http://172.17.0.1:9000 http://127.0.0.1:9000
AccessKey: testkey
SecretKey: testsecret
Browser Access:
 http://172.17.0.1:9000 http://127.0.0.1:9000
 </pre>
	</li>
	<li>Once Minio is installed, the admin UI should be running at http://&lt;your_host&gt;<your_host>:9000. You can use the big red plus (+) button in the admin UI to create a bucket. Here we&#x2019;ve called it <code>ece-backup</code>:
	</your_host></li>
</ol><img src="https://images.contentstack.io/v3/assets/bltefdd0b53724fa2ce/blt16a372179a3d6ecc/5c306695682c4c4866a798e0/minio.png" data-sys-asset-uid="blt16a372179a3d6ecc" alt="minio.png">

	We&#x2019;ve only done a basic installation of a single Minio node for test or evaluation purposes. When installing in production it will be necessary to use <a href="https://docs.docker.com/engine/swarm/" target="_blank">Docker Swarm</a> or <a href="https://kubernetes.io/" target="_blank">Kubernetes</a> to manage the high-availability deployment of multiple nodes. For more information, see the <a href="https://docs.minio.io/docs/minio-deployment-quickstart-guide" target="_blank">Minio Deployment Quickstart Guide</a>.
<h2>Configuring ECE</h2>First we need to add a snapshot repository to ECE. From the ECE admin UI:
<ol>
	<li>Navigate to Platform &gt; Repositories.</li>
	<li>Click the Add Repository button.</li>
	<li>From the Repository Type drop-down list, select Advanced.</li>
	<li>In the Configuration text area, provide the repository JSON. You must specify the bucket, access_key, secret_key, endpoint, and protocol. 
	<pre class="prettyprint">{
 &quot;type&quot;: &quot;s3&quot;,
 &quot;settings&quot;: {
 &quot;bucket&quot;: &quot;ece-backup&quot;,
 &quot;access_key&quot;: &quot;testkey&quot;,
 &quot;secret_key&quot;: &quot;testsecret&quot;,
 &quot;endpoint&quot;: &quot;&lt;your Minio endpoint&gt;:9000&quot;,
 &quot;protocol&quot;: &quot;http&quot;
 }
}
 </pre>
	<img src="https://images.contentstack.io/v3/assets/bltefdd0b53724fa2ce/blt8d404ecb62971469/5c306692760e7f7a666d694b/ece-minio-repository.png" data-sys-asset-uid="blt8d404ecb62971469" alt="ece-minio-repository.png">
	</li>
	<li>Save the repository config.</li>
</ol>Next, we can create a new cluster or update an existing cluster to use our snapshot repository. Under the Snapshot Repository drop-down you should select your new <code>ece-backup</code> repository. In addition, if you have a 6.x cluster you need to add the following settings in the User Settings section:
<pre class="prettyprint">s3.client.default.endpoint: &quot;&lt;your Minio endpoint&gt;:9000&quot;
s3.client.default.protocol: http
</pre>Once the cluster has been created or updated, you should start to see snapshots being created in the Elasticsearch &gt; Snapshots page. By default, snapshots are created <a href="https://www.elastic.co/guide/en/cloud-enterprise/1.1/ece-manage-repositories.html#ece-change-snapshot-interval">every 30 minutes</a>.
If you&#x2019;re curious, you can see the snapshot data by visiting the Minio browser and looking at the <code>ece-backup/snaphots/&lt;your_cluster_id&gt;</code> directory:
<img src="https://images.contentstack.io/v3/assets/bltefdd0b53724fa2ce/bltd877501d31428690/5c30668f61a626fb0b630150/snapshot-browse.gif" data-sys-asset-uid="bltd877501d31428690" alt="snapshot-browse.gif">
<h2>Conclusion</h2>We&#x2019;ve walked through the simple process of adding a single Minio node to an ECE installation so you can make local backups from your clusters, without crossing the public internet.
Installing Minio in production environment will involve a more sophisticated installation process, with considerations such as encryption and high-availability. If you want to read more, full details are in the online <a href="https://docs.minio.io/" target="_blank">Minio documentation</a>. Stay tuned for a future blog post where we will discuss these features and support for additional backends, including&#xA0;<a href="https://www.minio.io/nas.html" target="_blank">Network Attached Storage</a> (NAS), <a href="https://docs.microsoft.com/en-us/azure/storage/" target="_blank">Azure Blob Storage</a> and <a href="https://cloud.google.com/storage/docs/" target="_blank">Google Cloud Storage</a>.
Hopefully it will be better than Trainspotting 2*!
* - This movie was a travesty IMHO.
</body></html>

hdd.jpg

hdd_thumb.jpg

Storing Snapshots in Elastic Cloud Enterprise with Minio

Start free trial

Blog Footer CTA

Sign up for Elastic Cloud free trial

Blog Footer

Paul Coghlan

Can't make it? Register and we'll send you the recording. You'll also receive an email with related content

Can't make it? Register and we'll send you the recording. You'll also receive an email with related content.

You'll also receive an email with related content.

You'll also receive an email with related content

Load More

By submitting you acknowledge that you've read and agree to our <a href="/legal/elastic-cloud-account-terms" target="_blank">Terms of Service</a>, and that Elastic may <a href="/legal/privacy-statement#how-we-use-the-information" target="_blank">contact you</a> about our related products and services, using the details you provide above. See <a href="/legal/privacy-statement/" target="_blank">Elastic’s Privacy Statement</a> for more details or to opt-out at any time.

Newsletter GDPR Text

Speakers

Close

See more insights

The content on this page is not available in the selected language. As Elastic grows globally, we continue to support content in multiple languages.

Elasticsearch Platform

ELK Stack

Elastic Cloud

Observability

Security

Search

By industry

By solution

Customer spotlight

Developers

Connect

Learn

Help

See what's happening at Elastic

Author

Articles by Paul Coghlan

Storing Snapshots in Elastic Cloud Enterprise with Minio

Follow us

About us

Join us

Press

Partners

Trust & Security

Investor relations

EXCELLENCE AWARDS