O conteúdo desta página não está disponível no idioma selecionado. A Elastic está trabalhando para garantir que o conteúdo esteja disponível em vários idiomas. Agradecemos a compreensão.

Download Open Web Crawler

Prerequisite

Running instance of Elasticsearch

1

Download

Crawler source:
Source
Containers:
Docker
2

Connect to Elasticsearch

Access the Elasticsearch instance with API key or a username/password.

See elasticsearch.yml.example

3

Configure Crawler

Configure using config file.

4

Use CLI to start a crawl

Crawler CLI

5

Learn more

See our documentation for the latest up-to-date information.

Docs

Getting started guide
Learn more

Blog

Creation of a chatbot
Learn more

Summary

Version: 0.2.2

View past releases

Release date:

View release notes

License: Elastic License

Elastic License

Notes:

Running on Kubernetes? Try the Elastic Cloud on Kubernetes (ECK)).

This default distribution is governed by the Elastic License, and includes the full set of free features.

  • image_alternative_text: blt806c6156aefec893

    Want it hosted? Deploy on Elastic Cloud Serverless.

    Try it out for free for 14 days — no credit card required.

    Start free trial
  • "en": "Paper airplane", "cn": "纸飞机", "de": "Papierflugzeug", "es": "Avión de papel", "fr": "Avion en papier", "jp": "紙飛行機", "kr": "종이 비행기", "pt": "Aviãozinho de papel"

    New around here?

    View our getting started page to get acquainted with the Elastic Stack.

    Get started

Additional resources

Docs

Elastic's documentation helps you with all things implementation — from installation to solution components and workflow.

Forum

Have a question? Our community has the answers. Connect with other users and Elastic employees.

GitHub

Access open source code, rules, integrations, and so much more for any Elastic use case.