Web Crawler Quick Start

In this 3-step Quick Start series, you'll learn how to use the Elastic web crawler. See how quickly you can index the content of your website (crawl) and create a search engine that you can easily tune for your needs. Topics include what is the web crawler, crawling a website with Search, and analyzing and refining search.

Start free trial
Read documentation
Video thumbnail

Now it's your turn

Now that you've watched the Quick Start video, follow the steps below to practice what you've learned. If you don't have an Elastic Cloud instance, spin up a 14-day free trial.

  • Step 1

    1. Learn about the Elastic web crawler
    2. Create a new Search deployment
    3. Get ready to crawl your first website

  • Step 2

    1. Set up the crawler to crawl from your website
    2. Configure crawl and extraction rules
    3. Enable semantic search using ELSER

  • Step 3

    1. Learn how to run full text and semantic search on the crawled data
    2. Create synonyms
    3. Use curation to manually promote or hide documents for a given query

Try Elastic Cloud now

Spin up Elastic on the cloud provider you choose. As the company behind Elasticsearch, we bring our features and support to your Elastic clusters in the cloud.

Start free trial