Free Elastic Training

Web Crawler Quick Start

In this 3-step Quick Start series, you'll learn how to use the Elastic web crawler. See how quickly you can index the content of your website (crawl) and create a search engine that you can easily tune for your needs. Topics include what is the Elastic web crawler, how to crawl a website, and analyzing and refining search.

Start free trial

Read documentation

videoImage

Now it's your turn

Now that you've watched the Quick Start video, follow the steps below to practice what you've learned. If you don't have an Elastic Cloud instance, spin up a 14-day free trial.

  • Step 1

    1. Create a new Enterprise Search deployment on Elastic Cloud
    2. Launch Enterprise Search from the new deployment
    3. Select Content and create a new Elasticsearch index

  • Step 2

    1. Set up the crawler to retrieve information from your website
    2. Check the logs in Kibana
    3. Run some queries to test your new search engine

  • Step 3

    1. Tune the relevance of your search by boosting the field that makes for sense for your users
    2. Create synonyms
    3. Use curation to manually promote or hide documents for a given query

Explore more courses

App Search Quick Start

Learn about Elastic App Search: modern, natural search experiences with pretuned relevance for your apps and websites.

arrow-white

Workplace Search Quick Start

Learn about the single search experience for your teams to search across platforms, like Google Drive, Salesforce, GitHub, and more.

arrow-white

App Search web crawler Fundamentals

Explore the fundamentals of App Search web crawler like indexing web content data into App Search, monitoring and debugging the web crawler, building a UI, and refining search.

arrow-white