Elastic web crawler known issuesedit

The Elastic web crawler has the following known issues:

  • The crawler does not crawl pure JavaScript single-page applications (SPAs).

    We recommend looking at dynamic rendering to help your crawler properly index your JavaScript websites. Another option is to serve a static HTML version of your Javascript website, using a solution such as Prerender.

  • The crawler does not support dynamic content.

    The crawler does not execute JavaScript, and it only pulls text from HTML elements.