synthrank.Docs
WebsiteOpen SynthRank
Knowledge & strategy

Crawl and review your website

Bring existing pages into SynthRank so research and writing start with what is already on your site.

Run a website crawl

Check your domain in Settings, then open Articles → Setup → Sources and start the crawl. SynthRank discovers pages using your website and sitemaps, then retains a bounded set of useful pages.

Review the results

Watch the crawl status and inspect the retained pages. Check that your homepage, product and service pages represent your business accurately. A crawl is bounded: it does not prove that every URL on your website has been inspected.

Add product documentation

If your product has a separate documentation host, add its root URL in workspace settings. Documentation is crawled separately from your main site and can provide product instructions for generated articles.

For shared help platforms, use the documentation root path for your product. Only relevant retained documentation pages are supplied as references.

If pages are missing

Check that the pages are public and permitted by robots rules, and that your sitemap points to the correct host. Review the error shown in SynthRank before retrying. Private pages and redirects to unrelated hosts are not valid crawl targets.

Need a hand with this?Contact support