Connect your first site
- Open a workspace and select Site Board.
- Enter the full website URL, including
https://. - Select Connect.
- Scribeist will connect the site and begin its first crawl.
Only connect a site that you are authorized to analyze. Pages must be publicly reachable for Scribeist to crawl them.
What happens during a crawl
Scribeist starts from the connected URL and follows relevant links on that site. As pages are found, Site Board builds the Content Library, topic clusters, link reports, and content audit.
You can leave Site Board while a crawl runs. The crawl continues in the background.
If another crawl is already using the available crawler, your crawl may show as Queued. You do not need to restart it; it will begin automatically when the crawler is available.
Crawl limits
The maximum number of sites and pages depends on your plan. These allowances are shared by all workspaces in your account:
| Plan | Connected sites per account | Indexed pages per account |
|---|---|---|
| Hobby | 1 | 200 |
| Pro | 3 | 2,000 |
| AppSumo Tier 1 | 1 | 200 |
| AppSumo Tier 2 | 3 | 2,000 |
| AppSumo Tier 3 | 3 | 2,000 |
| AppSumo Tier 4 | 10 | 5,000 |
The indexed-page allowance is shared across every connected site and workspace owned by the account. Creating another workspace does not create another allowance. A website can contain more public pages than your plan allows.
Add a missing URL
If a public page was not discovered:
- Open the site's Content Library.
- Select Add URL.
- Enter the full page URL.
- Confirm the addition.
The URL must belong to the connected site and lead to a valid public page. Scribeist will not add unrelated domains, unsupported links, or pages it cannot retrieve.
Recrawl a site
Run another crawl after making meaningful changes to your website. A recrawl refreshes page content, link information, topic clusters, and audit results.
You do not need to recrawl after every small edit. Recrawl when you want Site Board to reflect the latest published version of the site.
Disconnect a site
Disconnecting removes the connected site's indexed Site Board data from the workspace. It does not change or delete anything on the website itself.
Troubleshooting
The crawl is queued
Leave it queued. It will start automatically when crawling capacity becomes available.
Very few pages were found
Check that the pages are public and linked from crawlable pages on the same site. Site restrictions, authentication, blocked crawlers, and unreachable links can prevent discovery.
A URL cannot be added
Confirm that it uses the connected site's domain, includes http:// or https://, and opens publicly in a browser.