Site health and speed
What SEOgent’s crawl checks, how pages are scored for search engines and AI answers, how Google index checks and Core Web Vitals work, and what to do with the issues.
SEOgent crawls your site the way search engines and AI crawlers see it, checks which pages Google has indexed, and measures how fast your most visited pages load. Problems appear on Site Health as issues.
The crawl
- Every Sunday, a full crawl of up to 500 pages. It starts with your homepage, then the pages in your sitemap and Search Console with the most impressions, then follows internal links to find the rest.
- Every day, a light crawl of your homepage, pages with open issues, pages whose action items were finished in the last week, and new pages in your sitemap.
The crawler identifies itself as SEOgent/1.0 and reads your pages’ raw HTML without running JavaScript, as AI crawlers do. If your content only appears after JavaScript runs, SEOgent flags it, because many crawlers will see a blank page. Pages set to noindex are crawled but not scored.
How pages are scored
Every crawled page gets two scores out of 100. Open any page under Pages to see them and every check behind them.
Search engines (SEO): what Google and Bing need to understand and show the page. The title is 30 to 60 characters, the meta description 70 to 160 characters, and there’s an H1, canonical URL, mobile viewport, language attribute, social preview tags, image alt text, sensible heading order, internal links, at least 300 words, HTTPS and a clean URL.
AI answers (AEO): what ChatGPT, Claude, Perplexity and AI Overviews need to read and quote the page. The biggest factor is content in the HTML. After that, on pages of 300 words or more: a short direct answer up front, question headings, lists and tables, facts with outside sources, and valid structured data. Articles also need to have been updated within the last year.
Each check is Good, Improve or Fix. A score counts Good as full marks and Improve as half, weighted by how much each check matters.
Issues
Site-wide and page problems are reported as issues, grouped by type, in three severities:
| Severity | Examples |
|---|---|
| Critical | Pages returning errors, broken internal links, pages set to noindex that are in your sitemap, pages Google hasn’t indexed, missing titles, content that only appears with JavaScript, robots.txt blocking all crawlers or Google |
| Warning | Redirect chains, canonicals pointing elsewhere, duplicate titles and descriptions, missing meta descriptions or H1s, no sitemap, robots.txt blocking AI crawlers, slow pages |
| Notice | Long titles and descriptions, thin content, more than one H1, images missing alt text, no robots.txt |
For each issue you can:
- Fix now: have SEOgent plan a fix. It appears under Fixes for review. See How fixes work.
- Fixed: mark it fixed yourself. The next crawl reopens it if it’s still there.
- Ignore: stop reporting it. Ignored issues stay ignored.
Issues also clear themselves: when a crawl no longer finds a problem, the issue moves to Resolved. If it comes back, it reopens.
Site health is the share of your indexable pages with no open critical or warning issue: 80 and up is Healthy, 50 to 79 Needs work, and below 50 At risk.
Google’s index
With Search Console connected, SEOgent asks Google about up to 100 pages a day, starting with those checked least recently. It flags:
- Not indexed by Google: the page is in your sitemap, but Google hasn’t indexed it, with Google’s reason
- Google chose a different canonical: Google treats another URL as the main version of the page
Each page under Pages shows its index status. Re-check asks Google again straight away. Request indexing walks you through asking Google to crawl the page in Search Console: Google only takes these requests there, about 10 a day per site.
Speed and Core Web Vitals
Every Sunday SEOgent runs Google PageSpeed Insights on mobile for your five pages with the most search impressions over the last 28 days. You can run it any time with Run speed check. The Core Web Vitals tile on This Week shows:
| Metric | Good | Poor |
|---|---|---|
| Largest paint (LCP): when the main content appears | 2.5 s or less | over 4 s |
| Interaction (INP): how quickly the page responds to taps and clicks | 200 ms or less | over 500 ms |
| Layout shift (CLS): how much the layout jumps while loading | 0.1 or less | over 0.25 |
Where Google has data from real Chrome users, SEOgent uses it. Otherwise it uses the lab test. Interaction can only come from real users. A page gets a Slow page issue when its performance score is below 50, or any metric is in the poor range.
To test any page on demand, on mobile or desktop, use the free speed test.
Updated October 27, 2026 Next: Accounts and data →