[Bug]: Crawling doesn't get all the pages

[4rokis]

Bug Description

When I try to run crawl on https://accesstime.co it returns only limited amount of pages, while there is much more present.

Steps to Reproduce

npm run cli -- crawl https://accesstime.co

Expected Behavior

All the pages should be returned. In the case of accesstime.co it should include all the articles on the blog list(at least the first page) and all the pages in the footer and accessible from the home

Actual Behavior

Only home page, blog and 4 articles got crawled

Environment Details

@accesstime/lenscore@0.1.68

Screenshots / Logs

bogdansikora@Bogdans-MacBook-Pro LensCore % npm run cli -- crawl https://accesstime.co

> @accesstime/lenscore@0.1.68 cli
> tsx src/cli.ts crawl https://accesstime.co

⠋ Starting crawl...
🕷️ Crawling: https://accesstime.co

✔ LensCore is ready
✔ LensCore ready
✔ Crawl completed
✔ Crawl completed
{
  "pages": [
    {
      "url": "https://accesstime.co",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:23:25.040Z"
    },
    {
      "url": "https://accesstime.co/en",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:23:26.328Z"
    },
    {
      "url": "https://accesstime.co/blog/international-day-of-persons-with-disabilities-2025",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:23:26.652Z"
    },
    {
      "url": "https://accesstime.co/blog",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:23:27.476Z"
    },
    {
      "url": "https://accesstime.co/blog/differences-between-wcag-ada-eaa-en301549",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:23:28.397Z"
    },
    {
      "url": "https://accesstime.co/blog/accessibility-needs-to-catchup",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:23:29.577Z"
    },
    {
      "url": "https://accesstime.co/blog/accessibility-should-be-everyone-job",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:23:29.786Z"
    }
  ],
  "totalPages": 7,
  "crawlTime": 7071,
  "metadata": {
    "crawledAt": "2025-12-08T06:23:30.152Z",
    "maxDepth": 2,
    "rules": {},
    "totalPages": 7,
    "crawlTime": 7071
  }
}

bogdansikora@Bogdans-MacBook-Pro LensCore % npm run cli -- crawl https://accesstime.co/en

> @accesstime/lenscore@0.1.68 cli
> tsx src/cli.ts crawl https://accesstime.co/en

⠋ Starting crawl...
🕷️ Crawling: https://accesstime.co/en

✔ LensCore is ready
✔ LensCore ready
✔ Crawl completed
✔ Crawl completed
{
  "pages": [
    {
      "url": "https://accesstime.co/en",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:26:06.254Z"
    },
    {
      "url": "https://accesstime.co/blog",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:26:07.239Z"
    },
    {
      "url": "https://accesstime.co/blog/differences-between-wcag-ada-eaa-en301549",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:26:07.314Z"
    },
    {
      "url": "https://accesstime.co/blog/international-day-of-persons-with-disabilities-2025",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:26:07.515Z"
    },
    {
      "url": "https://accesstime.co/blog/accessibility-should-be-everyone-job",
      "title": "AccessTime - Building a Web Without Barriers",
      "description": "Expert web accessibility consultation studio specializing in WCAG compliance audits, workshops, and training. We help businesses create inclusive digital experiences that work for everyone.",
      "statusCode": 200,
      "timestamp": "2025-12-08T06:26:08.597Z"
    }
  ],
  "totalPages": 5,
  "crawlTime": 4037,
  "metadata": {
    "crawledAt": "2025-12-08T06:26:08.963Z",
    "maxDepth": 2,
    "rules": {},
    "totalPages": 5,
    "crawlTime": 4037
  }
}

Severity/Priority

High - Core functionality not working

Additional Context

No response

Checklist

• I have searched for similar issues first
• I have read the relevant documentation
• I have tried updating to the latest version

[4rokis]

On the blog page there is at least 6 articles that should be included as we clearly visited blog page