Sites and profiles

Which pages of my site do you read?

We list every page we can find, read about twenty of them in full to write the profile, and check every new-page idea against all of them so we never tell you to build a page you already have.

Two different things happen to your pages, and they use different numbers.

Every page we can find is listed

We collect the addresses of your pages from three places:

  • Your llms.txt and llms-full.txt, when you publish them. Many WordPress sites get one automatically from their SEO plugin.
  • Your sitemaps, found through robots.txt or the usual sitemap addresses.
  • A crawl of the site, up to 5,000 addresses.

Every page on that list is kept, with where we found it. You can see the list on the Profile tab under Other pages we found. It is refreshed every time you run research.

About twenty are read in full

To write the profile, we read about twenty pages in full: the home page, the pages your llms.txt names, then your service, category, pricing and about pages. A large glossary, blog or directory gets one or two, because a hundred glossary entries don't say more about what you sell than two do. Those pages are listed on the Profile tab under Pages we read.

Every new-page idea is checked against every page

Before the plan tells you to build a page, it checks every page on the list for one that already covers the topic. It compares the words in each page's address and title with the searches in the group.

  • A close match is treated as your existing page. The plan then weighs improving it against building a new one.
  • A looser match is shown to the judgment step as a possible existing page. It decides whether that page really covers the need. A short glossary entry, for example, still counts as your page on the subject, but it doesn't fully cover a buyer's guide.

The page shows which of your pages it matched and how it was found, so you can check the call.

Later research reuses the reading

The profile is read once. Later research on the same site starts at the searches and says so on the progress screen as Reading your site: reused. The page list is still refreshed each time. To read the site again, open the Profile tab and choose Read the Site Again. It's free.

Helping us see all of your site

  • Keep your sitemap up to date. Pages that no page links to and no sitemap lists can't be found.
  • Publish an llms.txt that names your most important pages. We read those first.

Was this helpful?

Still stuck?

Tell us what you were trying to do and which site or page it concerns. A person replies from help@legiit.com, usually within one business day.