Skip to content

Content Crawling

The Crawling tab controls which content Inqyra indexes from your WordPress site.

Navigate to: Inqyra > Configuration > Crawling tab

The Crawling tab showing post type checkboxes and HTML tag options The Crawling tab with post type selection and advanced tag options

Post Types to Crawl

Select which WordPress content types to include in your knowledge base:

  • Posts — Blog posts and articles
  • Pages — Static pages

Free vs Premium

The free version supports Posts and Pages only, with a maximum of 10 pages. Premium users can crawl custom post types (e.g., WooCommerce products, portfolio items, custom content types) with no page limit.

HTML Tags to Extract

By default, Inqyra extracts text from these HTML elements:

  • <p> — Paragraphs
  • <h1>, <h2>, <h3>, <h4> — Headings
  • <li> — List items
  • <td> — Table cells
  • <blockquote> — Block quotes
  • <figcaption> — Image captions

You can add or remove tags based on your site's structure. For example, if your theme uses <span> elements for important content, add that tag to the list.

Adding Custom Tags

Type a tag name in the custom tag input field and press Enter to add it.

Auto Re-crawl

When enabled, Inqyra automatically re-indexes content whenever you save or update a post or page. This keeps your knowledge base up to date without manual intervention.

How Auto Re-crawl Works

  1. You save or update a post in WordPress
  2. Inqyra queues the post for re-crawling (happens in the background)
  3. The content is re-crawled and new chunks are created
  4. Embeddings are generated automatically in your browser the next time you visit any admin page

Tip

Keep auto re-crawl enabled to ensure your chatbot always has the latest content. Disable it only if you prefer to manually control when content is re-indexed.