AI Search adds CSS content selectors for precise website content extraction
Key Points
- CSS selectors for precise content extraction
- URL glob pattern matching support
- Up to 10 content selector entries per instance
Summary
Cloudflare AI Search now supports CSS content selectors for website data sources, enabling precise extraction of relevant content while filtering out navigation, sidebars, and other boilerplate elements.
Key Points
- Selective content extraction: Define CSS selectors paired with URL glob patterns to specify which parts of crawled pages are indexed
- Pattern matching: When a page URL matches a glob pattern, only elements matching the corresponding CSS selector are extracted and converted to Markdown
- Configuration options: Set up content selectors via dashboard or API with support for up to 10 selector entries per instance
- Evaluation order: Selectors are processed sequentially with first matching pattern taking precedence
- API integration: Full API support for programmatic configuration of content selectors