Our web crawler now handles JavaScript-rendered websites much more reliably, so you can train your agent on content from modern single-page apps and dynamic sites.
What's New
- JavaScript rendering - Pages that rely on JavaScript to display content are now crawled correctly
- Better content extraction - Improved parsing pulls cleaner, more complete text from complex page layouts
- Wider site compatibility - Train your agent on sites built with React, Vue, Angular, and other modern frameworks
Get Started
- Go to your agent's Sources page
- Add or re-crawl a website URL
- JavaScript-rendered content will be captured automatically