Validate Source

Check if a URL is crawlable before adding it as a source.

Validate Source

Check if a URL can be used as a source. Returns whether the URL is crawlable and any discovered RSS feeds.

Request body

Field	Type	Required	Description
url	string	Yes	URL to validate

curl -X POST https://twixb.com/api/v1/sources/validate \
  -H "X-API-Key: twxb_your_key_here" \
  -H "Content-Type: application/json" \
  -d '{"url": "https://techcrunch.com"}'

Response

{
  "url": "https://techcrunch.com",
  "source_type": "blog",
  "crawlable": true,
  "error": null,
  "rss_feeds": [
    {
      "url": "https://techcrunch.com/feed/",
      "title": null,
      "description": null,
      "is_category_match": false
    }
  ],
  "recommended_feed": "https://techcrunch.com/feed/"
}

Response fields

Field	Type	Description
crawlable	boolean	Whether the URL can be used as a source
source_type	string	Detected source type
error	string	Error message if not crawlable
rss_feeds	array	Discovered RSS feeds
recommended_feed	string	Best RSS feed to use