Link Extractor

Use to probe a URL for live HTTP status, final URL, redirects, content-type, and whether the response is HTML. Does not return the page body.

Use to extract the main article or document text from a single-page URL. Not for homepages or hubs (Web Index Cleaner) and not a link inventory (Link Extractor). Server HTML only; JavaScript is not run. Output is text or markdown. If the requested extract has no main content, the other profile is tried once in the same request. The HTTP body has correlation_id and data. The item array is data.resu

Use to extract readable text from a homepage or hub URL. Not a single-article extract (Web Content Cleaner) and not a structured link list (Link Extractor). If the requested extract has no main content, the other profile is tried once in the same request.

Use to list links on a page as structured rows: url, title, desc, rel, nofollow, internal/external, and kind. Not cleaned article body. An empty page returns item error no_links. After filter and dedupe, all unique links are returned; truncated_links is always false.

Use to fetch page metadata from a URL: title, description, Open Graph, favicon, HTTP status, and content type. Optional main-content text. One URL or items[]. Not article text (Web Content Cleaner) and not a link list (Link Extractor). If error is worker_chunk_failed, retry those items; the URL was not fetched. The HTTP body has correlation_id and data. The item array is data.results.

Batch 1-1000. Returns per-address valid plus detail codes.