{
  "data": {
    "id": "RT9eB8Rtre1mEYvQS",
    "actId": "DBmfP5hmm0BrHG5lx",
    "userId": "NL4ThgItAwaoBlffQ",
    "startedAt": "2026-11-14T23:04:14.466Z",
    "finishedAt": "2026-11-14T23:04:21.420Z",
    "status": "SUCCEEDED",
    "meta": {
      "origin": "CLI"
    },
    "stats": {
      "durationMillis": 6889,
      "runTimeSecs": 6.889,
      "computeUnits": 0.007654444444444445,
      "imageSizeBytes": 371718656
    },
    "options": {
      "useCache": true,
      "betaPackages": false,
      "memoryMbytes": 4096,
      "diskMbytes": 8192
    },
    "createdByOrganizationMemberUserId": "6GwdnIcc2aWR7LzCS",
    "exitCode": 0,
    "inputSchema": "{\n  \"title\": \"Any News Site Article Extractor input\",\n  \"type\": \"object\",\n  \"schemaVersion\": 1,\n  \"properties\": {\n    \"articleUrls\": {\n      \"title\": \"Article URLs\",\n      \"type\": \"array\",\n      \"description\": \"Paste one or more article URLs to extract directly. Any news site works, and no discovery is needed. When both this and News website URL are set, these URLs are processed first.\",\n      \"editor\": \"stringList\",\n      \"items\": {\n        \"type\": \"string\"\n      },\n      \"example\": [\n        \"https://www.bbc.com/news/articles/example-article\"\n      ]\n    },\n    \"websiteUrl\": {\n      \"title\": \"News website URL\",\n      \"type\": \"string\",\n      \"description\": \"Homepage, section page, or newsroom URL to discover articles from. The actor reads the site's sitemaps first (including robots.txt entries and gzipped sitemaps) and falls back to article-shaped links on the page itself. Leave blank when using Article URLs.\",\n      \"editor\": \"textfield\",\n      \"prefill\": \"https://techcrunch.com\",\n      \"example\": \"https://techcrunch.com\"\n    },\n    \"maxArticles\": {\n      \"title\": \"Maximum articles\",\n      \"type\": \"integer\",\n      \"description\": \"Hard cap on the number of articles returned across all input URLs.\",\n      \"default\": 20,\n      \"minimum\": 1,\n      \"maximum\": 500,\n      \"prefill\": 1\n    },\n    \"keywordFilter\": {\n      \"title\": \"Keyword filter\",\n      \"type\": \"string\",\n      \"description\": \"Boolean expression applied to each article's title and body. Supports AND, OR, NOT and parentheses, case-insensitive. Examples: `AI AND NOT crypto`, `(startup OR funding) AND SaaS`. Leave blank to keep every article.\",\n      \"editor\": \"textfield\",\n      \"example\": \"AI AND startup\"\n    },\n    \"minWordCount\": {\n      \"title\": \"Minimum article word count\",\n      \"type\": \"integer\",\n      \"description\": \"Drop articles whose extracted body text is shorter than this.\",\n      \"default\": 100,\n      \"minimum\": 0,\n      \"maximum\": 10000\n    },\n    \"concurrency\": {\n      \"title\": \"Concurrency\",\n      \"type\": \"integer\",\n      \"description\": \"Number of articles fetched in parallel. Higher is faster but more likely to trigger rate limits on small sites.\",\n      \"default\": 5,\n      \"minimum\": 1,\n      \"maximum\": 20\n    },\n    \"extractKeywords\": {\n      \"title\": \"Extract keywords\",\n      \"type\": \"boolean\",\n      \"description\": \"Compute the top 10 most frequent content words per article (stopwords removed).\",\n      \"default\": true,\n      \"prefill\": true\n    },\n    \"extractSummary\": {\n      \"title\": \"Extract summary\",\n      \"type\": \"boolean\",\n      \"description\": \"Emit the first three sentences of each article as a summary, with a meta-description fallback.\",\n      \"default\": true,\n      \"prefill\": true\n    },\n    \"language\": {\n      \"title\": \"Article language\",\n      \"type\": \"string\",\n      \"description\": \"Language hint for the articles. Use `auto` to detect from site metadata. An explicit language also filters out articles that declare a different one.\",\n      \"editor\": \"select\",\n      \"default\": \"auto\",\n      \"enum\": [\n        \"auto\",\n        \"en\",\n        \"de\",\n        \"fr\",\n        \"es\",\n        \"it\",\n        \"pt\",\n        \"nl\",\n        \"sv\",\n        \"da\",\n        \"no\",\n        \"fi\",\n        \"pl\",\n        \"ru\",\n        \"uk\",\n        \"cs\",\n        \"sk\",\n        \"hu\",\n        \"ro\",\n        \"bg\",\n        \"hr\",\n        \"sr\",\n        \"sl\",\n        \"et\",\n        \"lt\",\n        \"lv\",\n        \"el\",\n        \"tr\",\n        \"he\",\n        \"ar\",\n        \"fa\",\n        \"hi\",\n        \"bn\",\n        \"th\",\n        \"vi\",\n        \"id\",\n        \"ms\",\n        \"ja\",\n        \"ko\",\n        \"zh\"\n      ],\n      \"enumTitles\": [\n        \"Auto-detect\",\n        \"English\",\n        \"German\",\n        \"French\",\n        \"Spanish\",\n        \"Italian\",\n        \"Portuguese\",\n        \"Dutch\",\n        \"Swedish\",\n        \"Danish\",\n        \"Norwegian\",\n        \"Finnish\",\n        \"Polish\",\n        \"Russian\",\n        \"Ukrainian\",\n        \"Czech\",\n        \"Slovak\",\n        \"Hungarian\",\n        \"Romanian\",\n        \"Bulgarian\",\n        \"Croatian\",\n        \"Serbian\",\n        \"Slovenian\",\n        \"Estonian\",\n        \"Lithuanian\",\n        \"Latvian\",\n        \"Greek\",\n        \"Turkish\",\n        \"Hebrew\",\n        \"Arabic\",\n        \"Persian\",\n        \"Hindi\",\n        \"Bengali\",\n        \"Thai\",\n        \"Vietnamese\",\n        \"Indonesian\",\n        \"Malay\",\n        \"Japanese\",\n        \"Korean\",\n        \"Chinese\"\n      ]\n    },\n    \"autoProxyFallback\": {\n      \"title\": \"Auto-retry via proxy when the direct fetch fails\",\n      \"type\": \"boolean\",\n      \"description\": \"When a direct datacenter-IP fetch is blocked (0 candidates or 0 extracted articles), retry the same requests once through Apify residential proxy. Sites that work directly never trigger it. Turn off to guarantee zero proxy spend.\",\n      \"default\": true,\n      \"prefill\": true\n    }\n  }\n}",
    "readme": "# Any News Site Article Extractor\n\nTurn news pages into structured article rows without writing a scraper per publication. Paste article links you already have, or give the actor a news site and let it find the stories itself.\n\n## Two ways to run it\n\n**Known links.** Put one or more article URLs in `articleUrls`. Each page is fetched and parsed directly — useful when you have a list of links from a feed, a newsletter, or a search result.\n\n**Site discovery.** Put a homepage, section page, or newsroom URL in `websiteUrl`. The actor reads the page's current story links first, then walks the publication's sitemaps (including `robots.txt` declarations, sitemap indexes, and gzipped sitemap files) to fill the rest of your quota. A section URL such as `https://example.com/technology` keeps discovery focused on that section.\n\nBoth paths can be combined in one run. Known links are processed first, then discovery continues until `maxArticles` is reached.\n\n## What each article contains\n\n- The canonical article URL and the URL that was requested\n- Headline, author names, publish and last-modified timestamps\n- Full body text with navigation, related-story rails, newsletter prompts, and ad labels removed\n- Word count, detected language, section, and meta description\n- Top image plus every other image inside the article body (related-story and author-card images are excluded)\n- Optional top-10 keyword list and a three-sentence summary\n- Source domain and extraction timestamp\n\nFields a page genuinely does not publish are left out. The actor never writes `null`, empty strings, or empty arrays into a dataset row.\n\n## How the extraction cascade works\n\nEach page is parsed with three fallbacks, in order:\n\n1. **JSON-LD** — `NewsArticle`, `Article`, `BlogPosting`, and related schema.org types, including `@graph` and `mainEntity` wrappers.\n2. **Open Graph / article meta** — `og:*`, `article:published_time`, `article:author`, `article:section`, `og:locale`, and canonical links.\n3. **The rendered HTML** — the most article-specific body container (`.entry-content`, `.article-body`, `[itemprop=articleBody]`, and similar), author bylines, `<time datetime>`, and in-article images.\n\nStructured data wins over meta tags, which win over DOM heuristics. This keeps the output consistent across publishers while still returning clean text on older sites that never adopted JSON-LD.\n\n## Inputs\n\n| Field | Type | Default | What it does |\n|---|---|---|---|\n| `articleUrls` | string[] | – | Article links to extract directly |\n| `websiteUrl` | string | – | Homepage, section, or newsroom URL to discover articles from |\n| `maxArticles` | integer | `20` | Total article cap for the run (1–500) |\n| `keywordFilter` | string | – | Boolean expression over title + body: `AND`, `OR`, `NOT`, parentheses |\n| `minWordCount` | integer | `100` | Drop articles whose body is shorter than this |\n| `concurrency` | integer | `5` | Parallel article fetches (1–20) |\n| `extractKeywords` | boolean | `true` | Add a top-10 keyword list to each row |\n| `extractSummary` | boolean | `true` | Add a three-sentence summary to each row |\n| `language` | string | `auto` | Language hint / filter — `auto` or one of 40 ISO codes |\n| `autoProxyFallback` | boolean | `true` | Retry a blocked direct fetch through Apify residential proxy |\n\nAt least one of `articleUrls` or `websiteUrl` is required.\n\n## Output fields\n\n| Field | Description |\n|---|---|\n| `articleUrl` | URL that was fetched |\n| `articleCanonicalUrl` | Publisher's canonical URL, when declared |\n| `articleTitle` | Headline |\n| `articleAuthors[]` | Author names, cleaned and deduplicated |\n| `articlePublishDate` | ISO 8601 publish timestamp |\n| `articleModifiedDate` | ISO 8601 last-modified timestamp |\n| `articleSection` | Section or desk, when declared |\n| `articleDescription` | Meta / JSON-LD description |\n| `articleText` | Full body text |\n| `articleWordCount` | Words in `articleText` |\n| `articleTopImage` | Hero / lead image URL |\n| `articleImages[]` | All article image URLs, hero first |\n| `articleLanguage` | Detected or requested language code |\n| `articleSiteName` | Publication name, when declared |\n| `articleKeywords[]` | Top content words by frequency (optional) |\n| `articleSummary` | Three-sentence summary (optional) |\n| `sourceDomain` | Hostname of the article |\n| `scrapedAt` | ISO 8601 extraction timestamp |\n\nIf a run finds no usable articles it writes one diagnostic row with `type: \"news_crawler_error\"` and a `reason`, so a scheduled job can tell \"empty result\" apart from \"no output\".\n\n## Examples\n\nExtract three links directly:\n\n```json\n{\n  \"articleUrls\": [\n    \"https://www.bbc.com/news/articles/example-one\",\n    \"https://apnews.com/article/example-two\"\n  ],\n  \"maxArticles\": 3\n}\n```\n\nDiscover the latest stories from a technology publication and keep only AI coverage:\n\n```json\n{\n  \"websiteUrl\": \"https://techcrunch.com\",\n  \"maxArticles\": 25,\n  \"keywordFilter\": \"(AI OR \\\"machine learning\\\") AND NOT crypto\",\n  \"minWordCount\": 200\n}\n```\n\nScan a French news site in French:\n\n```json\n{\n  \"websiteUrl\": \"https://www.franceinfo.fr\",\n  \"maxArticles\": 20,\n  \"language\": \"fr\"\n}\n```\n\n## Common uses\n\n- **Media monitoring** — watch a publication or section and route only matching stories to alerts.\n- **Research corpora** — collect article text and metadata from many outlets into one dataset.\n- **Brand and executive tracking** — filter coverage by names, products, or competitors.\n- **Digest building** — take a list of links from a feed and turn it into clean rows for a newsletter or briefing.\n- **RAG pipelines** — use the body text and canonical URLs as document chunks with reliable provenance.\n\n## FAQ\n\n**Does it work on every news site?**\nMost publications that expose article metadata or a sitemap work without special handling. Pages that are fully client-side rendered, paywalled behind a login, or served as a bot challenge may return thin or no body text.\n\n**What happens on sites that block datacenter IPs?**\nThe direct fetch is tried first. If it is blocked and `autoProxyFallback` is on, the same requests are retried through Apify residential proxy. Sites that work directly never use proxy bandwidth.\n\n**Are duplicate links returned twice?**\nNo. URLs are deduplicated before fetching, so the same article appears once even if it is both pasted and discovered.\n\n**Why did I get fewer rows than `maxArticles`?**\nThe cap is a ceiling, not a promise. A small site, a shallow sitemap, the keyword filter, and the minimum word count can all reduce the number of qualifying articles.\n\n**Can I use the keyword filter with phrases?**\nYes. Quote multi-word phrases: `\"artificial intelligence\" AND NOT \"machine learning\"`. Bare terms match on word boundaries, so `AI` will not match `email`.\n\n**Is this affiliated with any publisher?**\nNo. It is an independent tool that reads publicly accessible pages from any news site. It is not endorsed by or connected to any publication.\n",
    "actorDefinition": {
      "actorSpecification": 1,
      "name": "any-news-site-article-extractor",
      "title": "Any News Site Article Extractor",
      "description": "Extract articles from any news site: paste article URLs or point at a homepage to discover stories. Returns headline, authors, publish date, body text, images, section, keywords and a summary, with keyword and length filters.",
      "version": "1.0",
      "buildTag": "latest",
      "meta": {
        "templateId": "python-start"
      },
      "input": {
        "title": "Any News Site Article Extractor input",
        "type": "object",
        "schemaVersion": 1,
        "properties": {
          "articleUrls": {
            "title": "Article URLs",
            "type": "array",
            "description": "Paste one or more article URLs to extract directly. Any news site works, and no discovery is needed. When both this and News website URL are set, these URLs are processed first.",
            "editor": "stringList",
            "items": {
              "type": "string"
            },
            "example": [
              "https://www.bbc.com/news/articles/example-article"
            ]
          },
          "websiteUrl": {
            "title": "News website URL",
            "type": "string",
            "description": "Homepage, section page, or newsroom URL to discover articles from. The actor reads the site's sitemaps first (including robots.txt entries and gzipped sitemaps) and falls back to article-shaped links on the page itself. Leave blank when using Article URLs.",
            "editor": "textfield",
            "prefill": "https://techcrunch.com",
            "example": "https://techcrunch.com"
          },
          "maxArticles": {
            "title": "Maximum articles",
            "type": "integer",
            "description": "Hard cap on the number of articles returned across all input URLs.",
            "default": 20,
            "minimum": 1,
            "maximum": 500,
            "prefill": 1
          },
          "keywordFilter": {
            "title": "Keyword filter",
            "type": "string",
            "description": "Boolean expression applied to each article's title and body. Supports AND, OR, NOT and parentheses, case-insensitive. Examples: `AI AND NOT crypto`, `(startup OR funding) AND SaaS`. Leave blank to keep every article.",
            "editor": "textfield",
            "example": "AI AND startup"
          },
          "minWordCount": {
            "title": "Minimum article word count",
            "type": "integer",
            "description": "Drop articles whose extracted body text is shorter than this.",
            "default": 100,
            "minimum": 0,
            "maximum": 10000
          },
          "concurrency": {
            "title": "Concurrency",
            "type": "integer",
            "description": "Number of articles fetched in parallel. Higher is faster but more likely to trigger rate limits on small sites.",
            "default": 5,
            "minimum": 1,
            "maximum": 20
          },
          "extractKeywords": {
            "title": "Extract keywords",
            "type": "boolean",
            "description": "Compute the top 10 most frequent content words per article (stopwords removed).",
            "default": true,
            "prefill": true
          },
          "extractSummary": {
            "title": "Extract summary",
            "type": "boolean",
            "description": "Emit the first three sentences of each article as a summary, with a meta-description fallback.",
            "default": true,
            "prefill": true
          },
          "language": {
            "title": "Article language",
            "type": "string",
            "description": "Language hint for the articles. Use `auto` to detect from site metadata. An explicit language also filters out articles that declare a different one.",
            "editor": "select",
            "default": "auto",
            "enum": [
              "auto",
              "en",
              "de",
              "fr",
              "es",
              "it",
              "pt",
              "nl",
              "sv",
              "da",
              "no",
              "fi",
              "pl",
              "ru",
              "uk",
              "cs",
              "sk",
              "hu",
              "ro",
              "bg",
              "hr",
              "sr",
              "sl",
              "et",
              "lt",
              "lv",
              "el",
              "tr",
              "he",
              "ar",
              "fa",
              "hi",
              "bn",
              "th",
              "vi",
              "id",
              "ms",
              "ja",
              "ko",
              "zh"
            ],
            "enumTitles": [
              "Auto-detect",
              "English",
              "German",
              "French",
              "Spanish",
              "Italian",
              "Portuguese",
              "Dutch",
              "Swedish",
              "Danish",
              "Norwegian",
              "Finnish",
              "Polish",
              "Russian",
              "Ukrainian",
              "Czech",
              "Slovak",
              "Hungarian",
              "Romanian",
              "Bulgarian",
              "Croatian",
              "Serbian",
              "Slovenian",
              "Estonian",
              "Lithuanian",
              "Latvian",
              "Greek",
              "Turkish",
              "Hebrew",
              "Arabic",
              "Persian",
              "Hindi",
              "Bengali",
              "Thai",
              "Vietnamese",
              "Indonesian",
              "Malay",
              "Japanese",
              "Korean",
              "Chinese"
            ]
          },
          "autoProxyFallback": {
            "title": "Auto-retry via proxy when the direct fetch fails",
            "type": "boolean",
            "description": "When a direct datacenter-IP fetch is blocked (0 candidates or 0 extracted articles), retry the same requests once through Apify residential proxy. Sites that work directly never trigger it. Turn off to guarantee zero proxy spend.",
            "default": true,
            "prefill": true
          }
        }
      },
      "output": {
        "actorOutputSchemaVersion": 1,
        "title": "Any News Site Article Extractor Output",
        "description": "Structured news articles with URL, headline, authors, publish and modified dates, section, description, full body text, images, language, keywords and summary.",
        "properties": {
          "articles": {
            "type": "string",
            "title": "Articles",
            "description": "Dataset containing all scraped news articles.",
            "template": "{{links.apiDefaultDatasetUrl}}/items"
          }
        }
      },
      "storages": {
        "dataset": {
          "actorSpecification": 1,
          "fields": {},
          "views": {
            "overview": {
              "title": "Articles",
              "transformation": {
                "fields": [
                  "articleUrl",
                  "articleTitle",
                  "articleAuthors",
                  "articlePublishDate",
                  "articleModifiedDate",
                  "articleSection",
                  "articleWordCount",
                  "articleTopImage",
                  "articleLanguage",
                  "articleKeywords",
                  "articleSummary",
                  "sourceDomain",
                  "scrapedAt",
                  "articleCanonicalUrl",
                  "articleDescription",
                  "articleImages",
                  "articleSiteName"
                ]
              },
              "display": {
                "component": "table",
                "properties": {
                  "articleUrl": {
                    "label": "URL",
                    "format": "link"
                  },
                  "articleTitle": {
                    "label": "Title"
                  },
                  "articleAuthors": {
                    "label": "Authors",
                    "format": "array"
                  },
                  "articlePublishDate": {
                    "label": "Published",
                    "format": "date"
                  },
                  "articleModifiedDate": {
                    "label": "Modified",
                    "format": "date"
                  },
                  "articleSection": {
                    "label": "Section"
                  },
                  "articleWordCount": {
                    "label": "Words",
                    "format": "number"
                  },
                  "articleTopImage": {
                    "label": "Top image",
                    "format": "image"
                  },
                  "articleLanguage": {
                    "label": "Language"
                  },
                  "articleKeywords": {
                    "label": "Keywords",
                    "format": "array"
                  },
                  "articleSummary": {
                    "label": "Summary"
                  },
                  "sourceDomain": {
                    "label": "Source"
                  },
                  "scrapedAt": {
                    "label": "Scraped at",
                    "format": "date"
                  },
                  "articleCanonicalUrl": {
                    "label": "Canonical URL",
                    "format": "link"
                  },
                  "articleDescription": {
                    "label": "Description"
                  },
                  "articleImages": {
                    "label": "Images",
                    "format": "array"
                  },
                  "articleSiteName": {
                    "label": "Site name"
                  }
                }
              }
            }
          }
        }
      },
      "dockerfile": "../Dockerfile",
      "readme": "# Any News Site Article Extractor\n\nTurn news pages into structured article rows without writing a scraper per publication. Paste article links you already have, or give the actor a news site and let it find the stories itself.\n\n## Two ways to run it\n\n**Known links.** Put one or more article URLs in `articleUrls`. Each page is fetched and parsed directly — useful when you have a list of links from a feed, a newsletter, or a search result.\n\n**Site discovery.** Put a homepage, section page, or newsroom URL in `websiteUrl`. The actor reads the page's current story links first, then walks the publication's sitemaps (including `robots.txt` declarations, sitemap indexes, and gzipped sitemap files) to fill the rest of your quota. A section URL such as `https://example.com/technology` keeps discovery focused on that section.\n\nBoth paths can be combined in one run. Known links are processed first, then discovery continues until `maxArticles` is reached.\n\n## What each article contains\n\n- The canonical article URL and the URL that was requested\n- Headline, author names, publish and last-modified timestamps\n- Full body text with navigation, related-story rails, newsletter prompts, and ad labels removed\n- Word count, detected language, section, and meta description\n- Top image plus every other image inside the article body (related-story and author-card images are excluded)\n- Optional top-10 keyword list and a three-sentence summary\n- Source domain and extraction timestamp\n\nFields a page genuinely does not publish are left out. The actor never writes `null`, empty strings, or empty arrays into a dataset row.\n\n## How the extraction cascade works\n\nEach page is parsed with three fallbacks, in order:\n\n1. **JSON-LD** — `NewsArticle`, `Article`, `BlogPosting`, and related schema.org types, including `@graph` and `mainEntity` wrappers.\n2. **Open Graph / article meta** — `og:*`, `article:published_time`, `article:author`, `article:section`, `og:locale`, and canonical links.\n3. **The rendered HTML** — the most article-specific body container (`.entry-content`, `.article-body`, `[itemprop=articleBody]`, and similar), author bylines, `<time datetime>`, and in-article images.\n\nStructured data wins over meta tags, which win over DOM heuristics. This keeps the output consistent across publishers while still returning clean text on older sites that never adopted JSON-LD.\n\n## Inputs\n\n| Field | Type | Default | What it does |\n|---|---|---|---|\n| `articleUrls` | string[] | – | Article links to extract directly |\n| `websiteUrl` | string | – | Homepage, section, or newsroom URL to discover articles from |\n| `maxArticles` | integer | `20` | Total article cap for the run (1–500) |\n| `keywordFilter` | string | – | Boolean expression over title + body: `AND`, `OR`, `NOT`, parentheses |\n| `minWordCount` | integer | `100` | Drop articles whose body is shorter than this |\n| `concurrency` | integer | `5` | Parallel article fetches (1–20) |\n| `extractKeywords` | boolean | `true` | Add a top-10 keyword list to each row |\n| `extractSummary` | boolean | `true` | Add a three-sentence summary to each row |\n| `language` | string | `auto` | Language hint / filter — `auto` or one of 40 ISO codes |\n| `autoProxyFallback` | boolean | `true` | Retry a blocked direct fetch through Apify residential proxy |\n\nAt least one of `articleUrls` or `websiteUrl` is required.\n\n## Output fields\n\n| Field | Description |\n|---|---|\n| `articleUrl` | URL that was fetched |\n| `articleCanonicalUrl` | Publisher's canonical URL, when declared |\n| `articleTitle` | Headline |\n| `articleAuthors[]` | Author names, cleaned and deduplicated |\n| `articlePublishDate` | ISO 8601 publish timestamp |\n| `articleModifiedDate` | ISO 8601 last-modified timestamp |\n| `articleSection` | Section or desk, when declared |\n| `articleDescription` | Meta / JSON-LD description |\n| `articleText` | Full body text |\n| `articleWordCount` | Words in `articleText` |\n| `articleTopImage` | Hero / lead image URL |\n| `articleImages[]` | All article image URLs, hero first |\n| `articleLanguage` | Detected or requested language code |\n| `articleSiteName` | Publication name, when declared |\n| `articleKeywords[]` | Top content words by frequency (optional) |\n| `articleSummary` | Three-sentence summary (optional) |\n| `sourceDomain` | Hostname of the article |\n| `scrapedAt` | ISO 8601 extraction timestamp |\n\nIf a run finds no usable articles it writes one diagnostic row with `type: \"news_crawler_error\"` and a `reason`, so a scheduled job can tell \"empty result\" apart from \"no output\".\n\n## Examples\n\nExtract three links directly:\n\n```json\n{\n  \"articleUrls\": [\n    \"https://www.bbc.com/news/articles/example-one\",\n    \"https://apnews.com/article/example-two\"\n  ],\n  \"maxArticles\": 3\n}\n```\n\nDiscover the latest stories from a technology publication and keep only AI coverage:\n\n```json\n{\n  \"websiteUrl\": \"https://techcrunch.com\",\n  \"maxArticles\": 25,\n  \"keywordFilter\": \"(AI OR \\\"machine learning\\\") AND NOT crypto\",\n  \"minWordCount\": 200\n}\n```\n\nScan a French news site in French:\n\n```json\n{\n  \"websiteUrl\": \"https://www.franceinfo.fr\",\n  \"maxArticles\": 20,\n  \"language\": \"fr\"\n}\n```\n\n## Common uses\n\n- **Media monitoring** — watch a publication or section and route only matching stories to alerts.\n- **Research corpora** — collect article text and metadata from many outlets into one dataset.\n- **Brand and executive tracking** — filter coverage by names, products, or competitors.\n- **Digest building** — take a list of links from a feed and turn it into clean rows for a newsletter or briefing.\n- **RAG pipelines** — use the body text and canonical URLs as document chunks with reliable provenance.\n\n## FAQ\n\n**Does it work on every news site?**\nMost publications that expose article metadata or a sitemap work without special handling. Pages that are fully client-side rendered, paywalled behind a login, or served as a bot challenge may return thin or no body text.\n\n**What happens on sites that block datacenter IPs?**\nThe direct fetch is tried first. If it is blocked and `autoProxyFallback` is on, the same requests are retried through Apify residential proxy. Sites that work directly never use proxy bandwidth.\n\n**Are duplicate links returned twice?**\nNo. URLs are deduplicated before fetching, so the same article appears once even if it is both pasted and discovered.\n\n**Why did I get fewer rows than `maxArticles`?**\nThe cap is a ceiling, not a promise. A small site, a shallow sitemap, the keyword filter, and the minimum word count can all reduce the number of qualifying articles.\n\n**Can I use the keyword filter with phrases?**\nYes. Quote multi-word phrases: `\"artificial intelligence\" AND NOT \"machine learning\"`. Bare terms match on word boundaries, so `AI` will not match `email`.\n\n**Is this affiliated with any publisher?**\nNo. It is an independent tool that reads publicly accessible pages from any news site. It is not endorsed by or connected to any publication.\n",
      "categories": [
        "NEWS"
      ]
    },
    "buildNumber": "1.0.2",
    "imageDigest": "abed6d19aac63fcfaca7795edba8d7105b83ce0051077beeb8b1c1dc466d8e26",
    "actVersion": {
      "sourceType": "SOURCE_FILES",
      "buildTag": "latest",
      "versionNumber": "1.0"
    },
    "usage": {
      "ACTOR_COMPUTE_UNITS": 0.007654444444444445
    }
  }
}