Historia aktualizacjiukończony
orchestrator
start · 14.07.2026, 12:00:00 · koniec · 14.07.2026, 12:01:16 · czas · 1m 15s
Znalezione
9
Pobrane
9
Nowe
9
Duplikaty
6
Trafienia
0
Metryki etapów
| Etap | We | Wy | Błędy | Czas | LLM (calls/avg ms) |
|---|---|---|---|---|---|
| discover | 39 | 9 | 0 | 6.4s | — |
| predupe | 0 | 0 | 0 | 2ms | — |
| scrape | 39 | 9 | 0 | 3.9s | — |
| normalize | 9 | 9 | 0 | 1.4s | — |
| dedup | 9 | 3 | 0 | 12.1s | — |
| heal | 0 | 0 | 0 | 4ms | — |
| availability | 150 | 0 | 0 | 51.8s | — |
| knockout | 0 | 0 | 0 | 0ms | — |
| notify | 0 | 0 | 0 | 7ms | — |
| knockout | 2 | 0 | 0 | 6ms | — |
| notify | 0 | 0 | 0 | 5ms | — |
| knockout | 1 | 0 | 0 | 5ms | — |
| notify | 0 | 0 | 0 | 4ms | — |
| Łącznie | 249 | 30 | 0 | 1m 15s | — |
Logi na żywo
ostatnie 255 linii
10:00:00 [log] === Orchestrator started ===10:00:00 [log] Running 39 discovery tasks10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawa?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,podkowa-lesna10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,stare-babice10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawa?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/izabelin?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/pruszkowski/michalowice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/milanowek?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/podkowa-lesna?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/stare-babice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,warszawa10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/izabelin?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/pruszkowski/michalowice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/stare-babice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,warszawa10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,izabelin10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,michalowice10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,milanowek10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,konstancin-jeziorna10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,michalowice10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/grodziski/podkowa-lesna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/piaseczynski/konstancin--jeziorna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,podkowa-lesna10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,stare-babice10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/mazowieckie/warszawa?priceMax=2800000&areaMin=90&daysSinceCreated=2&by=LATEST&direction=DESC10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,izabelin10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,mieszkanie,sprzedaz,,warszawa10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)10:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/milanowek?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/milanowek?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 21) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/land/Milanówek: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/podkowa-lesna?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/podkowa-lesna?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 22) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/land/Podkowa Leśna: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/piaseczynski/konstancin--jeziorna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/piaseczynski/konstancin--jeziorna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 2) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/house/Konstancin-Jeziorna: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/stare-babice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/stare-babice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 5) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/house/Stare Babice: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawa?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawa?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 18) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/land/Warszawa: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/stare-babice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/stare-babice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 23) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/land/Stare Babice: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/pruszkowski/michalowice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/pruszkowski/michalowice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 3) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/house/Michałowice: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/izabelin?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/izabelin?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 1) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/house/Izabelin: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawa?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawa?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 0) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/house/Warszawa: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/pruszkowski/michalowice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/pruszkowski/michalowice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 20) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/land/Michałowice: 0 new URLs10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/grodziski/podkowa-lesna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/grodziski/podkowa-lesna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 4) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/house/Podkowa Leśna: 0 new URLs10:00:01 [log] Page 1: found 36 URLs, hasNext: true10:00:01 [log] Page 1: dropped 16/36 out-of-city URLs (want podkowa-lesna)10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/izabelin?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/izabelin?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 19) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/land/Izabelin: 0 new URLs10:00:01 [log] Page 1: found 38 URLs, hasNext: true10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/house/Podkowa Leśna: 0 new URLs10:00:01 [log] Page 1: found 41 URLs, hasNext: true10:00:01 [log] Page 1: dropped 17/41 out-of-city URLs (want podkowa-lesna)10:00:01 [log] Page 1: found 38 URLs, hasNext: true10:00:01 [log] Page 1: found 41 URLs, hasNext: true10:00:01 [log] Page 1: dropped 16/41 out-of-city URLs (want stare-babice)10:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/mazowieckie/warszawa?priceMax=2800000&areaMin=90&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/mazowieckie/warszawa?priceMax=2800000&areaMin=90&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value. at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 36) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:01 [log] Discovery complete for otodom/flat/Warszawa: 0 new URLs10:00:01 [log] Page 1: found 41 URLs, hasNext: true10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/land/Podkowa Leśna: 0 new URLs10:00:01 [log] Page 1: found 41 URLs, hasNext: true10:00:01 [log] Page 1: dropped 32/41 out-of-city URLs (want izabelin)10:00:01 [log] Stopping pagination: 87% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/flat/Warszawa: 5 new URLs10:00:01 [log] Page 1: found 41 URLs, hasNext: true10:00:01 [log] Page 1: found 41 URLs, hasNext: true10:00:01 [log] Page 1: dropped 6/41 out-of-city URLs (want michalowice)10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/land/Izabelin: 0 new URLs10:00:01 [log] Page 1: found 36 URLs, hasNext: true10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/land/Stare Babice: 0 new URLs10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [log] Page 1: found 40 URLs, hasNext: true10:00:01 [log] Page 1: dropped 21/40 out-of-city URLs (want stare-babice)10:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/house/Michałowice: 0 new URLs10:00:01 [log] Page 1: found 39 URLs, hasNext: true10:00:01 [log] Page 1: dropped 34/39 out-of-city URLs (want izabelin)10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/house/Izabelin: 0 new URLs10:00:01 [log] Page 1: found 39 URLs, hasNext: true10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/house/Stare Babice: 0 new URLs10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/land/Michałowice: 0 new URLs10:00:01 [log] Stopping pagination: 95% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/land/Warszawa: 2 new URLs10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/land/Milanówek: 0 new URLs10:00:01 [log] Stopping pagination: 94% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/house/Warszawa: 2 new URLs10:00:01 [log] Stopping pagination: 100% URLs already known10:00:01 [log] Discovery complete for nieruchomosci/house/Konstancin-Jeziorna: 0 new URLs10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)10:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 14) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/house/Konstancin-Jeziorna: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 38) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/flat/Warszawa: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 33) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/land/Milanówek: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 30) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/land/Warszawa: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 13) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/house/Izabelin: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 32) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/land/Michałowice: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 35) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/land/Stare Babice: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 34) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/land/Podkowa Leśna: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 31) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/land/Izabelin: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 12) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/house/Warszawa: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 15) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/house/Michałowice: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 16) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/house/Podkowa Leśna: 0 new URLs10:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd"> <HTML><HEAD><META at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19) at process.processTicksAndRejections (node:internal/process/task_queues:103:5) at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20) at async withRetry (file:///app/dist/src/lib/retry.js:16:20) at async file:///app/dist/src/pipeline/run-pipeline.js:211:25 at async Promise.allSettled (index 17) at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33) at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)10:00:06 [log] Discovery complete for olx/house/Stare Babice: 0 new URLs10:00:06 [log] [discover] done · 39 in · 9 out · 0 err · 6358ms · otodom(0→0/0) nieruchomosci(0→9/0) olx(0→0/0)10:00:06 [log] Discovery complete: 9 new URLs10:00:06 [log] [predupe] done · 0 in · 0 out · 0 err · 2ms · · 0 pre-scrape duplicates10:00:06 [log] Running 2 scrape batches (39 URLs)10:00:06 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie,z-oddzielna-kuchnia/26818753.html10:00:06 [log] Scrape batch complete: 0 scraped, 0 created, 0 failed10:00:07 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie,z-kuchnia-z-oknem/26816045.html10:00:08 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie-w-bloku-mieszkalnym,do-odswiezenia/26827451.html10:00:08 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie,na-sprzedaz/26809303.html10:00:09 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie,z-kuchnia-z-oknem/26798905.html10:00:09 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,na-sprzedaz/26827590.html10:00:09 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,na-sprzedaz/26827725.html10:00:09 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dom,na-sprzedaz/26823554.html10:00:10 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dom,na-sprzedaz/26802977.html10:00:10 [log] Scrape batch complete: 9 scraped, 9 created, 0 failed10:00:10 [log] Scraping complete: 9 scraped, 9 created, 0 failed10:00:10 [log] [scrape] done · 39 in · 9 out · 0 err · 3885ms · http 910:00:12 [log] [normalize] done · 9 in · 9 out · 0 err · 1390ms · · 0 skipped10:00:12 [log] Normalize: 9 normalized, 0 skipped10:00:12 [log] Running deduplication...10:00:24 [log] [dedup] done · 9 in · 3 out · 0 err · 12068ms · · 6 duplicates merged10:00:24 [log] Deduplication: 6 duplicates found10:00:24 [log] [heal] done · 0 in · 0 out · 0 err · 4ms · · 0 healed, 0 cleared10:00:34 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-milanowek-CID3-ID1ba3I2.html (attempt 1/4)10:00:35 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-milanowek-CID3-ID1ba3I2.html (attempt 2/4)10:00:37 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-milanowek-CID3-ID1ba3I2.html (attempt 3/4)10:00:41 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-808-mkw-warszawa-CID3-ID1bdZW3.html (attempt 1/4)10:00:42 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-808-mkw-warszawa-CID3-ID1bdZW3.html (attempt 2/4)10:00:44 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-808-mkw-warszawa-CID3-ID1bdZW3.html (attempt 3/4)10:00:49 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-piekny-domek-70m2-na-dzialce-rod-CID3-ID1aQnHN.html (attempt 1/4)10:00:50 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-warszawa-CID3-ID19S4Wq.html (attempt 1/4)10:00:50 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-piekny-domek-70m2-na-dzialce-rod-CID3-ID1aQnHN.html (attempt 2/4)10:00:51 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-warszawa-CID3-ID19S4Wq.html (attempt 2/4)10:00:52 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-piekny-domek-70m2-na-dzialce-rod-CID3-ID1aQnHN.html (attempt 3/4)10:00:53 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-warszawa-CID3-ID19S4Wq.html (attempt 3/4)10:00:56 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-warszawa-zacisze-po-generalnym-remoncie-CID3-ID1axFiO.html (attempt 1/4)10:00:56 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-warszawa-CID3-ID1ajrR6.html (attempt 1/4)10:00:56 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rekreacyjna-na-sprzedaz-CID3-ID16CN1B.html (attempt 1/4)10:00:57 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-warszawa-zacisze-po-generalnym-remoncie-CID3-ID1axFiO.html (attempt 2/4)10:00:57 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-warszawa-CID3-ID1ajrR6.html (attempt 2/4)10:00:57 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rekreacyjna-na-sprzedaz-CID3-ID16CN1B.html (attempt 2/4)10:00:59 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-warszawa-zacisze-po-generalnym-remoncie-CID3-ID1axFiO.html (attempt 3/4)10:00:59 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-warszawa-CID3-ID1ajrR6.html (attempt 3/4)10:00:59 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rekreacyjna-na-sprzedaz-CID3-ID16CN1B.html (attempt 3/4)10:01:02 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-wola-ulrychow-284-m-nowy-domek-4x4-m-taras-12-m-CID3-ID1aqY10.html (attempt 1/4)10:01:02 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-radar-na-sprzedaz-nie-rod-CID3-ID1aQrM9.html (attempt 1/4)10:01:02 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-warszawa-targowek-CID3-ID1aVdAK.html (attempt 1/4)10:01:02 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-CID3-ID1avGOL.html (attempt 1/4)10:01:03 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-wola-ulrychow-284-m-nowy-domek-4x4-m-taras-12-m-CID3-ID1aqY10.html (attempt 2/4)10:01:03 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-radar-na-sprzedaz-nie-rod-CID3-ID1aQrM9.html (attempt 2/4)10:01:03 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-warszawa-targowek-CID3-ID1aVdAK.html (attempt 2/4)10:01:03 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-CID3-ID1avGOL.html (attempt 2/4)10:01:05 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-wola-ulrychow-284-m-nowy-domek-4x4-m-taras-12-m-CID3-ID1aqY10.html (attempt 3/4)10:01:05 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-radar-na-sprzedaz-nie-rod-CID3-ID1aQrM9.html (attempt 3/4)10:01:05 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-warszawa-targowek-CID3-ID1aVdAK.html (attempt 3/4)10:01:05 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-CID3-ID1avGOL.html (attempt 3/4)10:01:08 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-CID3-IDYtzkE.html (attempt 1/4)10:01:09 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-CID3-IDYtzkE.html (attempt 2/4)10:01:11 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-budowlana-CID3-IDYtzkE.html (attempt 3/4)10:01:16 [log] [availability] done · 150 in · 0 out · 0 err · 51763ms · · 0 removed (gone)10:01:16 [log] Availability: 150 checked, 0 removed10:01:16 [log] Processing 3 listings in this run's cohort10:01:16 [log] Processing profile: Domy Warszawa i okolice10:01:16 [log] [knockout] done · 0 in · 0 out · 0 err · 0ms · · 0 knocked out10:01:16 [log] Knockout: 0 survivors, 0 knocked out10:01:16 [log] Notifications sent: 010:01:16 [log] [notify] done · 0 in · 0 out · 0 err · 7ms10:01:16 [log] Processing profile: Działki Warszawa i okolice10:01:16 [log] [knockout] done · 2 in · 0 out · 0 err · 6ms · · 2 knocked out10:01:16 [log] Knockout: 0 survivors, 2 knocked out10:01:16 [log] Notifications sent: 010:01:16 [log] [notify] done · 0 in · 0 out · 0 err · 5ms10:01:16 [log] Processing profile: Mieszkania Warszawa10:01:16 [log] [knockout] done · 1 in · 0 out · 0 err · 5ms · · 1 knocked out10:01:16 [log] Knockout: 0 survivors, 1 knocked out10:01:16 [log] Notifications sent: 010:01:16 [log] [notify] done · 0 in · 0 out · 0 err · 4ms