Historia aktualizacji

orchestrator

start · 14.07.2026, 00:00:00 · koniec · 14.07.2026, 00:01:21 · czas · 1m 20s

ukończony
Znalezione
7
Pobrane
7
Nowe
7
Duplikaty
2
Trafienia
0

Metryki etapów

EtapWeWyBłędyCzasLLM (calls/avg ms)
discover39706.4s—
predupe0002ms—
scrape37702.9s—
normalize7701.2s—
dedup75012.1s—
heal0003ms—
availability1500040.3s—
knockout0000ms—
notify0005ms—
knockout41011ms—
enrich1101.8s—
walking140057ms—
assets110834ms—
score11013.2s1 / 0ms
notify0009ms—
knockout1008ms—
notify0004ms—
Łącznie2497001m 19s1 / 0ms

Logi na żywo

ostatnie 249 linii
22:00:00 [log] === Orchestrator started ===
22:00:00 [log] Running 39 discovery tasks
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawa?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,podkowa-lesna
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,stare-babice
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/stare-babice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawa?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/izabelin?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/izabelin?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/pruszkowski/michalowice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/podkowa-lesna?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/pruszkowski/michalowice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/piaseczynski/konstancin--jeziorna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,warszawa
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,izabelin
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,michalowice
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/stare-babice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/milanowek?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,milanowek
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,podkowa-lesna
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,stare-babice
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/mazowieckie/warszawa?priceMax=2800000&areaMin=90&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,mieszkanie,sprzedaz,,warszawa
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/grodziski/podkowa-lesna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
22:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,konstancin-jeziorna
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,warszawa
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,izabelin
22:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,michalowice
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc (attempt 1/4)
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/podkowa-lesna?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/podkowa-lesna?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 22)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/land/Podkowa Leśna: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/izabelin?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/izabelin?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 1)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/house/Izabelin: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/pruszkowski/michalowice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/pruszkowski/michalowice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 20)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/land/Michałowice: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/stare-babice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/stare-babice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 5)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/house/Stare Babice: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/izabelin?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/izabelin?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 19)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/land/Izabelin: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/mazowieckie/warszawa?priceMax=2800000&areaMin=90&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/mazowieckie/warszawa?priceMax=2800000&areaMin=90&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 36)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/flat/Warszawa: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/milanowek?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/milanowek?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 21)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/land/Milanówek: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/stare-babice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/stare-babice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 23)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/land/Stare Babice: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/piaseczynski/konstancin--jeziorna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/piaseczynski/konstancin--jeziorna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 2)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/house/Konstancin-Jeziorna: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawa?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawa?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 18)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/land/Warszawa: 0 new URLs
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/pruszkowski/michalowice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/pruszkowski/michalowice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 3)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/house/Michałowice: 0 new URLs
22:00:00 [log] Page 1: found 36 URLs, hasNext: true
22:00:00 [log] Page 1: dropped 16/36 out-of-city URLs (want podkowa-lesna)
22:00:00 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawa?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawa?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 0)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:00 [log] Discovery complete for otodom/house/Warszawa: 0 new URLs
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/house/Podkowa Leśna: 0 new URLs
22:00:01 [log] Page 1: found 40 URLs, hasNext: true
22:00:01 [log] Page 1: found 41 URLs, hasNext: true
22:00:01 [log] Page 1: dropped 6/41 out-of-city URLs (want michalowice)
22:00:01 [log] Page 1: found 41 URLs, hasNext: true
22:00:01 [log] Stopping pagination: 90% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/land/Warszawa: 4 new URLs
22:00:01 [log] Page 1: found 40 URLs, hasNext: true
22:00:01 [log] Page 1: dropped 20/40 out-of-city URLs (want stare-babice)
22:00:01 [error] Failed to fetch search page https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/grodziski/podkowa-lesna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: FirecrawlError: Firecrawl HTTP 402 for https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/grodziski/podkowa-lesna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC: {"success":false,"error":"Insufficient credits to perform this request. For more credits, you can upgrade your plan at https://firecrawl.dev/pricing or try changing the request limit to a lower value.
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:180:26)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 4)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:01 [log] Discovery complete for otodom/house/Podkowa Leśna: 0 new URLs
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/land/Michałowice: 0 new URLs
22:00:01 [log] Stopping pagination: 98% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/land/Milanówek: 1 new URLs
22:00:01 [log] Page 1: found 39 URLs, hasNext: true
22:00:01 [log] Page 1: found 41 URLs, hasNext: true
22:00:01 [log] Page 1: dropped 16/41 out-of-city URLs (want stare-babice)
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/house/Stare Babice: 0 new URLs
22:00:01 [log] Page 1: found 39 URLs, hasNext: true
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/land/Stare Babice: 0 new URLs
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/house/Michałowice: 0 new URLs
22:00:01 [log] Page 1: found 36 URLs, hasNext: true
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/house/Konstancin-Jeziorna: 0 new URLs
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/house/Warszawa: 0 new URLs
22:00:01 [log] Page 1: found 38 URLs, hasNext: true
22:00:01 [log] Stopping pagination: 95% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/flat/Warszawa: 2 new URLs
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [log] Page 1: found 41 URLs, hasNext: true
22:00:01 [log] Page 1: dropped 32/41 out-of-city URLs (want izabelin)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [log] Page 1: found 40 URLs, hasNext: true
22:00:01 [log] Page 1: dropped 35/40 out-of-city URLs (want izabelin)
22:00:01 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc (attempt 2/4)
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/house/Izabelin: 0 new URLs
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/land/Izabelin: 0 new URLs
22:00:01 [log] Page 1: found 41 URLs, hasNext: true
22:00:01 [log] Page 1: dropped 17/41 out-of-city URLs (want podkowa-lesna)
22:00:01 [log] Stopping pagination: 100% URLs already known
22:00:01 [log] Discovery complete for nieruchomosci/land/Podkowa Leśna: 0 new URLs
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc (attempt 3/4)
22:00:03 [warn] HTTP 403 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc (attempt 3/4)
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 31)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/land/Izabelin: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 16)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/house/Podkowa Leśna: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 35)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/land/Stare Babice: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 32)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/land/Michałowice: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 12)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/house/Warszawa: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 17)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/house/Stare Babice: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 15)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/house/Michałowice: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 14)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/house/Konstancin-Jeziorna: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 13)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/house/Izabelin: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 30)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/land/Warszawa: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=90951&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 33)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/land/Milanówek: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 34)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/land/Podkowa Leśna: 0 new URLs
22:00:06 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc: Error: olx: expected JSON from https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc but got a non-JSON body (likely blocked/error): <!DOCTYPE HTML PUBLIC "-//W3C//DTD HTML 4.01 Transitional//EN" "http://www.w3.org/TR/html4/loose.dtd">
<HTML><HEAD><META
    at fetchPageHtml (file:///app/dist/src/lib/fetcher.js:107:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:50:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:211:25
    at async Promise.allSettled (index 38)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:196:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
22:00:06 [log] Discovery complete for olx/flat/Warszawa: 0 new URLs
22:00:06 [log] [discover] done · 39 in · 7 out · 0 err · 6374ms · otodom(0→0/0) nieruchomosci(0→7/0) olx(0→0/0)
22:00:06 [log] Discovery complete: 7 new URLs
22:00:06 [log] [predupe] done · 0 in · 0 out · 0 err · 2ms · · 0 pre-scrape duplicates
22:00:06 [log] Running 2 scrape batches (37 URLs)
22:00:06 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,na-sprzedaz/26827008.html
22:00:06 [log] Scrape batch complete: 0 scraped, 0 created, 0 failed
22:00:07 [log] Scraping: https://milanowek.nieruchomosci-online.pl/dzialka,na-sprzedaz/26825391.html
22:00:07 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie,na-sprzedaz/26621480.html
22:00:08 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie,z-aneksem-kuchennym/26826106.html
22:00:08 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,na-sprzedaz/26826370.html
22:00:08 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,na-sprzedaz/26825193.html
22:00:09 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,na-sprzedaz/26825097.html
22:00:09 [log] Scrape batch complete: 7 scraped, 7 created, 0 failed
22:00:09 [log] Scraping complete: 7 scraped, 7 created, 0 failed
22:00:09 [log] [scrape] done · 37 in · 7 out · 0 err · 2866ms · http 7
22:00:10 [log] [normalize] done · 7 in · 7 out · 0 err · 1206ms · · 0 skipped
22:00:10 [log] Normalize: 7 normalized, 0 skipped
22:00:10 [log] Running deduplication...
22:00:22 [log] [dedup] done · 7 in · 5 out · 0 err · 12076ms · · 2 duplicates merged
22:00:22 [log] Deduplication: 2 duplicates found
22:00:22 [log] [heal] done · 0 in · 0 out · 0 err · 3ms · · 0 healed, 0 cleared
22:00:29 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-czerniakow-CID3-ID1b3837.html (attempt 1/4)
22:00:29 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-0-82-ha-z-wlasna-linia-brzegowa-rzeki-czarna-hancza-gmina-giby-CID3-ID1b3GwD.html (attempt 1/4)
22:00:29 [warn] HTTP 403 for https://www.olx.pl/d/oferta/apartament-mieszkanie-119-m2-warszawa-skwer-wyszynskiego-5-CID3-ID1aHke4.html (attempt 1/4)
22:00:30 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-czerniakow-CID3-ID1b3837.html (attempt 2/4)
22:00:30 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-0-82-ha-z-wlasna-linia-brzegowa-rzeki-czarna-hancza-gmina-giby-CID3-ID1b3GwD.html (attempt 2/4)
22:00:30 [warn] HTTP 403 for https://www.olx.pl/d/oferta/apartament-mieszkanie-119-m2-warszawa-skwer-wyszynskiego-5-CID3-ID1aHke4.html (attempt 2/4)
22:00:32 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-czerniakow-CID3-ID1b3837.html (attempt 3/4)
22:00:32 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-0-82-ha-z-wlasna-linia-brzegowa-rzeki-czarna-hancza-gmina-giby-CID3-ID1b3GwD.html (attempt 3/4)
22:00:32 [warn] HTTP 403 for https://www.olx.pl/d/oferta/apartament-mieszkanie-119-m2-warszawa-skwer-wyszynskiego-5-CID3-ID1aHke4.html (attempt 3/4)
22:00:35 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-mieszka-i-warszawa-domek-murowany-CID3-ID1aaxic.html (attempt 1/4)
22:00:36 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-mieszka-i-warszawa-domek-murowany-CID3-ID1aaxic.html (attempt 2/4)
22:00:38 [warn] HTTP 403 for https://www.olx.pl/d/oferta/dzialka-rod-mieszka-i-warszawa-domek-murowany-CID3-ID1aaxic.html (attempt 3/4)
22:00:41 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-ladna-dzialke-1500m2-narozna-b-wz-milanowek-polesie-CID3-ID18JWJg.html (attempt 1/4)
22:00:42 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-ladna-dzialke-1500m2-narozna-b-wz-milanowek-polesie-CID3-ID18JWJg.html (attempt 2/4)
22:00:44 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-ladna-dzialke-1500m2-narozna-b-wz-milanowek-polesie-CID3-ID18JWJg.html (attempt 3/4)
22:00:49 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-600m2-CID3-ID1aJLiV.html (attempt 1/4)
22:00:50 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-600m2-CID3-ID1aJLiV.html (attempt 2/4)
22:00:52 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-dzialke-rod-600m2-CID3-ID1aJLiV.html (attempt 3/4)
22:00:57 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-warszawa-wawer-1531-m2-lasu-obok-centrum-zdrowia-dziecka-CID3-ID1aZGSR.html (attempt 1/4)
22:00:58 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-warszawa-wawer-1531-m2-lasu-obok-centrum-zdrowia-dziecka-CID3-ID1aZGSR.html (attempt 2/4)
22:01:00 [warn] HTTP 403 for https://www.olx.pl/d/oferta/sprzedam-warszawa-wawer-1531-m2-lasu-obok-centrum-zdrowia-dziecka-CID3-ID1aZGSR.html (attempt 3/4)
22:01:03 [log] [availability] done · 150 in · 0 out · 0 err · 40319ms · · 0 removed (gone)
22:01:03 [log] Availability: 150 checked, 0 removed
22:01:03 [log] Processing 5 listings in this run's cohort
22:01:03 [log] Processing profile: Domy Warszawa i okolice
22:01:03 [log] [knockout] done · 0 in · 0 out · 0 err · 0ms · · 0 knocked out
22:01:03 [log] Knockout: 0 survivors, 0 knocked out
22:01:03 [log] Notifications sent: 0
22:01:03 [log] [notify] done · 0 in · 0 out · 0 err · 5ms
22:01:03 [log] Processing profile: Działki Warszawa i okolice
22:01:03 [log] [knockout] done · 4 in · 1 out · 0 err · 11ms · · 3 knocked out
22:01:03 [log] Knockout: 1 survivors, 3 knocked out
22:01:04 [log] [enrich] done · 1 in · 1 out · 0 err · 1764ms
22:01:04 [log] Enrich: 1 enriched
22:01:07 [log] [walking] done · 1 in · 40 out · 0 err · 57ms
22:01:07 [log] Walking: 40 distances calculated
22:01:07 [log] Asset fetch complete: 1/1 listings, 3 photos
22:01:07 [log] [assets] done · 1 in · 1 out · 0 err · 834ms · · 3 photos
22:01:07 [log] Assets: 1/1 listings, 3 photos
22:01:21 [log] Scoring progress: 1/1 processed (1 scored, top 59)
22:01:21 [log] Scoring complete: 1 scored, top: 59
22:01:21 [log] [score] done · 1 in · 1 out · 0 err · 13179ms · llm 1×0ms · · top: 59
22:01:21 [log] Score: 1 scored, top: 59
22:01:21 [log] Notifications sent: 0
22:01:21 [log] [notify] done · 0 in · 0 out · 0 err · 9ms · · 0 sent
22:01:21 [log] Processing profile: Mieszkania Warszawa
22:01:21 [log] [knockout] done · 1 in · 0 out · 0 err · 8ms · · 1 knocked out
22:01:21 [log] Knockout: 0 survivors, 1 knocked out
22:01:21 [log] Notifications sent: 0
22:01:21 [log] [notify] done · 0 in · 0 out · 0 err · 4ms