Historia aktualizacji

orchestrator

start · 30.07.2026, 12:00:00 · koniec · 30.07.2026, 12:01:04 · czas · 1m 4s

ukończony
Znalezione
4
Pobrane
4
Nowe
4
Duplikaty
1
Trafienia
0

Metryki etapów

EtapWeWyBłędyCzasLLM (calls/avg ms)
discover364144.5s—
scrape47401.3s—
normalize640747ms—
dedup43012.0s—
heal0004ms—
availability5105.6s—
resurrect0001ms—
knockout0000ms—
notify0005ms—
knockout1006ms—
notify0003ms—
knockout2007ms—
notify0004ms—
Łącznie1011611m 4s—

Logi na żywo

ostatnie 177 linii
10:00:00 [log] === Orchestrator started ===
10:00:00 [log] Running 36 discovery tasks
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawa?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,podkowa-lesna
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,stare-babice
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=17871&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=6925&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=117385&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=32345&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=140885&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=18&city_id=37063&filter_float_price%3Ato=2700000&filter_float_m%3Afrom=150&filter_float_m%3Ato=280&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/mieszkanie/mazowieckie/warszawa?priceMax=2800000&areaMin=90&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,mieszkanie,sprzedaz,,warszawa
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=14&city_id=17871&filter_float_price%3Ato=2800000&filter_float_m%3Afrom=90&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawa?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/piaseczynski/konstancin--jeziorna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/stare-babice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/grodziski/podkowa-lesna?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/izabelin?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/pruszkowski/michalowice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/grodziski/podkowa-lesna?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dzialka/mazowieckie/warszawski-zachodni/stare-babice?priceMax=1600000&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,konstancin-jeziorna
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/warszawski-zachodni/izabelin?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,warszawa
10:00:00 [log] Fetching search page (incremental): https://www.otodom.pl/pl/wyniki/sprzedaz/dom/mazowieckie/pruszkowski/michalowice?priceMax=2700000&areaMin=150&areaMax=280&daysSinceCreated=2&by=LATEST&direction=DESC
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,warszawa
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=17871&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=140885&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,izabelin
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,michalowice
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=32345&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,podkowa-lesna
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dzialka,sprzedaz,,stare-babice
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=6925&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,michalowice
10:00:00 [log] Fetching search page (incremental): https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc
10:00:00 [log] Fetching search page (incremental): https://www.nieruchomosci-online.pl/szukaj.html?3,dom,sprzedaz,,izabelin
10:00:01 [log] Page 1: found 38 URLs, hasNext: true
10:00:01 [log] Page 1: dropped 23/38 out-of-city URLs (want podkowa-lesna)
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/house/Podkowa Leśna: 0 new URLs
10:00:01 [log] Page 1: found 40 URLs, hasNext: true
10:00:01 [log] Page 1: found 38 URLs, hasNext: true
10:00:01 [log] Page 1: found 41 URLs, hasNext: true
10:00:01 [log] Page 1: dropped 18/41 out-of-city URLs (want podkowa-lesna)
10:00:01 [log] Page 1: found 0 URLs, hasNext: false
10:00:01 [log] Discovery complete for olx/house/Stare Babice: 0 new URLs
10:00:01 [log] Stopping pagination: 95% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/land/Warszawa: 2 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/land/Podkowa Leśna: 0 new URLs
10:00:01 [log] Stopping pagination: 95% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/flat/Warszawa: 2 new URLs
10:00:01 [log] Page 1: found 41 URLs, hasNext: true
10:00:01 [log] Page 1: dropped 15/41 out-of-city URLs (want stare-babice)
10:00:01 [log] Page 1: found 41 URLs, hasNext: true
10:00:01 [log] Page 1: dropped 2/41 out-of-city URLs (want michalowice)
10:00:01 [log] Page 1: found 0 URLs, hasNext: false
10:00:01 [log] Discovery complete for olx/house/Konstancin-Jeziorna: 0 new URLs
10:00:01 [log] Page 1: found 41 URLs, hasNext: true
10:00:01 [log] Page 1: dropped 32/41 out-of-city URLs (want izabelin)
10:00:01 [log] Page 1: found 0 URLs, hasNext: false
10:00:01 [log] Discovery complete for olx/house/Podkowa Leśna: 0 new URLs
10:00:01 [log] Page 1: found 38 URLs, hasNext: true
10:00:01 [log] Page 1: dropped 19/38 out-of-city URLs (want stare-babice)
10:00:01 [log] Page 1: found 38 URLs, hasNext: true
10:00:01 [log] Page 1: found 40 URLs, hasNext: true
10:00:01 [log] Page 1: found 0 URLs, hasNext: false
10:00:01 [log] Discovery complete for olx/house/Michałowice: 0 new URLs
10:00:01 [log] Page 1: found 3 URLs, hasNext: false
10:00:01 [log] Page 1: found 40 URLs, hasNext: true
10:00:01 [log] Page 1: dropped 32/40 out-of-city URLs (want izabelin)
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for otodom/house/Konstancin-Jeziorna: 0 new URLs
10:00:01 [log] Page 1: found 35 URLs, hasNext: true
10:00:01 [log] Page 1: found 0 URLs, hasNext: false
10:00:01 [log] Discovery complete for olx/house/Izabelin: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/land/Izabelin: 0 new URLs
10:00:01 [log] Page 1: found 9 URLs, hasNext: true
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/house/Izabelin: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/land/Stare Babice: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/house/Stare Babice: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for olx/flat/Warszawa: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/house/Konstancin-Jeziorna: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/land/Michałowice: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/house/Michałowice: 0 new URLs
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for nieruchomosci/house/Warszawa: 0 new URLs
10:00:01 [log] Page 1: found 2 URLs, hasNext: false
10:00:01 [log] Stopping pagination: 100% URLs already known
10:00:01 [log] Discovery complete for otodom/house/Stare Babice: 0 new URLs
10:00:02 [log] Page 1: found 29 URLs, hasNext: false
10:00:02 [log] Stopping pagination: 100% URLs already known
10:00:02 [log] Discovery complete for otodom/flat/Warszawa: 0 new URLs
10:00:02 [log] Page 1: found 4 URLs, hasNext: true
10:00:02 [log] Stopping pagination: 100% URLs already known
10:00:02 [log] Discovery complete for olx/house/Warszawa: 0 new URLs
10:00:02 [log] Page 1: found 8 URLs, hasNext: false
10:00:02 [log] Stopping pagination: 100% URLs already known
10:00:02 [log] Discovery complete for otodom/land/Warszawa: 0 new URLs
10:00:02 [log] Page 1: found 7 URLs, hasNext: false
10:00:02 [log] Stopping pagination: 100% URLs already known
10:00:02 [log] Discovery complete for otodom/house/Warszawa: 0 new URLs
10:00:03 [log] Page 1: found 0 URLs, hasNext: false
10:00:03 [log] Discovery complete for otodom/house/Podkowa Leśna: 0 new URLs
10:00:05 [log] Page 1: found 0 URLs, hasNext: false
10:00:05 [log] Discovery complete for otodom/land/Izabelin: 0 new URLs
10:00:06 [log] Page 1: found 2 URLs, hasNext: false
10:00:06 [log] Stopping pagination: 100% URLs already known
10:00:06 [log] Discovery complete for otodom/land/Stare Babice: 0 new URLs
10:00:06 [log] Page 1: found 0 URLs, hasNext: false
10:00:06 [log] Discovery complete for otodom/house/Michałowice: 0 new URLs
10:00:06 [log] Page 1: found 0 URLs, hasNext: false
10:00:06 [log] Discovery complete for otodom/land/Podkowa Leśna: 0 new URLs
10:00:06 [log] Page 1: found 0 URLs, hasNext: false
10:00:06 [log] Discovery complete for otodom/house/Izabelin: 0 new URLs
10:00:06 [log] Page 1: found 0 URLs, hasNext: false
10:00:06 [log] Discovery complete for olx/land/Michałowice: 0 new URLs
10:00:07 [log] Page 1: found 0 URLs, hasNext: false
10:00:07 [log] Discovery complete for otodom/land/Michałowice: 0 new URLs
10:00:07 [log] Page 1: found 0 URLs, hasNext: false
10:00:07 [log] Discovery complete for olx/land/Izabelin: 0 new URLs
10:00:08 [log] Page 1: found 41 URLs, hasNext: true
10:00:08 [log] Stopping pagination: 100% URLs already known
10:00:08 [log] Discovery complete for olx/land/Warszawa: 0 new URLs
10:00:09 [log] Page 1: found 0 URLs, hasNext: false
10:00:09 [log] Discovery complete for olx/land/Podkowa Leśna: 0 new URLs
10:00:44 [error] Failed to fetch search page https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: FirecrawlError: Firecrawl HTTP 408 for https://www.olx.pl/api/v1/offers/?offset=0&limit=40&category_id=24&city_id=37063&filter_float_price%3Ato=1600000&sort_by=created_at%3Adesc: {"success":false,"code":"SCRAPE_TIMEOUT","error":"The scrape operation timed out before completing. This happens when a page takes too long to load, render, or process. Possible causes: (1) The websit
    at scrapeOnce (file:///app/dist/src/lib/firecrawl.js:118:19)
    at process.processTicksAndRejections (node:internal/process/task_queues:103:5)
    at async firecrawlScrapeWithRetry (file:///app/dist/src/lib/firecrawl.js:181:26)
    at async firecrawlFetchHtml (file:///app/dist/src/lib/firecrawl.js:199:13)
    at async discoverListings (file:///app/dist/src/pipeline/stages/discover.js:51:20)
    at async withRetry (file:///app/dist/src/lib/retry.js:16:20)
    at async file:///app/dist/src/pipeline/run-pipeline.js:288:25
    at async Promise.allSettled (index 35)
    at async runPipelineBody (file:///app/dist/src/pipeline/run-pipeline.js:273:33)
    at async withRunLogging (file:///app/dist/src/lib/run-log.js:114:16)
10:00:44 [log] Discovery complete for olx/land/Stare Babice: 0 new URLs
10:00:44 [log] [discover] done · 36 in · 4 out · 1 err · 44524ms · otodom(0→0/0) nieruchomosci(0→4/0) olx(0→0/1)
10:00:44 [log] Discovery complete: 4 new URLs
10:00:44 [log] Running 3 scrape batches (47 URLs)
10:00:44 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,ogrodzona/26864422.html
10:00:45 [log] Scrape batch complete: 0 scraped, 0 created, 0 failed
10:00:45 [log] Scrape batch complete: 0 scraped, 0 created, 0 failed
10:00:45 [log] Scraping: https://warszawa.nieruchomosci-online.pl/dzialka,na-sprzedaz/26864082.html
10:00:45 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie-w-bloku-mieszkalnym,wysoki-standard/26864359.html
10:00:45 [log] Scraping: https://warszawa.nieruchomosci-online.pl/mieszkanie,z-oddzielna-kuchnia/26863655.html
10:00:46 [log] Scrape batch complete: 4 scraped, 4 created, 0 failed
10:00:46 [log] Scraping complete: 4 scraped, 4 created, 0 failed
10:00:46 [log] [scrape] done · 47 in · 4 out · 0 err · 1320ms · http 4
10:00:47 [log] [normalize] done · 6 in · 4 out · 0 err · 747ms · · 2 skipped
10:00:47 [log] Normalize: 4 normalized, 2 skipped
10:00:47 [log] Running deduplication...
10:00:59 [log] [dedup] done · 4 in · 3 out · 0 err · 11985ms · · 1 duplicates merged
10:00:59 [log] Deduplication: 1 duplicates found
10:00:59 [log] [heal] done · 0 in · 0 out · 0 err · 4ms · · 0 healed, 0 cleared
10:01:04 [log] [availability] done · 5 in · 1 out · 0 err · 5551ms · · 1 removed (gone)
10:01:04 [log] Availability: 5 checked, 1 removed
10:01:04 [log] [resurrect] done · 0 in · 0 out · 0 err · 1ms · · 0 revived
10:01:04 [log] Resurrection: 0 checked, 0 revived
10:01:04 [log] Processing 3 listings in this run's cohort
10:01:04 [log] Processing profile: Domy Warszawa i okolice
10:01:04 [log] [knockout] done · 0 in · 0 out · 0 err · 0ms · · 0 knocked out
10:01:04 [log] Knockout: 0 survivors, 0 knocked out
10:01:04 [log] Notifications sent: 0
10:01:04 [log] [notify] done · 0 in · 0 out · 0 err · 5ms
10:01:04 [log] Processing profile: Mieszkania Warszawa
10:01:04 [log] [knockout] done · 1 in · 0 out · 0 err · 6ms · · 1 knocked out
10:01:04 [log] Knockout: 0 survivors, 1 knocked out
10:01:04 [log] Notifications sent: 0
10:01:04 [log] [notify] done · 0 in · 0 out · 0 err · 3ms
10:01:04 [log] Processing profile: Działki Warszawa i okolice
10:01:04 [log] [knockout] done · 2 in · 0 out · 0 err · 7ms · · 2 knocked out
10:01:04 [log] Knockout: 0 survivors, 2 knocked out
10:01:04 [log] Notifications sent: 0
10:01:04 [log] [notify] done · 0 in · 0 out · 0 err · 4ms
10:01:04 [log] === Orchestrator complete ===