2025-06-18 16:00:11 [scrapy.utils.log] INFO: Scrapy 2.13.2 started (bot: scrapybot) 2025-06-18 16:00:11 [scrapy.utils.log] INFO: Versions: {'lxml': '5.4.0', 'libxml2': '2.13.8', 'cssselect': '1.3.0', 'parsel': '1.10.0', 'w3lib': '2.3.1', 'Twisted': '25.5.0', 'Python': '3.10.18 (main, Jun 10 2025, 23:52:59) [GCC 12.2.0]', 'pyOpenSSL': '25.1.0 (OpenSSL 3.5.0 8 Apr 2025)', 'cryptography': '45.0.4', 'Platform': 'Linux-6.8.0-55-generic-x86_64-with-glibc2.36'} 2025-06-18 16:00:11 [scrapy.addons] INFO: Enabled addons: [] 2025-06-18 16:00:11 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.epollreactor.EPollReactor 2025-06-18 16:00:11 [scrapy.middleware] INFO: Enabled extensions: ['scrapy.extensions.corestats.CoreStats', 'scrapy.extensions.memusage.MemoryUsage', 'scrapy.extensions.logstats.LogStats', 'scrapy.extensions.throttle.AutoThrottle'] 2025-06-18 16:00:11 [scrapy.crawler] INFO: Overridden settings: {'AUTOTHROTTLE_DEBUG': True, 'AUTOTHROTTLE_ENABLED': True, 'AUTOTHROTTLE_TARGET_CONCURRENCY': 4.0, 'COMMANDS_MODULE': 'houses.commands', 'CONCURRENT_REQUESTS': 8, 'DEFAULT_ITEM_CLASS': 'houses.items.HousesItem', 'DOWNLOAD_DELAY': 0.3, 'FTP_PASSWORD': 'H4KgYJ4zNyTTVokQGa_4', 'FTP_USER': 'ftpuser', 'HTTPCACHE_DIR': '/etc/scrapyd_cache', 'HTTPCACHE_ENABLED': True, 'HTTPCACHE_POLICY': 'crawler_utils.httpcache.GradualExpiresPolicy', 'HTTPCACHE_STORAGE': 'crawler_utils.httpcache.FilesystemCacheStorage', 'LOG_FILE': '/app/logs/rental_nl/pri_nl/4c5a10084c5d11f089dfae2447f2c79f.log', 'NEWSPIDER_MODULE': 'houses.spiders', 'RANDOMIZE_DOWNLOAD_DELAY': False, 'SPIDER_MODULES': ['houses.spiders'], 'TELNETCONSOLE_ENABLED': False, 'TWISTED_REACTOR': 'twisted.internet.epollreactor.EPollReactor', 'URLLENGTH_LIMIT': 5000, 'USER_AGENT': 'Mozilla/5.0 (X11; Linux x86_64) AppleWebKit/537.36 (KHTML, ' 'like Gecko) Chrome/29.0.1547.65 Safari/537.36'} 2025-06-18 16:00:11 [scrapy.middleware] INFO: Enabled downloader middlewares: ['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware', 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware', 'houses.middlewares.Fake404Middleware', 'crawler_utils.middlewares.MyUserAgentMiddleware', 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware', 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware', 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware', 'scrapy.downloadermiddlewares.retry.RetryMiddleware', 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware', 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware', 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware', 'rotating_proxies.middlewares.RotatingProxyMiddleware', 'rotating_proxies.middlewares.BanDetectionMiddleware', 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware', 'scrapy.downloadermiddlewares.stats.DownloaderStats', 'scrapy.downloadermiddlewares.httpcache.HttpCacheMiddleware'] 2025-06-18 16:00:11 [scrapy.middleware] INFO: Enabled spider middlewares: ['scrapy.spidermiddlewares.start.StartSpiderMiddleware', 'scrapy.spidermiddlewares.httperror.HttpErrorMiddleware', 'scrapy.spidermiddlewares.referer.RefererMiddleware', 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware', 'scrapy.spidermiddlewares.depth.DepthMiddleware'] 2025-06-18 16:00:11 [crawler_utils.yaml_export_pipeline] INFO: YamlExportPipeline initialized with FTP host: crawler-data.boligzonen.dk, user: ftpuser 2025-06-18 16:00:11 [crawler_utils.yaml_export_pipeline] INFO: Output directories: ['upload/rental_nl'] 2025-06-18 16:00:11 [crawler_utils.yaml_export_pipeline] INFO: Output tempdir: /tmp/rental_nl 2025-06-18 16:00:11 [crawler_utils.yaml_export_pipeline] INFO: Using PostCodeValidator for project: rental_nl 2025-06-18 16:00:11 [scrapy.middleware] INFO: Enabled item pipelines: ['houses.pipelines.DuplicatesPipeline', 'crawler_utils.yaml_export_pipeline.YamlExportPipeline'] 2025-06-18 16:00:11 [scrapy.core.engine] INFO: Spider opened 2025-06-18 16:00:11 [py.warnings] WARNING: /usr/local/lib/python3.10/site-packages/scrapy/core/spidermw.py:433: ScrapyDeprecationWarning: houses.spiders.pri_nl.RenthousevastgoedSpider defines the deprecated start_requests() method. start_requests() has been deprecated in favor of a new method, start(), to support asynchronous code execution. start_requests() will stop being called in a future version of Scrapy. If you use Scrapy 2.13 or higher only, replace start_requests() with start(); note that start() is a coroutine (async def). If you need to maintain compatibility with lower Scrapy versions, when overriding start_requests() in a spider class, override start() as well; you can use super() to reuse the inherited start() implementation without copy-pasting. See the release notes of Scrapy 2.13 for details: https://docs.scrapy.org/en/2.13/news.html warn( 2025-06-18 16:00:11 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min) 2025-06-18 16:00:11 [rotating_proxies.middlewares] INFO: Proxies(good: 0, dead: 0, unchecked: 7, reanimated: 0, mean backoff time: 0s) 2025-06-18 16:00:12 [scrapy.extensions.throttle] INFO: slot: fr.proxymesh.com | conc: 1 | delay: 2570 ms (-2429) | latency: 567 ms | size: 14732 bytes 2025-06-18 16:00:12 [crawler_utils.httpcache] INFO: ***Dont cache 2025-06-18 16:00:12 [rotating_proxies.expire] DEBUG: Proxy is GOOD 2025-06-18 16:00:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: None) 2025-06-18 16:00:12 [scrapy.extensions.throttle] INFO: slot: ch.proxymesh.com | conc: 1 | delay: 2542 ms (-2457) | latency: 342 ms | size: 14183 bytes 2025-06-18 16:00:12 [crawler_utils.httpcache] INFO: ***Dont cache 2025-06-18 16:00:12 [rotating_proxies.expire] DEBUG: Proxy is GOOD 2025-06-18 16:00:12 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.pri.nl/rentals/) 2025-06-18 16:00:16 [scrapy.extensions.throttle] INFO: slot: fr.proxymesh.com | conc: 1 | delay: 1322 ms (-1248) | latency: 292 ms | size: 14719 bytes 2025-06-18 16:00:16 [crawler_utils.httpcache] INFO: ***Dont cache 2025-06-18 16:00:16 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.pri.nl/rentals/) 2025-06-18 16:00:17 [scrapy.extensions.throttle] INFO: slot: nl.proxymesh.com | conc: 1 | delay: 2522 ms (-2477) | latency: 181 ms | size: 28374 bytes 2025-06-18 16:00:17 [crawler_utils.httpcache] INFO: ***Dont cache 2025-06-18 16:00:17 [rotating_proxies.expire] DEBUG: Proxy is GOOD 2025-06-18 16:00:17 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.pri.nl/rentals/?_paged=1) 2025-06-18 16:00:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.pri.nl/woningen/stade-de-colombes-56-amsterdam-06ab7af5-7f42-4e07-84c6-e8ce09269170/> {'area': 147, 'available': '2025-06-18', 'balcony': True, 'deposit_numb': 8900, 'description': '.\n' 'Description.\n' '**IMMEDIATELY AVAILABLE **.\n' 'Stade de Colombes, 1098 VT Amsterdam.\n' '**NO SHARING TENANTS**.\n' 'We offer in the Watergraafsmeer a beautifully situated semi ' 'furnished 05 room home of approx. 150 m2 with 04 bedrooms ' 'divided over 03 floors. On the front there is private parking ' 'for 02 cars and on the back there is a sunny garden facing ' 'South West with jetty on the water..\n' 'The home is beautifully situated in the car-free young ' 'residential area “Park de Meer”. On the west side of the ' 'district, completely surrounded by the smart nature park de ' 'Meer, is this dead end part of the Stade de Colombes, also ' 'known as the gold coast. on the odd side the well-known ' 'Stadsvillas and on the south side this mansion on the water; ' 'a unique part of town where a home is rarely available..\n' 'Layout:.\n' 'Entrance, spacious hallway with wardrobe, doors to meter ' 'cupboard and guest toilet with basin. Open kitchen with ' 'dining area, a few steps down to spacious bright living room ' 'with French doors to the garden. The open fully equipped ' 'kitchen is located at the front and offers sufficient ' 'cupboard space and various built-in appliances such as: a ' 'dishwasher, induction hob, double oven including a steam oven ' 'and fridge with separate freezer. Both kitchen and living ' 'have tiled heated floors..\n' 'First floor:.\n' 'You reach the first floor via the staircase in the hallway. ' 'Through the landing you have access to 2 bedrooms at the rear ' 'and 1 spacious bedroom at the front with high ceilings. The ' 'luxurious bathroom is equipped a large bath tub, walk-in ' 'shower, double basin with drawers below, 2nd toilet and ' 'design radiator..\n' 'Second floor:.\n' 'Via the open staircase you reach the landing with doors to ' 'the laundry area/ internal storage and the spacious studio ' 'bedroom on this level. There are 02 French Balconies offering ' 'an exceptional view over the gardens and the water at the ' 'back of the home. This level could be ideal for a home ' 'office, to host guests, to have 02 children share or to ' 'create a home cinema!.\n' 'Location:.\n' 'The neighborhood has an open and changing character and is ' 'surrounded by lots of water and greenery, laid out as an ' 'Ecopark. you have a wide variety of (sports) facilities, ' 'including: Jaap’s restaurant and terrace, skating rink with ' 'fitness, athletics track, tennis, hockey, football, etc. You ' 'will also find a large “nature play” playground around the ' 'corner for children. The quiet street – with only local ' 'traffic from residents of this part of the Stade – is ' 'child-friendly and the neighborhood has a tasteful and ' 'playful design. In the immediate vicinity are: excellent ' 'schools (Montessori, WSV, Dalton), beautiful shops, sports ' 'facilities, roads (A1, A2 and ring A10), public transport ' 'such as bus 40, a subway connection to the World Trade Center ' 'and tram line 19 to the Central Station and Science Park..\n' 'The playfulness of the high ceilings and the split level in ' 'the living room give the home a pleasant and atmospheric ' 'character with great light. In short this is an unique object ' 'with lots of living space and unique because of its location ' 'and size. Such a house is very exceptional within the ' 'Amsterdam Ring road and within cycling distance of the ' 'center!.\n' 'Specifications:.\n' '• 05 room town house.\n' '• 04 bedrooms.\n' '• Living area approx. 150 m2.\n' '• Spacious garden with jetty on the water facing South West.\n' '• Storage.\n' '• Semi furnished.\n' '• Private parking for 02 cars in front of the home.\n' '• Floor heated.\n' '• Solar panels.\n' '• Charger for car present.\n' '• Energy label A.\n' '• Model A rental agreement for in- definitive term.\n' 'Please contact our office to schedule a viewing and we will ' 'be happy to show you around!.\n' 'Read the full description.', 'energy_label': 'a_2015', 'external_property_attributes': {'external_property_id': '3435728e905986abbcbe1fc0a147f5ea', 'external_provider_id': 844, 'property_url': 'https://www.pri.nl/woningen/stade-de-colombes-56-amsterdam-06ab7af5-7f42-4e07-84c6-e8ce09269170/'}, 'furnished': True, 'house_number': '56', 'images': ['https://media.nvm.nl/360x/f76f9641-9e7b-42a6-b65c-854b196247a9?v=20250513T152501', 'https://media.nvm.nl/360x/6362bebd-d959-4829-89ed-28ae36ce8cf1?v=20250513T152501', 'https://media.nvm.nl/360x/04b119d7-32d3-4665-bf7d-15a7b31862c3?v=20250513T152501', 'https://media.nvm.nl/360x/83c03d36-090a-4870-8635-155ec5bb0edd?v=20250513T152501', 'https://media.nvm.nl/360x/e546405d-eb0c-41e3-a8a8-5485629150a9?v=20250513T152501', 'https://media.nvm.nl/360x/4b293503-78ed-4798-b6fc-3a29da36f613?v=20250513T152501', 'https://media.nvm.nl/360x/644dfc91-e4d3-402d-bebe-257b2aca7e15?v=20250513T152501', 'https://media.nvm.nl/360x/9d11b53b-d63e-4a5a-8b1f-f233918a8e30?v=20250513T152501', 'https://media.nvm.nl/360x/f7f9859f-ec7c-47ad-b882-69751be96865?v=20250513T152501', 'https://media.nvm.nl/360x/b5fad0fd-7365-4277-89da-6bc186baddef?v=20250513T152501', 'https://media.nvm.nl/360x/a3ac0a40-8e93-4ee1-b555-033a4791dcdd?v=20250513T152501', 'https://media.nvm.nl/360x/d51e7e1a-3dbb-4e5f-a621-765496eeedfc?v=20250513T152501', 'https://media.nvm.nl/360x/ff6901d0-4d68-442e-9735-adc5bb07be06?v=20250513T152501', 'https://media.nvm.nl/360x/e5f88393-8f99-4ac1-87ac-7433f837d3d3?v=20250513T152501', 'https://media.nvm.nl/360x/846f0909-7c99-47f1-b911-4c659f423bba?v=20250513T152501', 'https://media.nvm.nl/360x/978856c4-03f7-4551-8ccc-933108e47a62?v=20250513T152501', 'https://media.nvm.nl/360x/f69a96ce-8b34-43e8-afa9-7d977894d62e?v=20250513T152501', 'https://media.nvm.nl/360x/349fdb12-0b9f-4be0-8f66-285b83bef277?v=20250513T152501', 'https://media.nvm.nl/360x/3aaa9b9c-6700-464c-b8b5-ab292b66876a?v=20250513T152501', 'https://media.nvm.nl/360x/4be29d1d-eefc-4e85-9c48-65b2f177fa25?v=20250513T152501', 'https://media.nvm.nl/360x/99a8a3d0-f8cf-4564-ac5f-f7e1edd539e6?v=20250513T152501', 'https://media.nvm.nl/360x/1613f3bf-20e0-4fab-8cf6-5a98a4367a42?v=20250513T152501', 'https://media.nvm.nl/360x/25d16283-155a-472b-a66e-f39672a3c885?v=20250513T152501', 'https://media.nvm.nl/360x/f6930e9d-1846-4a90-a8ab-fff54fb58c73?v=20250513T152501', 'https://media.nvm.nl/360x/89921605-347b-4bb1-9352-e095646a0ab9?v=20250513T152501', 'https://media.nvm.nl/360x/a3f0e8be-9265-431b-b084-8949898c64d1?v=20250513T152501', 'https://media.nvm.nl/360x/d95d9086-9b62-4cbb-a1a3-5dac4c0d8548?v=20250513T152501', 'https://media.nvm.nl/360x/1802d513-1bf6-4ef6-9617-4d9c3fbf53f9?v=20250513T152501', 'https://media.nvm.nl/360x/74a3ec71-8096-4447-b890-adb9ddf28a15?v=20250513T152501', 'https://media.nvm.nl/360x/c23bb93e-cb5e-43f3-ae85-0c4c067d586c?v=20250513T152501', 'https://media.nvm.nl/360x/1369e1f8-cfaa-445b-8229-11264228a3c0?v=20250513T152501', 'https://media.nvm.nl/360x/035eb3df-7383-470e-b390-e11e5e7df06a?v=20250513T152501', 'https://media.nvm.nl/360x/06ed2011-dd7b-457e-a60d-a758b88ac081?v=20250513T152501', 'https://media.nvm.nl/360x/36d9b63e-678e-4e38-9f1b-6d7da4ea5b4b?v=20250513T152501', 'https://media.nvm.nl/360x/e45f4662-449b-471b-9b72-2dd32964130e?v=20250513T152501', 'https://media.nvm.nl/360x/dda9f8b8-44a1-42ed-8a0f-95f1c3205051?v=20250513T152501', 'https://media.nvm.nl/360x/cb681b11-49f9-4682-93af-75d3c4f5cebf?v=20250513T152501', 'https://media.nvm.nl/360x/4b2125f1-720a-4a7d-b121-3b84bd1fe5a8?v=20250513T152501', 'https://media.nvm.nl/360x/addd2def-1d3f-48f3-b2b4-d38ded1dcd7d?v=20250513T152501', 'https://media.nvm.nl/360x/32ca54e8-a213-4d15-b66e-da5fde4d5dc2?v=20250513T152501', 'https://media.nvm.nl/360x/ec2380cb-e23f-401d-b20d-6ce66bf52833?v=20250513T152501'], 'property_type': 'Apartment', 'rent': 4450, 'rental_period_id': 3, 'rooms': 5, 'street_name': 'Stade de Colombes', 'zip_code_code': '1098 VT'} 2025-06-18 16:00:22 [scrapy.extensions.throttle] INFO: slot: nl.proxymesh.com | conc: 1 | delay: 1270 ms (-1251) | latency: 75 ms | size: 26105 bytes 2025-06-18 16:00:22 [crawler_utils.httpcache] INFO: ***Dont cache 2025-06-18 16:00:22 [scrapy.core.engine] DEBUG: Crawled (200) (referer: https://www.pri.nl/rentals/?_paged=1) 2025-06-18 16:00:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.pri.nl/woningen/omval-78-amsterdam-555a4942-034a-4098-b017-f2b4a6bfce0a/> {'area': 330, 'available': '2025-07-01', 'deposit_numb': 16000, 'description': '.\n' 'Description.\n' '**AVAILABLE FROM THE 1st OF JULY**.\n' 'Omval, 1096 HV Amsterdam.\n' 'We offer an excellent well laid out penthouse of app. 320 m2 ' 'with 5 bedrooms and 4 bathrooms in a well- organized ' 'apartment building ‘De Staalmeesters’ overlooking the Amstel ' 'river giving you a breath-taking view of Amsterdam and ' 'surroundings. In the garage below is a parking spot equipped ' 'with an electric charging station and if needed additional ' 'spots are available..\n' 'Lay-out: entrance ground floor, hallway, elevator to top ' 'floor. Spacious landing of former 3 apartments which are now ' 'combined into one luxurious penthouse. Middle door giving ' 'access to the property, wide hallway with doors to all rooms ' 'and bathrooms..\n' 'French doors to spacious bright living facing South in the ' 'middle of the apartment, with sliding doors to a terrace of ' 'app. 50 m² alongside the complete length of the apartment. ' 'Television or library room on the left side with a ' 'magnificent view along the Amstel River, and on the right a ' 'cosy dining room overlooking the City of Amsterdam. Connected ' 'to the dining room is a spacious fully equipped kitchen with ' 'a breakfast table..\n' 'On the side and on the back of the property are 5 well sized ' 'bedrooms with build-in wardrobes of which 3 have en-suite ' 'full bathrooms with tub, walk-in shower, double basin, and ' 'toilet. The master bedroom offers a spacious ' 'walk-in-wardrobe. There are 2 guest bathrooms accessible via ' 'the hallway..\n' 'There are parquet floors throughout the property, and the ' 'larger bedrooms have been carpeted in a natural colour ' 'well-chosen quality..\n' 'The 02 storage rooms and private parking spot(s) are located ' 'in the basement of the building and can be reached via the ' 'elevator..\n' 'Location:.\n' 'The building is located very close to the Amstel train ' 'station, the ring road A 10, highway A 2 to Utrecht, and the ' 'Centre of Amsterdam..\n' 'Specifications:.\n' '• Spacious magnificent penthouse.\n' '• Top to bottom windows in all rooms on the front.\n' '• Fully equipped luxurious kitchen.\n' '• Formal dining area.\n' '• Library or television room.\n' '• 5 generous bedrooms.\n' '• 4 state-of-the-art bathrooms.\n' '• All-round unique view of Amsterdam and the Amstel River.\n' '• Private parking spaces in garage underneath the building.\n' '• Electric charging station available.\n' '• Separate storage rooms.\n' '• Mod. A agreement for an in- definitive term.\n' '• Rental price of € 8.000,– per month excluding utilities, ' 'inclusive of service cost..\n' 'The apartment is for rent for expats with owners prior ' 'consent..\n' 'Please contact our office to view this special property with ' 'breath-taking views..\n' 'Read the full description.', 'elevator': True, 'energy_label': 'b', 'external_property_attributes': {'external_property_id': '3364de6ebddf190d39f8026dd9e01613', 'external_provider_id': 844, 'property_url': 'https://www.pri.nl/woningen/omval-78-amsterdam-555a4942-034a-4098-b017-f2b4a6bfce0a/'}, 'house_number': '78', 'images': ['https://media.nvm.nl/360x/c8f16156-8da8-41ac-9a96-038574bc87e5?v=20250618T075001', 'https://media.nvm.nl/360x/7506b11c-13be-4a6a-8a2b-f33cc8929a00?v=20250618T075001', 'https://media.nvm.nl/360x/35b9642d-f206-4601-a11c-9e604a97614a?v=20250618T075001', 'https://media.nvm.nl/360x/43b39650-5da2-4acd-ba75-0efb40a44c72?v=20250618T075001', 'https://media.nvm.nl/360x/95d97984-6681-4f5a-a3ae-40afe4cda0bb?v=20250618T075001', 'https://media.nvm.nl/360x/0a6e56d1-7467-4563-aeb4-dc85437aa87f?v=20250618T075001', 'https://media.nvm.nl/360x/9eb2b414-a05d-4ddb-944c-e9d3993d868a?v=20250618T075001', 'https://media.nvm.nl/360x/797664d3-7b38-4723-a799-8702c8298c57?v=20250618T075001', 'https://media.nvm.nl/360x/ac4938b2-490f-485e-b78b-827ef93bab8e?v=20250618T075001', 'https://media.nvm.nl/360x/c9a6f1a1-31b4-4055-a993-97f85550cb62?v=20250618T075001', 'https://media.nvm.nl/360x/43b29489-0475-435d-918e-b1f987d9bd0a?v=20250618T075001', 'https://media.nvm.nl/360x/06f51132-0ff7-4cb3-baa0-79c40c1028a4?v=20250618T075001', 'https://media.nvm.nl/360x/b3f59de7-588f-402b-9ce1-e2577a7f1f48?v=20250618T075001', 'https://media.nvm.nl/360x/384b6e92-0165-4750-8437-521a141b42e1?v=20250618T075001', 'https://media.nvm.nl/360x/6745e4c6-33a5-400b-a46b-5d103f742848?v=20250618T075001', 'https://media.nvm.nl/360x/a981da54-599b-443c-8979-67c9eae205df?v=20250618T075001', 'https://media.nvm.nl/360x/9e63a070-29bc-4ed5-bd43-03551afbc995?v=20250618T075001', 'https://media.nvm.nl/360x/24a39178-c15c-4e0a-b69a-181b7aa52483?v=20250618T075001', 'https://media.nvm.nl/360x/60fae69f-2802-4ce7-a0a7-0c9bbe7af0fd?v=20250618T075001', 'https://media.nvm.nl/360x/168bee39-2aab-480f-8438-3bae532574bf?v=20250618T075001', 'https://media.nvm.nl/360x/f4f46f20-0862-4cb1-9bcb-ba53f638b435?v=20250618T075001', 'https://media.nvm.nl/360x/a3e50fdd-0653-45cd-991c-299bd1d7c956?v=20250618T075001', 'https://media.nvm.nl/360x/5ac7d4ba-8e5f-4dce-8074-1f0ab3683466?v=20250618T075001', 'https://media.nvm.nl/360x/6f66b1a7-29f8-43a7-a90c-1e6ee2cb7850?v=20250618T075001'], 'property_type': 'Apartment', 'rent': 8000, 'rental_period_id': 3, 'rooms': 6, 'street_name': 'Omval', 'zip_code_code': '1096 HV'} 2025-06-18 16:00:22 [scrapy.core.engine] INFO: Closing spider (finished) 2025-06-18 16:00:22 [crawler_utils.yaml_export_pipeline] INFO: Uploading /tmp/rental_nl/pri_nl_1750262417.yaml to /upload/rental_nl 2025-06-18 16:00:22 [crawler_utils.yaml_export_pipeline] INFO: FTP host: crawler-data.boligzonen.dk, user: ftpuser 2025-06-18 16:00:22 [paramiko.transport] DEBUG: starting thread (client mode): 0xe6fcba30 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Local version/idstring: SSH-2.0-paramiko_3.5.1 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Remote version/idstring: SSH-2.0-OpenSSH_9.6p1 Ubuntu-3ubuntu13.11 2025-06-18 16:00:22 [paramiko.transport] INFO: Connected (version 2.0, client OpenSSH_9.6p1) 2025-06-18 16:00:22 [paramiko.transport] DEBUG: === Key exchange possibilities === 2025-06-18 16:00:22 [paramiko.transport] DEBUG: kex algos: sntrup761x25519-sha512@openssh.com, curve25519-sha256, curve25519-sha256@libssh.org, ecdh-sha2-nistp256, ecdh-sha2-nistp384, ecdh-sha2-nistp521, diffie-hellman-group-exchange-sha256, diffie-hellman-group16-sha512, diffie-hellman-group18-sha512, diffie-hellman-group14-sha256, ext-info-s, kex-strict-s-v00@openssh.com 2025-06-18 16:00:22 [paramiko.transport] DEBUG: server key: rsa-sha2-512, rsa-sha2-256, ecdsa-sha2-nistp256, ssh-ed25519 2025-06-18 16:00:22 [paramiko.transport] DEBUG: client encrypt: chacha20-poly1305@openssh.com, aes128-ctr, aes192-ctr, aes256-ctr, aes128-gcm@openssh.com, aes256-gcm@openssh.com 2025-06-18 16:00:22 [paramiko.transport] DEBUG: server encrypt: chacha20-poly1305@openssh.com, aes128-ctr, aes192-ctr, aes256-ctr, aes128-gcm@openssh.com, aes256-gcm@openssh.com 2025-06-18 16:00:22 [paramiko.transport] DEBUG: client mac: umac-64-etm@openssh.com, umac-128-etm@openssh.com, hmac-sha2-256-etm@openssh.com, hmac-sha2-512-etm@openssh.com, hmac-sha1-etm@openssh.com, umac-64@openssh.com, umac-128@openssh.com, hmac-sha2-256, hmac-sha2-512, hmac-sha1 2025-06-18 16:00:22 [paramiko.transport] DEBUG: server mac: umac-64-etm@openssh.com, umac-128-etm@openssh.com, hmac-sha2-256-etm@openssh.com, hmac-sha2-512-etm@openssh.com, hmac-sha1-etm@openssh.com, umac-64@openssh.com, umac-128@openssh.com, hmac-sha2-256, hmac-sha2-512, hmac-sha1 2025-06-18 16:00:22 [paramiko.transport] DEBUG: client compress: none, zlib@openssh.com 2025-06-18 16:00:22 [paramiko.transport] DEBUG: server compress: none, zlib@openssh.com 2025-06-18 16:00:22 [paramiko.transport] DEBUG: client lang: 2025-06-18 16:00:22 [paramiko.transport] DEBUG: server lang: 2025-06-18 16:00:22 [paramiko.transport] DEBUG: kex follows: False 2025-06-18 16:00:22 [paramiko.transport] DEBUG: === Key exchange agreements === 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Strict kex mode: True 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Kex: curve25519-sha256@libssh.org 2025-06-18 16:00:22 [paramiko.transport] DEBUG: HostKey: ssh-ed25519 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Cipher: aes128-ctr 2025-06-18 16:00:22 [paramiko.transport] DEBUG: MAC: hmac-sha2-256 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Compression: none 2025-06-18 16:00:22 [paramiko.transport] DEBUG: === End of kex handshake === 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Resetting outbound seqno after NEWKEYS due to strict mode 2025-06-18 16:00:22 [paramiko.transport] DEBUG: kex engine KexCurve25519 specified hash_algo 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Switch to new keys ... 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Resetting inbound seqno after NEWKEYS due to strict mode 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Got EXT_INFO: {'server-sig-algs': b'ssh-ed25519,ecdsa-sha2-nistp256,ecdsa-sha2-nistp384,ecdsa-sha2-nistp521,sk-ssh-ed25519@openssh.com,sk-ecdsa-sha2-nistp256@openssh.com,rsa-sha2-512,rsa-sha2-256', 'publickey-hostbound@openssh.com': b'0', 'ping@openssh.com': b'0'} 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Attempting password auth... 2025-06-18 16:00:22 [paramiko.transport] DEBUG: userauth is OK 2025-06-18 16:00:22 [paramiko.transport] INFO: Authentication (password) successful! 2025-06-18 16:00:22 [paramiko.transport] DEBUG: [chan 0] Max packet in: 32768 bytes 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Received global request "hostkeys-00@openssh.com" 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Rejecting "hostkeys-00@openssh.com" global request from server. 2025-06-18 16:00:22 [paramiko.transport] DEBUG: [chan 0] Max packet out: 32768 bytes 2025-06-18 16:00:22 [paramiko.transport] DEBUG: Secsh channel 0 opened. 2025-06-18 16:00:22 [paramiko.transport] DEBUG: [chan 0] Sesch channel 0 request ok 2025-06-18 16:00:22 [paramiko.transport.sftp] INFO: [chan 0] Opened sftp connection (server version 3) 2025-06-18 16:00:22 [paramiko.transport.sftp] DEBUG: [chan 0] open(b'/upload/rental_nl/pri_nl_1750262417.yaml', 'wb') 2025-06-18 16:00:22 [paramiko.transport.sftp] DEBUG: [chan 0] open(b'/upload/rental_nl/pri_nl_1750262417.yaml', 'wb') -> 00000000 2025-06-18 16:00:22 [paramiko.transport.sftp] DEBUG: [chan 0] close(00000000) 2025-06-18 16:00:22 [paramiko.transport.sftp] DEBUG: [chan 0] stat(b'/upload/rental_nl/pri_nl_1750262417.yaml') 2025-06-18 16:00:22 [paramiko.transport.sftp] INFO: [chan 0] sftp session closed. 2025-06-18 16:00:22 [paramiko.transport] DEBUG: [chan 0] EOF sent (0) 2025-06-18 16:00:22 [crawler_utils.yaml_export_pipeline] INFO: Successfully uploaded /tmp/rental_nl/pri_nl_1750262417.yaml to upload/rental_nl 2025-06-18 16:00:22 [scrapy.statscollectors] INFO: Dumping Scrapy stats: {'downloader/request_bytes': 2607, 'downloader/request_count': 5, 'downloader/request_method_count/GET': 5, 'downloader/response_bytes': 104604, 'downloader/response_count': 5, 'downloader/response_status_count/200': 5, 'elapsed_time_seconds': 10.739447, 'finish_reason': 'finished', 'finish_time': datetime.datetime(2025, 6, 18, 16, 0, 22, 188953, tzinfo=datetime.timezone.utc), 'httpcache/firsthand': 5, 'httpcache/miss': 5, 'httpcache/uncacheable': 5, 'httpcompression/response_bytes': 613869, 'httpcompression/response_count': 5, 'item_scraped_count': 2, 'items_per_minute': 12.0, 'log_count/DEBUG': 52, 'log_count/INFO': 30, 'log_count/WARNING': 1, 'memusage/max': 96264192, 'memusage/startup': 96264192, 'proxies/good': 3, 'proxies/mean_backoff': 0.0, 'proxies/reanimated': 0, 'proxies/unchecked': 4, 'request_depth_max': 2, 'response_received_count': 5, 'responses_per_minute': 30.0, 'scheduler/dequeued': 5, 'scheduler/dequeued/memory': 5, 'scheduler/enqueued': 5, 'scheduler/enqueued/memory': 5, 'start_time': datetime.datetime(2025, 6, 18, 16, 0, 11, 449506, tzinfo=datetime.timezone.utc)} 2025-06-18 16:00:22 [scrapy.core.engine] INFO: Spider closed (finished) 2025-06-18 16:00:22 [paramiko.transport] DEBUG: EOF in transport thread