EljakimHerrewijnen/usse
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity

Update

Browse Source
This commit is contained in:
Eljakim Herrewijnen 2023-12-27 23:18:06 +01:00
parent cde64f6294
commit b502ce3e58
1 changed files with 15 additions and 3 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

18
scrape/Readme.md
View File

@ -1,12 +1,24 @@
# Scrape Usse # Scrape Usse
Funda scraper that automatically calculates the distance to several points in the Netherlands. Project relies heavily on a slightly modified version of the funda-scraper that is available on github. Funda scraper that automatically calculates the distance to several points in the Netherlands. Project relies heavily on a slightly modified version of the funda-scraper that is available on github.
## Install
Create a virtual env and install the dependencies
```bash
python3 -m venv venv/
source venv/bin/activate
pip3 install -r requirements.txt
```
Also lxml is required for beautifullsoup to run:
```bash
sudo apt-get install python3-lxml
```
## Usage ## Usage
Update the ``URL`` parameter to use your filtered url from Funda. Update the ``URL`` parameter to use your filtered url from Funda.
```python ```python
URL = "https://www.funda.nl/zoeken/koop?selected_area=%5B%22utrecht,15km%22%5D&price=%22-400000%22&object_type=%5B%22house%22%5D" URL = "https://www.funda.nl/zoeken/koop?selected_area=%5B%22utrecht,15km%22%5D&price=%22-400000%22&object_type=%5B%22house%22%5D"
``` ```
Next you should be able to scrape the data from funda. See the RTD for more docs on how to setup OSRM and use the results. Next you should be able to scrape the data from funda. See the RTD for more docs on how to setup OSRM and use the results.