[WIP] 2023 updates

.editorconfig

@@ -0,0 +1,17 @@
+# EditorConfig is awesome: http://EditorConfig.org
+
+# top-most EditorConfig file
+root = true
+
+# Tab indentation
+[*]
+indent_style = space
+indent_size = 4
+trim_trailing_whitespace = true
+insert_final_newline = true
+
+# The indent size used in the `package.json` file cannot be changed
+# https://github.com/npm/npm/pull/3180#issuecomment-16336516
+[{.travis.yml,npm-shrinkwrap.json,package.json}]
+indent_style = space
+indent_size = 4

.gitignore

@@ -1,3 +1,4 @@
+data
 .idea/
 *.pyc
 *.swp
@@ -11,4 +12,7 @@
 *.jpg
 *.xlsx
 .ipynb_checkpoints
-lv/__pycache__/
+__pycache__
+cache
+*.zip
+scrapy_fs/responses

README.md

@@ -1,19 +1,13 @@
-FarmSubsidy.org Scrapers
-========================
+# FarmSubsidy.org Scrapers
 
-[FarmSubsidy](http://farmsubsidy.openspending.org/) is a website that collects the payment data of the Common Agriculture Policy (CAP) which represents about a third of the EU budget. It was run by a group of journalists and activists for the past years. In 2013 the [OpenSpending project](http://openspending.org/) of the [Open Knowledge Foundation](http://okfn.org/) took over responsibility of the website.
+[FarmSubsidy](https://farmsubsidy.org) is a platform that collects payment data related to the EU’s Common Agricultural Policy (CAP), which accounts for approximately one-third of the EU budget. This repository focuses on the initial data collection phase, often using web scraping. However, many EU member states now offer bulk data downloads, reducing the need for scraping.
 
-The FarmSubsidy data is mostly scraped from member state websites. The old scrapers were working well, but were running in costly and proprietary software. This year we need Free and Open Source scrapers and this repository will collect these scrapers and coordinate the effort.
+## Related Farm Subsidy repositories
 
-Please have a look at the [member state scraper issues](https://github.com/openspending/farmsubsidy-scrapers/issues?labels=memberstate&page=1&state=open). If you can help provide a scraper that would be awesome.
+-   Backend & cleaning: <https://github.com/okfde/farmsubsidy-store>
+-   Website: <https://github.com/simonwoerpel/farmsubsidy.org-next>
 
+## Resources
 
-Developer Documentation
------------------------
-
-Developer documentation for both website and scrapers can be found at http://farmsubsidy.readthedocs.org.
-
-[Member states data sites](http://ec.europa.eu/agriculture/cap-funding/beneficiaries/shared/index_en.htm)
-
-
-[Financial Reports](http://ec.europa.eu/agriculture/cap-funding/financial-reports/index_en.htm)
+-   **[Member States Data Sites](https://agriculture.ec.europa.eu/common-agricultural-policy/financing-cap/beneficiaries_en):** Links to member states’ CAP payment data portals.
+-   **[Financial Reports](http://ec.europa.eu/agriculture/cap-funding/financial-reports/index_en.htm):** Summary reports on CAP funding and expenditures.