4.7.0

What's Changed

• chore(deps): bump uvicorn from 0.28.0 to 0.28.1 by @dependabot in #1692
• chore(deps-dev): bump pytest-asyncio from 0.23.5.post1 to 0.23.6 by @dependabot in #1693
• chore(deps-dev): bump types-python-dateutil from 2.9.0.20240315 to 2.9.0.20240316 by @dependabot in #1691
• chore(deps-dev): bump ruff from 0.3.3 to 0.3.4 by @dependabot in #1695
• chore(deps): bump uvicorn from 0.28.1 to 0.29.0 by @dependabot in #1694
• chore(deps): bump lxml from 5.1.0 to 5.2.1 by @dependabot in #1703
• chore(deps-dev): bump ruff from 0.3.4 to 0.3.5 by @dependabot in #1699
• chore(deps): bump aiodns from 3.1.1 to 3.2.0 by @dependabot in #1700
• chore(deps-dev): bump types-requests from 2.31.0.20240311 to 2.31.0.20240402 by @dependabot in #1702
• chore(deps): bump censys from 2.2.11 to 2.2.12 by @dependabot in #1697
• chore(deps): bump fastapi from 0.110.0 to 0.110.1 by @dependabot in #1704
• chore(deps): bump playwright from 1.42.0 to 1.43.0 by @dependabot in #1707
• chore(deps-dev): bump types-requests from 2.31.0.20240402 to 2.31.0.20240406 by @dependabot in #1706
• chore(deps-dev): bump ruff from 0.3.5 to 0.3.6 by @dependabot in #1708
• chore(deps): bump aiohttp from 3.9.3 to 3.9.4 by @dependabot in #1709
• chore(deps-dev): bump ruff from 0.3.6 to 0.3.7 by @dependabot in #1711
• chore(deps): bump setuptools from 69.2.0 to 69.4.0 by @dependabot in #1710
• chore(deps): bump aiohttp from 3.9.4 to 3.9.5 by @dependabot in #1713
• chore(deps-dev): bump ruff from 0.3.7 to 0.4.0 by @dependabot in #1714
• chore(deps-dev): bump ruff from 0.4.0 to 0.4.1 by @dependabot in #1715
• chore(deps): bump fastapi from 0.110.1 to 0.110.2 by @dependabot in #1716
• chore(deps): bump aiomultiprocess from 0.9.0 to 0.9.1 by @dependabot in #1717
• fix: create static directory when missing by @branchvincent in #1721
• chore(deps-dev): bump pytest from 8.1.1 to 8.2.0 by @dependabot in #1722
• chore(deps-dev): bump ruff from 0.4.1 to 0.4.2 by @dependabot in #1719
• chore(deps-dev): bump mypy from 1.9.0 to 1.10.0 by @dependabot in #1718
• chore(deps): bump fastapi from 0.110.2 to 0.111.0 by @dependabot in #1724
• chore(deps-dev): bump ruff from 0.4.2 to 0.4.4 by @dependabot in #1726
• chore(deps): bump ujson from 5.9.0 to 5.10.0 by @dependabot in #1730
• chore(deps): bump playwright from 1.43.0 to 1.44.0 by @dependabot in #1734
• chore(deps): bump requests from 2.31.0 to 2.32.0 by @dependabot in #1735
• chore(deps-dev): bump pytest from 8.2.0 to 8.2.1 by @dependabot in #1737
• chore(deps-dev): bump types-ujson from 5.9.0.0 to 5.10.0.20240515 by @dependabot in #1731
• chore(deps-dev): bump pyre-check from 0.9.19 to 0.9.21 by @dependabot in #1727
• chore(deps-dev): bump pytest-asyncio from 0.23.6 to 0.23.7 by @dependabot in #1736
• chore(deps): bump lxml from 5.2.1 to 5.2.2 by @dependabot in #1729
• chore(deps): bump requests from 2.32.0 to 2.32.2 by @dependabot in #1740
• chore(deps-dev): bump types-requests from 2.31.0.20240406 to 2.32.0.20240521 by @dependabot in #1741
• Bump ruff from 0.4.4 to 0.4.5 by @dependabot in #1743
• Bump types-requests from 2.32.0.20240521 to 2.32.0.20240523 by @dependabot in #1742
• Bump uvicorn from 0.29.0 to 0.30.0 by @dependabot in #1745
• Bump ruff from 0.4.5 to 0.4.6 by @dependabot in #1746
• Bump netaddr from 1.2.1 to 1.3.0 by @dependabot in #1747
• Bump requests from 2.32.2 to 2.32.3 by @dependabot in #1748
• Bump ruff from 0.4.6 to 0.4.7 by @dependabot in #1750
• Bump pytest from 8.2.1 to 8.2.2 by @dependabot in #1754
• Bump ruff from 0.4.7 to 0.4.8 by @dependabot in #1755
• Bump ruff from 0.4.8 to 0.4.9 by @dependabot in #1757
• fix: bump python version to 3.10 by @EliorFureraj in #1759
• Properly clean up apt footprint in Dockerfile by @PeterDaveHello in #1760
• Bump aiofiles from 23.2.1 to 24.1.0 by @dependabot in #1762
• Bump ruff from 0.4.9 to 0.5.0 by @dependabot in #1767
• Bump uvicorn from 0.30.0 to 0.30.1 by @dependabot in #1752
• Bump mypy from 1.10.0 to 1.10.1 by @dependabot in #1764
• Bump certifi from 2024.2.2 to 2024.6.2 by @dependabot in #1753
• Bump types-requests from 2.32.0.20240523 to 2.32.0.20240622 by @dependabot in #1763
• Bump pyre-check from 0.9.21 to 0.9.22 by @dependabot in #1765
• Bump playwright from 1.44.0 to 1.45.0 by @dependabot in #1768
• Bump ruff from 0.5.0 to 0.5.1 by @dependabot in #1771
• Bump fastapi from 0.111.0 to 0.111.1 by @dependabot in #1774
• Bump ruff from 0.5.1 to 0.5.2 by @dependabot in #1775
• Bump certifi from 2024.6.2 to 2024.7.4 by @dependabot in #1770
• Bump ruff from 0.5.2 to 0.5.3 by @dependabot in #1777
• Bump pytest-asyncio from 0.23.7 to 0.23.8 by @dependabot in #1776
• Bump mypy from 1.10.1 to 1.11.0 by @dependabot in #1779
• Bump types-requests from 2.32.0.20240622 to 2.32.0.20240712 by @dependabot in #1773
• Bump uvicorn from 0.30.1 to 0.30.3 by @dependabot in #1782
• Bump pytest from 8.2.2 to 8.3.1 by @dependabot in #1781
• Bump ruff from 0.5.3 to 0.5.4 by @dependabot in #1783
• Bump playwright from 1.45.0 to 1.45.1 by @dependabot in #1785
• Bump ruff from 0.5.4 to 0.5.6 by @dependabot in #1797
• Bump fastapi from 0.111.1 to 0.112.0 by @dependabot in #1796
• Bump uvicorn from 0.30.3 to 0.30.5 by @dependabot in #1795
• Bump censys from 2.2.12 to 2.2.13 by @dependabot in #1792
• Bump aiohttp from 3.9.5 to 3.10.0 by @dependabot in #1789
• Bump aiohttp from 3.10.0 to 3.10.1 by @dependabot in #1798
• Bump wheel from 0.43.0 to 0.44.0 by @dependabot in #1799
• Bump pyyaml from 6.0.1 to 6.0.2 by @dependabot in #1800
• Bump mypy from 1.11.0 to 1.11.1 by @dependabot in #1793
• Bump types-pyyaml from 6.0.12.20240311 to 6.0.12.20240724 by @dependabot in #1786
• Bump pytest from 8.3.1 to 8.3.2 by @dependabot in #1788
• Add Winloop to the Harvester as a performance enhancement by @Vizonex in #1766
• Bump winloop from 0.1.4 to 0.1.6 by @dependabot in #1801
• Bump aiohttp from 3.10.1 to 3.10.2 by @dependabot in #1802
• Bump types-pyyaml from 6.0.12.20240724 to 6.0.12.20240808 by @dependabot in #1803
• Bump ruff from 0.5.6 to 0.5.7 by @dependabot in #1804
• Bump aiohttp from 3.10.2 to 3.10.3 by @dependabot in #1806
• Bump playwright from 1.45.1 to 1.46.0 by @dependabot in #1807
• Bump lxml from 5.2.2 to 5.3.0 by @dependabot in #1808
• Bump ruff from 0.5.7 to 0.6.0 by @dependabot in #1810
• Bump uvloop from 0.19.0 to 0.20.0 by @dependabot in #1811
• Bump uvicorn from 0.30.5 to 0.30.6 by @dependabot in #1809
• Bump ruff from 0.6.0 to 0.6.1 by @dependabot in #1813
• Bump fastapi from 0.112.0 to 0.112.1 by @dependabot in #1812
• Bump aiohttp from 3.10.3 to 3.10.5 by @dependabot in #1814
• Bump fastapi from 0.112.1 to 0.112.2 by @dependabot in #1818
• Bump ruff from 0.6.1 to 0.6.2 by @dependabot in #1817
• Bump pytest-asyncio from 0.23.8 to 0.24.0 by @dependabot in #1816
• Bump mypy from 1.11.1 to 1.11.2 by @dependabot in #1819
• Bump types-python-dateutil from 2.9.0.20240316 to 2.9.0.20240821 by @dependabot in #1815
• Bump ruff from 0.6.2 to 0.6.3 by @dependabot in #1820
• Bump fastapi from 0.112.2 to 0.113.0 by @dependabot in #1822
• Bump ruff from 0.6.3 to 0.6.4 by @dependabot in #1823
• Bump fastapi from 0.113.0 to 0.114.1 by @dependabot in #1830
• Bump pytest from 8.3.2 to 8.3.3 by @dependabot in #1829
• Bump types-requests from 2.32.0.20240712 to 2.32.0.20240907 by @dependabot in #1827
• Bump censys from 2.2.13 to 2.2.14 by @dependabot in #1828
• Bump types-python-dateutil from 2.9.0.20240821 to 2.9.0.20240906 by @dependabot in #1826
• Bump certifi from 2024.7.4 to 2024.8.30 by @dependabot in #1821
• Bump ruff from 0.6.4 to 0.6.5 by @dependabot in #1833
• Bump playwright from 1.46.0 to 1.47.0 by @dependabot in #1831
• Bump fastapi from 0.114.1 to 0.114.2 by @dependabot in #1832
• Bump ruff from 0.6.5 to 0.6.7 by @dependabot in #1838
• Bump aiohttp from 3.10.5 to 3.10.6 by @dependabot in #1839
• Bump ruff from 0.6.7 to 0.6.8 by @dependabot in #1841
• Bump fastapi from 0.114.2 to 0.115.0 by @dependabot in #1835
• Bump types-pyyaml from 6.0.12.20240808 to 6.0.12.20240917 by @dependabot in #1836
• Bump types-requests from 2.32.0.20240907 to 2.32.0.20240914 by @dependabot in #1834
• Bump uvicorn from 0.30.6 to 0.31.0 by @dependabot in #1842
• Bump aiohttp from 3.10.6 to 3.10.8 by @dependabot in #1843
• Bump dnspython from 2.6.1 to 2.7.0 by @dependabot in #1847
• Bump fastapi from 0.115.0 to 0.115.2 by @dependabot in #1850
• Bump uvicorn from 0.31.0 to 0.32.0 by @dependabot in #1852
• Bump mypy from 1.11.2 to 1.12.0 by @dependabot in #1851
• Bump ruff from 0.6.8 to 0.6.9 by @dependabot in #1845
• Bump aiohttp from 3.10.8 to 3.10.10 by @dependabot in #1849
• Bump types-python-dateutil from 2.9.0.20240906 to 2.9.0.20241003 by @dependabot in #1844
• Bump uvloop from 0.20.0 to 0.21.0 by @dependabot in #1853
• Bump ruff from 0.6.9 to 0.7.0 by @dependabot in #1856
• Bump censys from 2.2.14 to 2.2.15 by @dependabot in #1855
• Bump types-requests from 2.32.0.20240914 to 2.32.0.20241016 by @dependabot in #1854
• Bump playwright from 1.47.0 to 1.48.0 by @dependabot in #1860
• Bump mypy from 1.12.0 to 1.12.1 by @dependabot in #1858
• Bump censys from 2.2.15 to 2.2.16 by @dependabot in #1859
• Bump fastapi from 0.115.2 to 0.115.3 by @dependabot in #1861
• Bump mypy from 1.12.1 to 1.13.0 by @dependabot in #1863
• Bump ruff from 0.7.0 to 0.7.1 by @dependabot in #1864
• Bump fastapi from 0.115.3 to 0.115.4 by @dependabot in #1866
• Bump ruff from 0.7.1 to 0.7.2 by @dependabot in #1867
• Bump ruff from 0.7.2 to 0.7.3 by @dependabot in #1868
• Bump ruff from 0.7.3 to 0.7.4 by @dependabot in #1876
• Bump fastapi from 0.115.4 to 0.115.5 by @dependabot in #1872
• Bump aiohttp from 3.10.10 to 3.11.2 by @dependabot in #1875
• Bump wheel from 0.44.0 to 0.45.0 by @dependabot in #1869
• Bump aiohttp from 3.11.2 to 3.11.6 by @dependabot in #1881
• Bump playwright from 1.48.0 to 1.49.0 by @dependabot in #1885
• Bump ruff from 0.7.4 to 0.8.0 by @dependabot in #1884
• Bump aiohttp from 3.11.6 to 3.11.7 by @dependabot in #1883
• Bump uvicorn from 0.32.0 to 0.32.1 by @dependabot in #1882
• Bump aiohttp from 3.11.7 to 3.11.10 by @dependabot in #1895
• Bump fastapi from 0.115.5 to 0.115.6 by @dependabot in #1894
• Bump types-python-dateutil from 2.9.0.20241003 to 2.9.0.20241206 by @dependabot in #1896
• Bump pytest from 8.3.3 to 8.3.4 by @dependabot in #1892
• Bump winloop from 0.1.6 to 0.1.7 by @dependabot in #1890
• Bump wheel from 0.45.0 to 0.45.1 by @dependabot in #1888
• Add GitHub Actions workflow for building and pushing Docker image by @ozeliurs in #1893
• Bump docker/build-push-action from 5 to 6 by @dependabot in #1897
• Bump playwright from 1.49.0 to 1.49.1 by @dependabot in #1899
• Bump pytest-asyncio from 0.24.0 to 0.25.0 by @dependabot in #1901
• Change: methods of searching subdomains in SearchNetlas by @thurrsense in #1900
• Bump uvicorn from 0.32.1 to 0.34.0 by @dependabot in #1903
• Bump aiohttp from 3.11.10 to 3.11.11 by @dependabot in #1905
• Bump certifi from 2024.8.30 to 2024.12.14 by @dependabot in #1904
• Bump types-pyyaml from 6.0.12.20240917 to 6.0.12.20241221 by @dependabot in #1908
• Bump pytest-asyncio from 0.25.0 to 0.25.2 by @dependabot in #1913
• Bump fastapi from 0.115.6 to 0.115.7 by @dependabot in #1916
• Bump winloop from 0.1.7 to 0.1.8 by @dependabot in #1914
• Bump types-pyyaml from 6.0.12.20241221 to 6.0.12.20241230 by @dependabot in #1909
• Bump mypy from 1.13.0 to 1.14.1 by @dependabot in #1910
• Bump ruff from 0.9.3 to 0.9.10 by @dependabot in #1940
• Bump fastapi from 0.115.7 to 0.115.11 by @dependabot in #1938
• Bump playwright from 1.49.1 to 1.50.0 by @dependabot in #1924
• Bump aiohttp from 3.11.11 to 3.11.13 by @dependabot in #1933
• Bump certifi from 2024.12.14 to 2025.1.31 by @dependabot in #1921
• Bump pytest-asyncio from 0.25.2 to 0.25.3 by @dependabot in #1918
• Bump beautifulsoup4 from 4.12.3 to 4.13.3 by @dependabot in #1925
• Bump mypy from 1.14.1 to 1.15.0 by @dependabot in #1926
• Bump lxml from 5.3.0 to 5.3.1 by @dependabot in #1930
• Print which engines aren't supported if unsupported engine is provided by @perfectra1n in #1939
• Bump aiosqlite from 0.20.0 to 0.21.0 by @dependabot in #1923

New Contributors

• @EliorFureraj made their first contribution in #1759
• @PeterDaveHello made their first contribution in #1760
• @Vizonex made their first contribution in #1766
• @ozeliurs made their first contribution in #1893
• @thurrsense made their first contribution in #1900
• @perfectra1n made their first contribution in #1939

Full Changelog: 4.6.0...4.7.0