4.10.0

[4.10.0] - 2026-01-18

Packaging changes

As part of adding socks proxy support we now use aiohttp-socks so for deb maintainers this package is required now
https://packages.debian.org/sid/python3-aiohttp-socks

Added

• LeakIX API key support and improved request header configuration (31861c19).
• Bitbucket API key entry in theHarvester/data/api-keys.yaml (6be673fa).
• Fix issue #469 Add socks proxy support (e38bb8fb).

Changed

• CI: switch GitHub workflow to ruff-action for linting and formatting (8ddcd1a8).
• Dockerfile: add apt-get update/upgrade and clean up apt cache layers (3a5d504b).
• Dependencies updated: bump aiodns, ruff, ty, filelock, and librt (40759146).
• Codebase formatting and lint fixes applied (Ruff) (7c6dec53).
• Tests: expand proxy parameter default structure to include both http and socks5 fields (bc2fce07).
• api-keys.yaml synchronized with Core API key references; add consistency test coverage (ffe1f3a8).

Removed

• Core.bing_key() removed (814c7811).

Fixed

• Fix mypy type-checking errors (0991356b).

Security

• Improve input sanitization and add security-focused tests (3d7489c9).

4.9.2

What's Changed

• feat(discovery): add THC subdomain enumeration module by @686f6c61 in #2221

New Contributors

• @686f6c61 made their first contribution in #2221

Full Changelog: 4.9.1...4.9.2

4.9.1

What's Changed

• Bump astral-sh/setup-uv from 5 to 7 by @dependabot[bot] in #2218
• support python 3.14 by @branchv in #2220

Full Changelog: 4.9.0...4.9.1

4.9.0

What's Changed

• Updated README.md with uv info by @leebaird in #2077
• Updated README.md by @leebaird in #2078
• Bump playwright from 1.53.0 to 1.54.0 by @dependabot[bot] in #2079
• Bump retrying from 1.4.0 to 1.4.1 by @dependabot[bot] in #2080
• Bump censys from 2.2.17 to 2.2.18 by @dependabot[bot] in #2082
• Bump ruff from 0.12.4 to 0.12.5 by @dependabot[bot] in #2083
• Bump winloop from 0.1.91 to 0.2.0 by @dependabot[bot] in #2084
• Bump aiohttp from 3.12.14 to 3.12.15 by @dependabot[bot] in #2088
• Bump ruff from 0.12.5 to 0.12.7 by @dependabot[bot] in #2094
• Bump mypy from 1.17.0 to 1.17.1 by @dependabot[bot] in #2095
• Bump winloop from 0.2.0 to 0.2.1 by @dependabot[bot] in #2089
• Add Hudson Rock and bugs fixed. by @ibrahmsql in #2096
• Updated README, removed bing, and shodan. by @leebaird in #2081
• Bump certifi from 2025.7.14 to 2025.8.3 by @dependabot[bot] in #2098
• Bump retrying from 1.4.1 to 1.4.2 by @dependabot[bot] in #2099
• Bump ruff from 0.12.7 to 0.12.8 by @dependabot[bot] in #2100
• Updated README to match modules. by @leebaird in #2101
• Bump actions/checkout from 4 to 5 by @dependabot[bot] in #2106
• Bump types-python-dateutil from 2.9.0.20250708 to 2.9.0.20250809 by @dependabot[bot] in #2105
• Bump winloop from 0.2.1 to 0.2.2 by @dependabot[bot] in #2107
• Bump types-requests from 2.32.4.20250611 to 2.32.4.20250809 by @dependabot[bot] in #2104
• Bump ruff from 0.12.8 to 0.12.9 by @dependabot[bot] in #2110
• brave by @ibrahmsql in #2109
• Bump playwright from 1.54.0 to 1.55.0 by @dependabot[bot] in #2119
• Bump lxml from 6.0.0 to 6.0.1 by @dependabot[bot] in #2116
• Bump ruff from 0.12.9 to 0.12.11 by @dependabot[bot] in #2118
• Bump beautifulsoup4 from 4.13.4 to 4.13.5 by @dependabot[bot] in #2117
• Bump ujson from 5.10.0 to 5.11.0 by @dependabot[bot] in #2112
• Bump types-ujson from 5.10.0.20250326 to 5.10.0.20250822 by @dependabot[bot] in #2114
• Bump types-python-dateutil from 2.9.0.20250809 to 2.9.0.20250822 by @dependabot[bot] in #2115
• Bump requests from 2.32.4 to 2.32.5 by @dependabot[bot] in #2111
• Fix: Container Running as Root User Instead of Safer Account in Dockerfile by @kira-offgrid in #2121
• Bump actions/setup-python from 5 to 6 by @dependabot[bot] in #2123
• Bump ruff from 0.12.11 to 0.12.12 by @dependabot[bot] in #2125
• Bump dnspython from 2.7.0 to 2.8.0 by @dependabot[bot] in #2126
• Bump pytest from 8.4.1 to 8.4.2 by @dependabot[bot] in #2124
• Replace except Exceptions with proper error handeling by @Rafaelorr in #2120
• Bump ruff from 0.12.12 to 0.13.0 by @dependabot[bot] in #2127
• Bump mypy from 1.17.1 to 1.18.1 by @dependabot[bot] in #2130
• Bump pytest-asyncio from 1.1.0 to 1.2.0 by @dependabot[bot] in #2129
• Bump fastapi from 0.116.1 to 0.116.2 by @dependabot[bot] in #2132
• Bump ruff from 0.13.0 to 0.13.1 by @dependabot[bot] in #2133
• Bump mypy from 1.18.1 to 1.18.2 by @dependabot[bot] in #2134
• removed api_endpoints from lib/core.py by @sebr-dev in #2138
• Bump fastapi from 0.116.2 to 0.117.1 by @dependabot[bot] in #2135
• Add 10 new discovery modules addressing issues #2103 and #2128 by @ibrahmsql in #2131
• Bump uvicorn from 0.35.0 to 0.36.0 by @dependabot[bot] in #2137
• Bump ruff from 0.13.1 to 0.13.2 by @dependabot[bot] in #2140
• Bump uvicorn from 0.36.0 to 0.37.0 by @dependabot[bot] in #2139
• Bump github/codeql-action from 3 to 4 by @dependabot[bot] in #2149
• Bump ruff from 0.13.2 to 0.14.0 by @dependabot[bot] in #2150
• Bump fastapi from 0.117.1 to 0.118.0 by @dependabot[bot] in #2143
• Bump winloop from 0.2.2 to 0.2.3 by @dependabot[bot] in #2145
• Bump beautifulsoup4 from 4.13.5 to 4.14.2 by @dependabot[bot] in #2141
• Bump aiohttp from 3.12.15 to 3.13.0 by @dependabot[bot] in #2147
• Bump certifi from 2025.8.3 to 2025.10.5 by @dependabot[bot] in #2148
• Bump lxml from 6.0.1 to 6.0.2 by @dependabot[bot] in #2136
• Bump fastapi from 0.118.0 to 0.118.3 by @dependabot[bot] in #2155
• Bump aiofiles from 24.1.0 to 25.1.0 by @dependabot[bot] in #2154
• Bump types-python-dateutil from 2.9.0.20250822 to 2.9.0.20251008 by @dependabot[bot] in #2152
• Bump ruff from 0.14.0 to 0.14.1 by @dependabot[bot] in #2161
• Bump uvloop from 0.21.0 to 0.22.1 by @dependabot[bot] in #2163
• Bump aiohttp from 3.13.0 to 3.13.1 by @dependabot[bot] in #2162
• Bump fastapi from 0.118.3 to 0.119.0 by @dependabot[bot] in #2158
• Bump winloop from 0.2.3 to 0.3.0 by @dependabot[bot] in #2159
• Bump fastapi from 0.119.0 to 0.120.1 by @dependabot[bot] in #2169
• Bump ruff from 0.14.1 to 0.14.2 by @dependabot[bot] in #2167
• Bump uvicorn from 0.37.0 to 0.38.0 by @dependabot[bot] in #2165
• Bump aiohttp from 3.13.1 to 3.13.2 by @dependabot[bot] in #2171
• fixing spelling of occurred by @digininja in #2176
• Bump fastapi from 0.120.1 to 0.121.0 by @dependabot[bot] in #2177
• Bump ruff from 0.14.2 to 0.14.3 by @dependabot[bot] in #2175
• Bump actions/checkout from 5 to 6 by @dependabot[bot] in #2191
• Bump fastapi from 0.121.0 to 0.121.3 by @dependabot[bot] in #2190
• Bump ruff from 0.14.3 to 0.14.5 by @dependabot[bot] in #2186
• Bump playwright from 1.55.0 to 1.56.0 by @dependabot[bot] in #2183
• Bump pytest-asyncio from 1.2.0 to 1.3.0 by @dependabot[bot] in #2181
• Bump certifi from 2025.10.5 to 2025.11.12 by @dependabot[bot] in #2185
• Bump pytest from 8.4.2 to 9.0.1 by @dependabot[bot] in #2184
• Bump types-python-dateutil from 2.9.0.20251008 to 2.9.0.20251115 by @dependabot[bot] in #2188
• bitbucket added by @MatthewL-UF in #2160
• Bump fastapi from 0.121.3 to 0.123.5 by @dependabot[bot] in #2198
• Bump ruff from 0.14.5 to 0.14.7 by @dependabot[bot] in #2195
• Bump beautifulsoup4 from 4.14.2 to 4.14.3 by @dependabot[bot] in #2196
• Bump mypy from 1.18.2 to 1.19.0 by @dependabot[bot] in #2194
• Bump aiodns from 3.5.0 to 3.6.0 by @dependabot[bot] in #2201
• Bump fastapi from 0.123.5 to 0.123.10 by @dependabot[bot] in #2203
• Bump ruff from 0.14.7 to 0.14.8 by @dependabot[bot] in #2199
• Bump wi...

4.8.2

What's Changed

• Fix Shodan by @ibrahmsql in #2069

Dependency Updates

• Bump types-python-dateutil from 2.9.0.20250516 to 2.9.0.20250708 by @dependabot[bot] in #2064
• Bump aiohttp from 3.12.13 to 3.12.14 by @dependabot[bot] in #2066
• Bump certifi from 2025.6.15 to 2025.7.9 by @dependabot[bot] in #2065
• Bump fastapi from 0.116.0 to 0.116.1 by @dependabot[bot] in #2067
• Bump ruff from 0.12.2 to 0.12.3 by @dependabot[bot] in #2068
• Bump pytest-asyncio from 1.0.0 to 1.1.0 by @dependabot[bot] in #2073
• Bump mypy from 1.16.1 to 1.17.0 by @dependabot[bot] in #2070
• Bump certifi from 2025.7.9 to 2025.7.14 by @dependabot[bot] in #2071
• Bump ruff from 0.12.3 to 0.12.4 by @dependabot[bot] in #2076
• Bump winloop from 0.1.8 to 0.1.91 by @dependabot[bot] in #2075

Full Changelog: 4.8.1...4.8.2

4.8.1

API

theHarvester restAPI has had big updates and fixes driven by @digininja so thank you on bringing issues to my attention :-)

What's Changed

L1ghtn1ng - Fix #2061
L1ghtn1ng - Fix #2012
L1ghtn1ng - Fix #1999
Lee Baird - Fix #2062
L1ghtn1ng - fix CI workflow to push changes to correct branch on push event
L1ghtn1ng - Fix #2053
L1ghtn1ng - Fix #2055
yiğit ibrahim - docker build error fix (#2047)
L1ghtn1ng - fix #1870
L1ghtn1ng - fix #1927
L1ghtn1ng - Add auto-commit step for ruff fixes in CI workflow
Anis Mekacher - Added venacus data leak search engine plugin. (#1968)

Misc

Dependency updates

New Contributors

• @ibrahmsql made their first contribution in #2047

Full Changelog: 4.8.0...4.8.1

4.8.0

What's Changed

• Add Command Line Arguments to Exported File by @dimeko in #1984
• Update Dockerfile by @noarche in #1976
• Added a module Dehashed by @p3test in #1990
• Added a module for searching subdomains via the dnsdumpster service API by @p3test in #1998
• theHarvester Enhancements and New Features by @ibrahimsql in #1995
• Fix #1927
• Add new quiet flag which takes care of #1870

and a load of dependency updates, with also moving fully to using pyproject.toml for dependency management. MVP goes to @ibrahimsql for the features(modules) and enhancements in #1995

New Contributors

• @dimeko made their first contribution in #1984
• @noarche made their first contribution in #1976
• @p3test made their first contribution in #1990
• @ibrahimsql made their first contribution in #1995

Full Changelog: 4.7.1...4.8.0

4.7.1

What's Changed

• Added whoisxml subdomain discovery with API module, refreshed user agents list, and allowed for support of python3.10+. by @NotoriousRebel in #1955
• Added WhoisXML info. by @leebaird in #1960
• Added venacus data leak search engine plugin. by @Mekacher-Anis in #1968
• Dependency updates

New Contributors

• @Mekacher-Anis made their first contribution in #1968

Full Changelog: 4.7.0...4.7.1

4.7.0

What's Changed

• chore(deps): bump uvicorn from 0.28.0 to 0.28.1 by @dependabot in #1692
• chore(deps-dev): bump pytest-asyncio from 0.23.5.post1 to 0.23.6 by @dependabot in #1693
• chore(deps-dev): bump types-python-dateutil from 2.9.0.20240315 to 2.9.0.20240316 by @dependabot in #1691
• chore(deps-dev): bump ruff from 0.3.3 to 0.3.4 by @dependabot in #1695
• chore(deps): bump uvicorn from 0.28.1 to 0.29.0 by @dependabot in #1694
• chore(deps): bump lxml from 5.1.0 to 5.2.1 by @dependabot in #1703
• chore(deps-dev): bump ruff from 0.3.4 to 0.3.5 by @dependabot in #1699
• chore(deps): bump aiodns from 3.1.1 to 3.2.0 by @dependabot in #1700
• chore(deps-dev): bump types-requests from 2.31.0.20240311 to 2.31.0.20240402 by @dependabot in #1702
• chore(deps): bump censys from 2.2.11 to 2.2.12 by @dependabot in #1697
• chore(deps): bump fastapi from 0.110.0 to 0.110.1 by @dependabot in #1704
• chore(deps): bump playwright from 1.42.0 to 1.43.0 by @dependabot in #1707
• chore(deps-dev): bump types-requests from 2.31.0.20240402 to 2.31.0.20240406 by @dependabot in #1706
• chore(deps-dev): bump ruff from 0.3.5 to 0.3.6 by @dependabot in #1708
• chore(deps): bump aiohttp from 3.9.3 to 3.9.4 by @dependabot in #1709
• chore(deps-dev): bump ruff from 0.3.6 to 0.3.7 by @dependabot in #1711
• chore(deps): bump setuptools from 69.2.0 to 69.4.0 by @dependabot in #1710
• chore(deps): bump aiohttp from 3.9.4 to 3.9.5 by @dependabot in #1713
• chore(deps-dev): bump ruff from 0.3.7 to 0.4.0 by @dependabot in #1714
• chore(deps-dev): bump ruff from 0.4.0 to 0.4.1 by @dependabot in #1715
• chore(deps): bump fastapi from 0.110.1 to 0.110.2 by @dependabot in #1716
• chore(deps): bump aiomultiprocess from 0.9.0 to 0.9.1 by @dependabot in #1717
• fix: create static directory when missing by @branchvincent in #1721
• chore(deps-dev): bump pytest from 8.1.1 to 8.2.0 by @dependabot in #1722
• chore(deps-dev): bump ruff from 0.4.1 to 0.4.2 by @dependabot in #1719
• chore(deps-dev): bump mypy from 1.9.0 to 1.10.0 by @dependabot in #1718
• chore(deps): bump fastapi from 0.110.2 to 0.111.0 by @dependabot in #1724
• chore(deps-dev): bump ruff from 0.4.2 to 0.4.4 by @dependabot in #1726
• chore(deps): bump ujson from 5.9.0 to 5.10.0 by @dependabot in #1730
• chore(deps): bump playwright from 1.43.0 to 1.44.0 by @dependabot in #1734
• chore(deps): bump requests from 2.31.0 to 2.32.0 by @dependabot in #1735
• chore(deps-dev): bump pytest from 8.2.0 to 8.2.1 by @dependabot in #1737
• chore(deps-dev): bump types-ujson from 5.9.0.0 to 5.10.0.20240515 by @dependabot in #1731
• chore(deps-dev): bump pyre-check from 0.9.19 to 0.9.21 by @dependabot in #1727
• chore(deps-dev): bump pytest-asyncio from 0.23.6 to 0.23.7 by @dependabot in #1736
• chore(deps): bump lxml from 5.2.1 to 5.2.2 by @dependabot in #1729
• chore(deps): bump requests from 2.32.0 to 2.32.2 by @dependabot in #1740
• chore(deps-dev): bump types-requests from 2.31.0.20240406 to 2.32.0.20240521 by @dependabot in #1741
• Bump ruff from 0.4.4 to 0.4.5 by @dependabot in #1743
• Bump types-requests from 2.32.0.20240521 to 2.32.0.20240523 by @dependabot in #1742
• Bump uvicorn from 0.29.0 to 0.30.0 by @dependabot in #1745
• Bump ruff from 0.4.5 to 0.4.6 by @dependabot in #1746
• Bump netaddr from 1.2.1 to 1.3.0 by @dependabot in #1747
• Bump requests from 2.32.2 to 2.32.3 by @dependabot in #1748
• Bump ruff from 0.4.6 to 0.4.7 by @dependabot in #1750
• Bump pytest from 8.2.1 to 8.2.2 by @dependabot in #1754
• Bump ruff from 0.4.7 to 0.4.8 by @dependabot in #1755
• Bump ruff from 0.4.8 to 0.4.9 by @dependabot in #1757
• fix: bump python version to 3.10 by @EliorFureraj in #1759
• Properly clean up apt footprint in Dockerfile by @PeterDaveHello in #1760
• Bump aiofiles from 23.2.1 to 24.1.0 by @dependabot in #1762
• Bump ruff from 0.4.9 to 0.5.0 by @dependabot in #1767
• Bump uvicorn from 0.30.0 to 0.30.1 by @dependabot in #1752
• Bump mypy from 1.10.0 to 1.10.1 by @dependabot in #1764
• Bump certifi from 2024.2.2 to 2024.6.2 by @dependabot in #1753
• Bump types-requests from 2.32.0.20240523 to 2.32.0.20240622 by @dependabot in #1763
• Bump pyre-check from 0.9.21 to 0.9.22 by @dependabot in #1765
• Bump playwright from 1.44.0 to 1.45.0 by @dependabot in #1768
• Bump ruff from 0.5.0 to 0.5.1 by @dependabot in #1771
• Bump fastapi from 0.111.0 to 0.111.1 by @dependabot in #1774
• Bump ruff from 0.5.1 to 0.5.2 by @dependabot in #1775
• Bump certifi from 2024.6.2 to 2024.7.4 by @dependabot in #1770
• Bump ruff from 0.5.2 to 0.5.3 by @dependabot in #1777
• Bump pytest-asyncio from 0.23.7 to 0.23.8 by @dependabot in #1776
• Bump mypy from 1.10.1 to 1.11.0 by @dependabot in #1779
• Bump types-requests from 2.32.0.20240622 to 2.32.0.20240712 by @dependabot in #1773
• Bump uvicorn from 0.30.1 to 0.30.3 by @dependabot in #1782
• Bump pytest from 8.2.2 to 8.3.1 by @dependabot in #1781
• Bump ruff from 0.5.3 to 0.5.4 by @dependabot in #1783
• Bump playwright from 1.45.0 to 1.45.1 by @dependabot in #1785
• Bump ruff from 0.5.4 to 0.5.6 by @dependabot in #1797
• Bump fastapi from 0.111.1 to 0.112.0 by @dependabot in #1796
• Bump uvicorn from 0.30.3 to 0.30.5 by @dependabot in #1795
• Bump censys from 2.2.12 to 2.2.13 by @dependabot in #1792
• Bump aiohttp from 3.9.5 to 3.10.0 by @dependabot in #1789
• Bump aiohttp from 3.10.0 to 3.10.1 by @dependabot in #1798
• Bump wheel from 0.43.0 to 0.44.0 by @dependabot in #1799
• Bump pyyaml from 6.0.1 to 6.0.2 by @dependabot in #1800
• Bump mypy from 1.11.0 to 1.11.1 by @dependabot in #1793
• Bump types-pyyaml from 6.0.12.20240311 to 6.0.12.20240724 by @dependabot in #1786
• Bump pytest from 8.3.1 to 8.3.2 by @dependabot in #1788
• Add Winloop to the Harvester as a performance enhancement by @Vizonex in #1766
• Bump winloop from 0.1.4 to 0.1.6 by @dependabot in #1801
• Bump aiohttp from 3.10.1 to 3.10.2 by @dependabot in #1802
• Bump types-pyyaml from 6.0.12.20240724 to 6.0.12.20240808 by @dependabot in #1803
• Bump ruff from 0.5.6 to 0.5.7 by @dependabot in #1804
• Bump aiohttp fro...

4.6.0

Package Maintainer Changes

We have dropped using pyppeteer and moved to using PlayWright https://playwright.dev/ for the screenshot module

Dev Changes:

Moved away from isort,black and flake8 for ruff for linting and formatting as ruff can do all that and more, not to mention is crazy fast.

What's Changed

• chore(deps): bump fastapi from 0.109.0 to 0.109.1 in /requirements by @dependabot in #1649
• chore(deps): bump slowapi from 0.1.8 to 0.1.9 by @dependabot in #1651
• chore(deps): bump fastapi from 0.109.1 to 0.109.2 by @dependabot in #1652
• chore(deps-dev): bump pydantic from 2.5.3 to 2.6.1 by @dependabot in #1650
• chore(deps-dev): bump pytest-asyncio from 0.23.4 to 0.23.5 by @dependabot in #1654
• chore(deps): bump netaddr from 0.10.1 to 1.1.0 by @dependabot in #1659
• chore(deps-dev): bump black from 24.1.1 to 24.2.0 by @dependabot in #1656
• chore(deps): bump uvicorn from 0.27.0.post1 to 0.27.1 by @dependabot in #1658
• chore(deps): bump setuptools from 69.0.3 to 69.1.0 by @dependabot in #1655
• chore(deps): bump dnspython from 2.5.0 to 2.6.0 by @dependabot in #1661
• chore(deps): bump aiosqlite from 0.19.0 to 0.20.0 by @dependabot in #1667
• Fix ip-address parsing for IPv6 addresses by @jeffguy in #1670
• chore(deps): bump netaddr from 1.1.0 to 1.2.1 by @dependabot in #1665
• chore(deps): bump dnspython from 2.6.0 to 2.6.1 by @dependabot in #1663
• chore(deps): bump setuptools from 69.1.0 to 69.1.1 by @dependabot in #1668
• chore(deps): bump fastapi from 0.109.2 to 0.110.0 by @dependabot in #1671
• chore(deps-dev): bump pytest from 7.4.4 to 8.0.2 by @dependabot in #1672
• chore(deps): bump python-dateutil from 2.8.2 to 2.9.0.post0 by @dependabot in #1674
• chore(deps): bump playwright from 1.41.2 to 1.42.0 by @dependabot in #1676
• chore(deps-dev): bump ruff from 0.3.0 to 0.3.1 by @dependabot in #1677
• chore(deps-dev): bump pytest from 8.0.2 to 8.1.1 by @dependabot in #1687
• chore(deps-dev): bump types-requests from 2.31.0.6 to 2.31.0.20240311 by @dependabot in #1686
• chore(deps-dev): bump ruff from 0.3.1 to 0.3.2 by @dependabot in #1682
• chore(deps-dev): bump mypy from 1.8.0 to 1.9.0 by @dependabot in #1680
• chore(deps-dev): bump types-python-dateutil from 2.8.19.20240106 to 2.8.19.20240311 by @dependabot in #1685
• chore(deps): bump uvicorn from 0.27.1 to 0.28.0 by @dependabot in #1681
• chore(deps-dev): bump types-pyyaml from 6.0.12.12 to 6.0.12.20240311 by @dependabot in #1684
• chore(deps-dev): bump wheel from 0.42.0 to 0.43.0 by @dependabot in #1683
• chore(deps-dev): bump pytest-asyncio from 0.23.5 to 0.23.5.post1 by @dependabot in #1679
• chore(deps-dev): bump ruff from 0.3.2 to 0.3.3 by @dependabot in #1689
• chore(deps): bump setuptools from 69.1.1 to 69.2.0 by @dependabot in #1688
• chore(deps-dev): bump types-python-dateutil from 2.8.19.20240311 to 2.9.0.20240315 by @dependabot in #1690

New Contributors

• @jeffguy made their first contribution in #1670

Full Changelog: 4.5.1...4.6.0