This is a small C++ tool I put together for the GSoC evaluation task. It reads a list of URLs from a JSON file, fetches them using libcurl, and shows a quick preview of what it found.
You'll need cmake, libcurl, and the nlohmann-json library. If you're on a Mac, you can just grab them with brew:
brew install curl nlohmann-json cmakeThen just follow the usual cmake flow:
mkdir build
cd build
cmake ..
makeOnce you've built it, you can run it by passing the config file:
./httpbot ../config.json- Config: It uses
nlohmann/jsonto parse your settings. - Requests: It uses
libcurlfor the heavy lifting. I set it to follow redirects and time out after 10 seconds so it doesn't get stuck. - Bot Name: It uses the
bot_namefrom your JSON as the User-Agent string. - Preview: It prints the HTTP status code and the first few lines of the response just to show it's working.