Better logging

[deadbits]

Review logging across the application and standardize to a common format that's conducive to key-value extraction.

I'm thinking two main loggers:

• Application logs (database, loading and running scanners, etc)
• Results (final scan results)

Right now, the final scan results are returned via API or as a dict in the Python library but not logged anywhere.

Logging should also be configurable; whether to log to a file or not, log results or not.

[deadbits]

This also raises the question of whether or not Vigil should returned the submitted prompt/response in the results, because it will then be reflected in the logs.

Same goes for the vector db scanner matches. High likelihood for bad content that's probably best not to ingest through logs.

Right now the logs do contain strings like this, but it's meant more for debugging / research purposes. Maybe a flag in the config to choose to log unsafe strings or not.

[deadbits]

And less verbose. There's lots of informational messages that should be debug messages or not present at all. Other messages could be consolidated.