osquery-file-carve-server.md

Oquery-file-carve server

File storeage backend

This GoLang file server supports writing file uploads to the file system or to Mongo GridFS.

File system

Pros

• Simplest configuration
• Doesn't require management of a backend database

Cons

• Doesn't allow for scalability horizontally

Mongo GridFS

Pros

• Ability to scale horizontally

Cons

• Requires Mongo GridFS
• More resources
• Requires management of a backend database

References

File streaming

• StackOverFlow - How to read/write from/to file using Go?
• StackOverFlow - Getting “bytes.Buffer does not implement io.Writer” error message
• GoDocs - Package io
• Streaming IO in Go

Mongo + GridFS streaming

• GoDocs - package gridfs
• Golang+MongoDB
• GoDocs - package mongo
• Github - MongoDB Go Driver
• StackOverFlow - Mongodb to Mongodb GridFS
• golang mongoDB GridFS query storage delete file
• Quick Start: Golang & MongoDB - A Quick Look at GridFS
• Connection String URI Format
• Github issue - how to configure TLS/SSL for mongod
• StackOverFlow - How to use new URL from mongodb 3.6 to connect from golang
• StackOverflow- How to download file in browser from Go server
• primitive.go
• StackOverFlow - Delete all the document older than a date using _id in mongo using mgo