Enable to run "in memory" without mongo

[rmannibucau]

Would be great to have an in memory datastorage (maybe addressed through http to reuse existing node process?) to light up the infra needed to run the scanner "locally".

[alexec]

good idea - would you be interested in creating a PR?

[rmannibucau]

@alexec maybe in some times but for now i'm trying to find why I miss some executions in the report (had the same issue with takari plugin)

[edumco]

@rmannibucau is this useful? https://docs.mongodb.com/manual/core/inmemory/

I have no experience with databases :(

[alexec]

We use Mongo, but I think this was overkill. Writing to a disk would probably work just as well.

[rmannibucau]

Was thinking to orientdb or alike, mongo is clearly overkill and too heavy for that need.

[edumco]

@rmannibucau I've just runned orientdb and it was really fast. What do we need to change to make it work?

[rmannibucau]

Implement OrientDBDataStorage? (https://github.com/intuit/maven-build-scanner/blob/master/src/main/java/com/intuit/maven/extensions/build/scanner/infra/DataStorage.java) and make LifecycleProfiler not hardcode mongo impl by using a maven properties (better than using env var since maven properties can be populated from env but also system props.

[edumco]

@alexec Just clarifying if i really Understood the @rmannibucau comment

1. Create a class OrientDBDataStorage that implements the interface DataStorage
2. Alter the constructor of LifecycleProfiler to choose the database from a maven propertie
3. Create some unit testes to make sure nothing has stop working (i cant help beeing a tester)

What am I missing?

[alexec]

Would it possible to use files?

[alexec]

I'm refreshing my memory - I think the challenge isn't the Java code - but the Node code. I think there is a lot of logic there, e.g.

https://github.com/intuit/maven-build-scanner/blob/master/server/routes/index.js#L3

[alexec]

https://github.com/intuit/maven-build-scanner/blob/master/server/models/ProjectSummary.js#L1

[rmannibucau]

@edumco yep exactly.
@alexec orientdb is able to use files as well but supports in memory storage. Orientdb has a node driver btw: https://orientdb.com/docs/3.0.x/orientjs/OrientJS.html.

[alexec]

I think we can get rid of Mongo AND Node completely. Most of the logic is in JavaScript.

You could implement DataStorage to output a small website:

~/.maven-build-scanner/project_summaries/{groupId}-{artifactId}
~/.maven-build-scanner/session_summaries/{id}
~/.maven-build-scanner/index.html

Doing so would make it much easier to use for most users.

[edumco]

i did not understood. Instead of save to memory we would save to a html+js file?