Evals

[saihaj]

I am also thinking we prep some datasets for evals https://platform.openai.com/docs/guides/evals

We can easily do evals for question extractor, rewriter and even spam detector.