Add better support for logs management

[avishnyakov]

Currently, this provider does not support any of log management features.

It makes it hard to manage and move configurations across different DataDog organizations.
Here are several suggestion for new features:

• support column creation
• support facets creation
• support saved views creation

[gregsymons]

DataDog would have to publish APIs for log management first.

[julianvmodesto]

There are Datadog Log Index and Pipeline APIs

https://docs.datadoghq.com/api/?lang=python#logs-indexes
https://docs.datadoghq.com/api/?lang=python#logs-pipelines

[NBParis]

Hello,

Thanks @julianvmodesto , we indeed to have an API for pipelines and indexes (which include exclusion filters) and we are working on adding terraform support for it.

Regarding your request, it is planned to have an API and terraform support for:

• Management of Facets and Measures
• Management of Saved Views

Those are being worked on and we will update this thread once released.

Regarding columns, those are per users therefore I'm not sure to understand how you would use an API for them. Would you mind extending on your use case regarding setting columns via API?

[bkabrda]

Hi folks, version 2.5.0 of the provider has been released and contains support for logs indexes and logs pipelines [1]. While I understand that the current feature set does not fully satisfy everything that this issue asks for, I still wanted to give a heads-up here so that you could benefit from these new resources.

[1] https://github.com/terraform-providers/terraform-provider-datadog/blob/master/CHANGELOG.md#250-october-22-2019

[thomas-riccardi]

Hello,

Are there any plans to add "Generate Metrics" from logs support too? (and Distribution Metrics from them?)

Thanks

[NBParis]

Hello @thomas-riccardi ,

The overall plan is to support all features through API and terraform which includes the Generate Metrics from Logs.

We will make sure to update this issue as we make progress on the different items covered here.

[chriskolenko]

Any ETA for managing Facets?

[lukeforehand]

Our company also needs to generate metrics and create facets from terraform. They are the next logical features after finishing datadog_dashboard, since the dashboards require special metrics and facets. On the positive side, we were able to wire our cluster resource names into the dashboard log queries because they are terraformed, BIG WIN!

[egorchabala]

Be able to terrafom facets is must for multi-org setups. I'm interesting to see this feature as well

[drpebcak]

Being able to create facets via terraform would be really great. Is there an ETA on this?

[sanderginn]

Still no news? Facet management in Terraform is important for us.

[pavlospt]

Bumping up this issue, since there is no reply yet! Will Logs -> Saved Views be available through the TF provider? If there is API support I could help with a contribution!