You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Transformation of Azure Resource Log records happened based on Category defined in incoming log record (category or type field) using mappings described in this document.
Mapping are defined to be OpenTelemetry SemConv compatible as much as possible.
If any of the expected field is not present in incoming JSON record or has an empty string value (i.e. "") - it will be ignored.
Unknown/Unsupported Azure Resource Log record Category
For logs Category that conform common Azure Resource Logs schema,
but doesn't have mapping for specific Category in this extension following rules will be applied:
If properties field is parsable JSON - all parsed attributes are put as is into Log Attributes (except for message - goes to Body, correlationId and duration - goes to Log Attributes according to map below)
If properties field couldn't be parsed as JSON - it will be stored into azure.properties Log Attribute as string and parsing error will be logged
Unparsable Azure Resource Log record
In case of parsing or transformation failure - original Azure Resource Log record
will be saved as-is (original JSON string representation) into OpenTelemetry log.Body and error will be logged.
This approach allows you to try to parse or transform Azure Resource Log record later
in OpenTelemetry Collector pipeline (for example, using transformprocessor) or in log Storage if applicable.
Storage Logs have a different identity structure containing authorization decisions as an array, token information, and requester details. The entire identity object is stored as a nested map under azure.identity.
Unknown/Generic Categories
For log categories where the identity structure is not known, the entire identity object is stored as a nested map under azure.identity to preserve all data.
Application Gateway
Application Gateway Access Logs (both v1 and v2)
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
listenerName
azure.agw.listener.name
Log Attribute
ruleName
azure.agw.rule.name
Log Attribute
backendPoolName
azure.agw.backend.pool.name
Log Attribute
backendSettingName
azure.agw.backend.setting.name
Log Attribute
instanceId
service.instance.id
Resource Attribute
clientIP
client.address
Log Attribute
clientPort
client.port
Log Attribute
clientResponseTime
azure.agw.latency
Log Attribute
httpMethod
http.request.method
Log Attribute
requestUri
url.path
Log Attribute
requestQuery
url.query
Log Attribute
originalRequestUriWithArgs
url.original
Log Attribute
userAgent
user_agent.original
Log Attribute
httpStatus
http.response.status_code
Log Attribute
httpVersion
network.protocol.name + network.protocol.version. If unparsable - network.protocol.original
Log Attribute
receivedBytes
http.request.size
Log Attribute
sentBytes
http.response.size
Log Attribute
timeTaken
azure.request.duration
Log Attribute
transactionId
azure.service.request.id
Log Attribute
sslEnabled
tls.enabled
Log Attribute
host
host.name
Log Attribute
originalHost
http.request.header.host
Log Attribute
sslCipher
tls.cipher
Log Attribute
sslProtocol
tls.protocol.name + tls.protocol.version. If unparsable - tls.protocol.original
Log Attribute
serverRouted
server.address + server.port. If unparsable - server.original_address
Log Attribute
serverStatus
azure.agw.backend.status_code
Log Attribute
serverResponseLatency
azure.agw.backend.latency
Log Attribute
WAFEvaluationTime
azure.firewall.evaluation.duration
Log Attribute
WAFMode
security_rule.ruleset.mode
Log Attribute
upstreamSourcePort
network.local.port
Log Attribute
error_info
error.type
Log Attribute
Application Gateway Performance Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
instanceId
service.instance.id
Resource Attribute
healthyHostCount
azure.agw.backend.healthy.count
Log Attribute
unHealthyHostCount
azure.agw.backend.unhealthy.count
Log Attribute
requestCount
azure.agw.request.count
Log Attribute
latency
azure.agw.backend.latency
Log Attribute
failedRequestCount
azure.agw.request.failed
Log Attribute
throughput
azure.agw.throughput
Log Attribute
Application Gateway Firewall Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
instanceId
service.instance.id
Resource Attribute
clientIP
client.address
Log Attribute
clientPort
client.port
Log Attribute
requestUri
url.original
Log Attribute
ruleSetType
security_rule.category
Log Attribute
ruleSetVersion
security_rule.version
Log Attribute
ruleId
security_rule.uuid
Log Attribute
ruleGroup
security_rule.ruleset.name
Log Attribute
message
Body
Log
action
security_rule.action
Log Attribute
site
azure.firewall.site
Log Attribute
details
azure.firewall.evaluation.details
Log Attribute
hostname
host.name
Log Attribute
transactionId
azure.service.request.id
Log Attribute
policyId
azure.firewall.policy.id
Log Attribute
policyScope
azure.firewall.policy.scope.type
Log Attribute
policyScopeName
azure.firewall.policy.object.name
Log Attribute
App Service
App Service App Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
containerId
container.id
Log Attribute
customLevel
log.record.severity.original
Log Attribute
exceptionClass
exception.type
Log Attribute
host
host.name
Log Attribute
logger
log.record.logger
Log Attribute
message
Body
Log
method
code.function.name
Log Attribute
source
log.file.path
Log Attribute
stackTrace
exception.stacktrace
Log Attribute
webSiteInstanceId
azure.app_service.instance.id
Log Attribute
App Service Audit Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
User
user.id
Log Attribute
UserDisplayName
user.name
Log Attribute
UserAddress
source.address
Log Attribute
Protocol
network.protocol.name
Log Attribute
App Service Authentication Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
details
azure.auth.event.details
Log Attribute
hostName
host.name
Log Attribute
message
Body
Log
moduleRuntimeVersion
azure.auth.module.runtime.version
Log Attribute
siteName
azure.app_service.site.name
Log Attribute
statusCode
http.response.status_code
Log Attribute
subStatusCode
azure.http.response.sub_status_code
Log Attribute
taskName
azure.app_service.task.name
Log Attribute
App Service Console Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
containerId
container.id
Log Attribute
host
host.name
Log Attribute
App Service HTTP Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
CIp
client.address + client.port. If unparsable - client.original_address
Log Attribute
ComputerName
server.address
Log Attribute
Cookie
Skipped as it may contains sensitive data, like authentication tokens
-
CsBytes
http.request.size
Log Attribute
CsHost
http.request.header.host
Log Attribute
CsMethod
http.request.method
Log Attribute
CsUriQuery
url.query
Log Attribute
CsUriStem
url.path
Log Attribute
CsUsername
user.name
Log Attribute
Referer
http.request.header.referer
Log Attribute
Result
Body
Log
ScBytes
http.response.size
Log Attribute
ScStatus
http.response.status_code
Log Attribute
ScSubStatus
azure.http.response.sub_status_code
Log Attribute
SPort
server.port
Log Attribute
TimeTaken
azure.request.duration
Log Attribute
UserAgent
user_agent.original
Log Attribute
App Service IPSec Audit Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
CIp
source.address + source.port. If unparsable - source.original_address
Log Attribute
CsHost
http.request.header.host
Log Attribute
details
azure.auth.event.details
Log Attribute
Result
Body
Log
ServiceEndpoint
azure.app_service.endpoint
Log Attribute
XAzureFDID
http.request.header.x-azure-fdid
Log Attribute
XFDHealthProbe
http.request.header.x-fd-healthprobe
Log Attribute
XForwardedFor
http.request.header.x-forwarded-for
Log Attribute
XForwardedHost
http.request.header.x-forwarded-host
Log Attribute
App Service Platform Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
containerId
container.id
Log Attribute
deploymentId
azure.deployment.id
Log Attribute
Exception
exception.message
Log Attribute
host
host.name
Log Attribute
message
Body
Log
stackTrace
exception.stacktrace
Log Attribute
App Service File Audit Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
path
file.path
Log Attribute
process
process.title
Log Attribute
Azure CDN
Azure CDN Access Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
trackingReference
azure.service.request.id
Log Attribute
httpMethod
http.request.method
Log Attribute
httpVersion
network.protocol.version
Log Attribute
requestUri
url.full with parsed url.scheme, url.domain, url.fragment, url.query, url.path and url.port. If unparsable - only url.original
Log Attribute
sni
tls.server.name
Log Attribute
requestBytes
http.request.size
Log Attribute
responseBytes
http.response.size
Log Attribute
userAgent
user_agent.original
Log Attribute
clientIp
client.address
Log Attribute
clientPort
client.port
Log Attribute
socketIp
network.peer.address
Log Attribute
timeToFirstByte
azure.time_to_first_byte
Log Attribute
timeTaken
azure.request.duration
Log Attribute
requestProtocol
network.protocol.name
Log Attribute
securityProtocol
tls.protocol.name + tls.protocol.version. If unparsable - tls.protocol.original
Log Attribute
httpStatusCode
http.response.status_code
Log Attribute
pop
azure.cdn.edge.name
Log Attribute
cacheStatus
azure.cdn.cache.outcome
Log Attribute
errorInfo
exception.type
Log Attribute
endpoint
network.local.address
Log Attribute
isReceivedFromClient
network.io.direction with value receive (if true) or transmit (if false)
Log Attribute
backendHostname
server.address + server.port. If unparsable - server.original_address
Log Attribute
Azure Messaging Logs (service Bus and EventHub Logs)
ApplicationMetricsLogs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
Environment
deployment.environment.name
Resource Attribute
Region
cloud.region
Resource Attribute
SubscriptionId
cloud.account.id
Resource Attribute
NamespaceName
service.namespace
Resource Attribute
EntityName
service.name
Resource Attribute
EntityType
messaging.system
Log Attribute
ScaleUnit
azure.autoscale.unit
Log Attribute
ActivityId
log.record.uid
Log Attribute
ActivityName
azure.operation.name
Log Attribute
ChildEntityType
- (not documented)
Log Attribute
ChildEntityName
- (not documented)
Log Attribute
PartitionId
messaging.destination.partition.id
Log Attribute
Outcome
error.type (in not eq "Success")
Log Attribute
Protocol
network.protocol.name
Log Attribute
AuthType
azure.auth.type
Log Attribute
AuthId
azure.auth.id
Log Attribute
NetworkType
network.connection.type
Log Attribute
ClientIp
client.address
Log Attribute
Count
messaging.message.count
Log Attribute
Properties.ApplicationGroupName
- (not documented)
Log Attribute
DiagnosticErrorLogs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
Environment
deployment.environment.name
Resource Attribute
Region
cloud.region
Resource Attribute
SubscriptionId
cloud.account.id
Resource Attribute
NamespaceName
service.namespace
Resource Attribute
EntityName
service.name
Resource Attribute
EntityType
messaging.system
Log Attribute
ScaleUnit
azure.autoscale.unit
Log Attribute
ActivityId
log.record.uid
Log Attribute
ActivityName
azure.operation.name
Log Attribute
TaskName
azure.messaging.task.name
Log Attribute
OperationResult
error.type
Log Attribute
ErrorMessage
error.message
Log Attribute
ErrorCount
azure.messaging.error.count
Log Attribute
OperationalLogs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
Environment
deployment.environment.name
Resource Attribute
Region
cloud.region
Resource Attribute
SubscriptionId
cloud.account.id
Resource Attribute
NamespaceName
service.namespace
Resource Attribute
EntityName
service.name
Resource Attribute
- (from ResourceID)
messaging.system
Log Attribute
ScaleUnit
azure.autoscale.unit
Log Attribute
ActivityId
log.record.uid
Log Attribute
EventName
azure.operation.name
Log Attribute
Status
error.type (if not eq "Succeeded")
Log Attribute
Caller
client.type
Log Attribute
EventProperties.SubscriptionId
- (duplicates high level attributes)
-
EventProperties.Namespace
- (duplicates high level attributes)
-
EventProperties.Via
url.full with parsed url.scheme, url.domain, url.fragment, url.query, url.path and url.port. If unparsable - only url.original
Log Attribute
EventProperties.TrackingId
azure.service.request.id
Log Attribute
EventProperties.ErrorCode
error.code
Log Attribute
EventProperties.ErrorMessage
error.message
Log Attribute
RuntimeAuditLogs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
Environment
deployment.environment.name
Resource Attribute
Region
cloud.region
Resource Attribute
SubscriptionId
cloud.account.id
Resource Attribute
NamespaceName
service.namespace
Resource Attribute
EntityName
service.name
Resource Attribute
EntityType
messaging.system
Log Attribute
ScaleUnit
azure.autoscale.unit
Log Attribute
ActivityId
log.record.uid
Log Attribute
ActivityName
azure.operation.name
Log Attribute
TaskName
azure.messaging.task.name
Log Attribute
Status
error.type (if not eq "Success")
Log Attribute
Protocol
network.protocol.name
Log Attribute
AuthType
azure.auth.type
Log Attribute
AuthId
azure.auth.id
Log Attribute
NetworkType
network.connection.type
Log Attribute
ClientIp
client.address
Log Attribute
Count
messaging.message.count
Log Attribute
Properties
Body (unparsed, as-is)
Log
VNetAndIPFilteringLogs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
Environment
deployment.environment.name
Resource Attribute
Region
cloud.region
Resource Attribute
SubscriptionId
cloud.account.id
Resource Attribute
NamespaceName
service.namespace
Resource Attribute
- (from ResourceID)
messaging.system
Log Attribute
ScaleUnit
azure.autoscale.unit
Log Attribute
ActivityId
log.record.uid
Log Attribute
EventName
azure.operation.name
Log Attribute
ipAddress
client.address
Log Attribute
action
security_rule.action
Log Attribute
reason
security_rule.evaluation.reason
Log Attribute
count
security_rule.evaluation.count
Log Attribute
Azure Data Factory
ActivityRuns Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
start
azure.datafactory.activity.start_time
Log Attribute
end
azure.datafactory.activity.end_time
Log Attribute
UserProperties
azure.datafactory.user_properties
Log Attribute
Annotations
azure.datafactory.annotations
Log Attribute
Input
azure.datafactory.input
Log Attribute
Output
azure.datafactory.output
Log Attribute
Predecessors
azure.datafactory.predecessors
Log Attribute
Parameters
azure.datafactory.parameters
Log Attribute
SystemParameters
azure.datafactory.system_parameters
Log Attribute
Tags
azure.datafactory.tags
Log Attribute
Error.errorCode
error.code
Log Attribute
Error.message
error.message
Log Attribute
Error.failureType
error.type
Log Attribute
Error.target
error.target
Log Attribute
activityRunId
azure.datafactory.activity.run_id
Log Attribute
activityName
azure.datafactory.activity.name
Log Attribute
pipelineRunId
azure.datafactory.pipeline.run_id
Log Attribute
pipelineName
azure.datafactory.pipeline.name
Log Attribute
PipelineRuns Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
start
azure.datafactory.pipeline.start_time
Log Attribute
end
azure.datafactory.pipeline.end_time
Log Attribute
UserProperties
azure.datafactory.user_properties
Log Attribute
Annotations
azure.datafactory.annotations
Log Attribute
Input
azure.datafactory.input
Log Attribute
Output
azure.datafactory.output
Log Attribute
Predecessors
azure.datafactory.predecessors
Log Attribute
Parameters
azure.datafactory.parameters
Log Attribute
SystemParameters
azure.datafactory.system_parameters
Log Attribute
Tags
azure.datafactory.tags
Log Attribute
Error.errorCode
error.code
Log Attribute
Error.message
error.message
Log Attribute
Error.failureType
error.type
Log Attribute
Error.target
error.target
Log Attribute
runId
azure.datafactory.pipeline.run_id
Log Attribute
pipelineName
azure.datafactory.pipeline.name
Log Attribute
status
``
Log Attribute
TriggerRuns Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
start
azure.datafactory.trigger.start_time
Log Attribute
end
azure.datafactory.trigger.end_time
Log Attribute
UserProperties
azure.datafactory.user_properties
Log Attribute
Annotations
azure.datafactory.annotations
Log Attribute
Input
azure.datafactory.input
Log Attribute
Output
azure.datafactory.output
Log Attribute
Predecessors
azure.datafactory.predecessors
Log Attribute
Parameters
azure.datafactory.parameters
Log Attribute
SystemParameters
azure.datafactory.system_parameters
Log Attribute
Tags
azure.datafactory.tags
Log Attribute
Error.errorCode
error.code
Log Attribute
Error.message
error.message
Log Attribute
Error.failureType
error.type
Log Attribute
Error.target
error.target
Log Attribute
triggerId
azure.datafactory.trigger.run_id
Log Attribute
triggerName
azure.datafactory.trigger.name
Log Attribute
triggerType
azure.datafactory.trigger.type
Log Attribute
triggerEvent
azure.datafactory.trigger.event_payload
Log Attribute
status
azure.datafactory.pipeline.state
Log Attribute
Front Door
Front Door Web Application Firewall Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
clientIP
client.address
Log Attribute
clientPort
client.port
Log Attribute
socketIP
network.peer.address
Log Attribute
requestUri
url.full with parsed url.scheme, url.domain, url.fragment, url.query, url.path and url.port. If unparsable - only url.original
Log Attribute
ruleName
security_rule.name
Log Attribute
policy
security_rule.ruleset.name
Log Attribute
action
security_rule.action
Log Attribute
host
http.request.header.host
Log Attribute
trackingReference
azure.service.request.id
Log Attribute
policyMode
security_rule.ruleset.mode
Log Attribute
Front Door Health Probe Logs
Azure "properties" Field
OpenTelemetry
OpenTelemetry Scope
healthProbeId
azure.frontdoor.health_probe.id
Log Attribute
POP
azure.cdn.edge.name
Log Attribute
httpVerb
http.request.method
Log Attribute
result
Body
Log
httpStatusCode
http.response.status_code
Log Attribute
probeURL
url.full with parsed url.scheme, url.domain, url.fragment, url.query, url.path and url.port. If unparsable - only url.original
Log Attribute
originName
azure.frontdoor.health_probe.origin.name
Log Attribute
originIP
server.address + server.port. If unparsable - server.original_address