Skip to content

End to end metrics stop emitting after a while #96

@lherman-cs

Description

@lherman-cs

After a while, Master and Viewer stopped pushing end-to-end metrics as this is shown by -nan in the metric value.

This is the only place where the end-to-end metrics gets pushed:

auto handleVideoFrame = [](UINT64 customData, PFrame pFrame) -> VOID {
PPeer pPeer = (Canary::PPeer)(customData);
std::unique_lock<std::recursive_mutex> lock(pPeer->mutex);
PBYTE frameDataPtr = pFrame->frameData + ANNEX_B_NALU_SIZE;
UINT32 rawPacketSize = 0;
// Get size of hex encoded data
hexDecode((PCHAR) frameDataPtr, pFrame->size - ANNEX_B_NALU_SIZE, NULL, &rawPacketSize);
PBYTE rawPacket = (PBYTE) MEMCALLOC(1, (rawPacketSize * SIZEOF(BYTE)));
hexDecode((PCHAR) frameDataPtr, pFrame->size - ANNEX_B_NALU_SIZE, rawPacket, &rawPacketSize);
// Extract the timestamp field from raw packet
frameDataPtr = rawPacket;
UINT64 receivedTs = getUnalignedInt64BigEndian((PINT64)(frameDataPtr));
frameDataPtr += SIZEOF(UINT64);
UINT32 receivedSize = getUnalignedInt32BigEndian((PINT32)(frameDataPtr));
pPeer->endToEndMetricsContext.frameLatency.push_back((DOUBLE)(GETTIME() - receivedTs) / HUNDREDS_OF_NANOS_IN_A_MILLISECOND);
// Do a size match of the raw packet. Since raw packet does not contain the NALu, the
// comparison would be rawPacketSize + ANNEX_B_NALU_SIZE and the received size
pPeer->endToEndMetricsContext.sizeMatch.push_back((rawPacketSize + ANNEX_B_NALU_SIZE) == receivedSize ? 1.0 : 0.0);
SAFE_MEMFREE(rawPacket);
};

From the snippet above, we can tell that:

  1. There can't be any error/jump statement in the callback that leads to unpublished metrics as there's no CHK_*
  2. There's no deadlock since the thread that is driving the callback was still pushing other metrics (e.g. bytes received, packets received, etc.) even after it stopped pushing the end-to-end metrics.
  3. The end-to-end metrics are pushed in the same rate as inbound video FPS, which 30 fps for our case. And, the end-to-end metrics will be averaged and pushed to Cloudwatch once per 30 seconds. So, it's not possible to have empty data since we should expect ~900 data per batch (30 data per second * 30 seconds).

Master Log Snippet:

--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
|   timestamp   |                                                                                                                           message                                                                                                                            |
|---------------|--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
| 1602344463392 | 2020-10-10 15:41:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.993   Dimensions : N/A                                                                                  |
| 1602344463392 | 2020-10-10 15:41:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344464053 | 2020-10-10 15:41:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344467853 | 2020-10-10 15:41:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344474054 | 2020-10-10 15:41:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344482853 | 2020-10-10 15:41:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344484056 | 2020-10-10 15:41:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344493300 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344493300 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7833   Dimensions : N/A                                                                                      |
| 1602344493300 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344493300 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344493300 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03248e+06   Dimensions : N/A                                                                               |
| 1602344493300 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.4999   Dimensions : N/A                                                                             |
| 1602344493300 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344493392 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.892   Dimensions : N/A                                                                                  |
| 1602344493393 | 2020-10-10 15:41:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344494058 | 2020-10-10 15:41:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344497853 | 2020-10-10 15:41:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344504059 | 2020-10-10 15:41:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344512853 | 2020-10-10 15:41:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344514061 | 2020-10-10 15:41:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344523393 | 2020-10-10 15:42:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.7772   Dimensions : N/A                                                                                 |
| 1602344523393 | 2020-10-10 15:42:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344524063 | 2020-10-10 15:42:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344527853 | 2020-10-10 15:42:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344534064 | 2020-10-10 15:42:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344542853 | 2020-10-10 15:42:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344544066 | 2020-10-10 15:42:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344553300 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344553300 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7999   Dimensions : N/A                                                                                      |
| 1602344553300 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344553300 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344553300 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03695e+06   Dimensions : N/A                                                                               |
| 1602344553300 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5329   Dimensions : N/A                                                                             |
| 1602344553300 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344553393 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.738   Dimensions : N/A                                                                                  |
| 1602344553393 | 2020-10-10 15:42:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344554067 | 2020-10-10 15:42:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344557853 | 2020-10-10 15:42:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344564069 | 2020-10-10 15:42:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344572854 | 2020-10-10 15:42:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344574070 | 2020-10-10 15:42:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344583393 | 2020-10-10 15:43:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.6072   Dimensions : N/A                                                                                 |
| 1602344583393 | 2020-10-10 15:43:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344584072 | 2020-10-10 15:43:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344587854 | 2020-10-10 15:43:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344594074 | 2020-10-10 15:43:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344602854 | 2020-10-10 15:43:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344604075 | 2020-10-10 15:43:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344613300 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344613300 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7833   Dimensions : N/A                                                                                      |
| 1602344613300 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344613300 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344613300 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.04151e+06   Dimensions : N/A                                                                               |
| 1602344613300 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5668   Dimensions : N/A                                                                             |
| 1602344613300 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344613393 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.5338   Dimensions : N/A                                                                                 |
| 1602344613393 | 2020-10-10 15:43:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344614077 | 2020-10-10 15:43:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344617854 | 2020-10-10 15:43:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344624078 | 2020-10-10 15:43:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344632854 | 2020-10-10 15:43:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344634080 | 2020-10-10 15:43:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344643393 | 2020-10-10 15:44:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.5064   Dimensions : N/A                                                                                 |
| 1602344643393 | 2020-10-10 15:44:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344644081 | 2020-10-10 15:44:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344644309 | 2020-10-10 15:44:04 DEBUG   refreshIceConfigurationCallback(): Refreshing the ICE Server Configuration                                                                                                                                                       |
| 1602344644309 | 2020-10-10 15:44:04 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000100, Next state: 0x0000000000000020                                                                                                                            |
| 1602344644309 | 2020-10-10 15:44:04 DEBUG   operator()(): Signaling client state changed to 6 - 'Get ICE Server Configuration'                                                                                                                                               |
| 1602344644340 | 2020-10-10 15:44:04 DEBUG   lwsHttpCallbackRoutine(): Client append handshake header                                                                                                                                                                         |
| 1602344644340 | 2020-10-10 15:44:04 DEBUG   lwsHttpCallbackRoutine(): Sending the body {  "ChannelARN": "arn:aws:kinesisvideo:us-west-2:232283333863:channel/webrtc-canary-runner-1-WebrtcLongRunning/1602012922349",  "ClientId": "Master",  "Service": "TURN" }, size 170  |
| 1602344644390 | 2020-10-10 15:44:04 DEBUG   lwsHttpCallbackRoutine(): Connected with server response: 200                                                                                                                                                                    |
| 1602344644390 | 2020-10-10 15:44:04 DEBUG   lwsHttpCallbackRoutine(): Received client http                                                                                                                                                                                   |
| 1602344644390 | 2020-10-10 15:44:04 DEBUG   lwsHttpCallbackRoutine(): Received client http read: 537 bytes                                                                                                                                                                   |
| 1602344644390 | 2020-10-10 15:44:04 DEBUG   lwsHttpCallbackRoutine(): Http client completed                                                                                                                                                                                  |
| 1602344644390 | 2020-10-10 15:44:04 DEBUG   lwsHttpCallbackRoutine(): Client http closed                                                                                                                                                                                     |
| 1602344644436 | 2020-10-10 15:44:04 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000020, Next state: 0x0000000000000040                                                                                                                            |
| 1602344644436 | 2020-10-10 15:44:04 DEBUG   operator()(): Signaling client state changed to 7 - 'Ready'                                                                                                                                                                      |
| 1602344644436 | 2020-10-10 15:44:04 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000040, Next state: 0x0000000000000080                                                                                                                            |
| 1602344644436 | 2020-10-10 15:44:04 DEBUG   operator()(): Signaling client state changed to 8 - 'Connecting'                                                                                                                                                                 |
| 1602344644436 | 2020-10-10 15:44:04 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000080, Next state: 0x0000000000000100                                                                                                                            |
| 1602344644436 | 2020-10-10 15:44:04 DEBUG   operator()(): Signaling client state changed to 9 - 'Connected'                                                                                                                                                                  |
| 1602344647854 | 2020-10-10 15:44:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344654083 | 2020-10-10 15:44:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344662854 | 2020-10-10 15:44:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344664084 | 2020-10-10 15:44:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344673300 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344673300 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7999   Dimensions : N/A                                                                                      |
| 1602344673300 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344673300 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344673300 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03698e+06   Dimensions : N/A                                                                               |
| 1602344673300 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5332   Dimensions : N/A                                                                             |
| 1602344673300 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344673393 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.398   Dimensions : N/A                                                                                  |
| 1602344673393 | 2020-10-10 15:44:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344674086 | 2020-10-10 15:44:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344677854 | 2020-10-10 15:44:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344684087 | 2020-10-10 15:44:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344692855 | 2020-10-10 15:44:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344694089 | 2020-10-10 15:44:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344703394 | 2020-10-10 15:45:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : 35.3865   Dimensions : N/A                                                                                 |
| 1602344703394 | 2020-10-10 15:45:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : 1   Dimensions : N/A                                                                                                    |
| 1602344704090 | 2020-10-10 15:45:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344707855 | 2020-10-10 15:45:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344714092 | 2020-10-10 15:45:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344722855 | 2020-10-10 15:45:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344724093 | 2020-10-10 15:45:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344733300 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344733300 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7833   Dimensions : N/A                                                                                      |
| 1602344733300 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344733300 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344733300 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03248e+06   Dimensions : N/A                                                                               |
| 1602344733301 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.4999   Dimensions : N/A                                                                             |
| 1602344733301 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344733394 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344733394 | 2020-10-10 15:45:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344733398 | 2020-10-10 15:45:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344733398 | 2020-10-10 15:45:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344734095 | 2020-10-10 15:45:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344737855 | 2020-10-10 15:45:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344744096 | 2020-10-10 15:45:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344752855 | 2020-10-10 15:45:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344754098 | 2020-10-10 15:45:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344763394 | 2020-10-10 15:46:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344763394 | 2020-10-10 15:46:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344763408 | 2020-10-10 15:46:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344763413 | 2020-10-10 15:46:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344764100 | 2020-10-10 15:46:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344767855 | 2020-10-10 15:46:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344774102 | 2020-10-10 15:46:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344782855 | 2020-10-10 15:46:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344784104 | 2020-10-10 15:46:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344793300 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344793300 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7833   Dimensions : N/A                                                                                      |
| 1602344793300 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344793301 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344793301 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03698e+06   Dimensions : N/A                                                                               |
| 1602344793301 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5332   Dimensions : N/A                                                                             |
| 1602344793301 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344793394 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344793394 | 2020-10-10 15:46:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344793398 | 2020-10-10 15:46:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344793398 | 2020-10-10 15:46:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344794106 | 2020-10-10 15:46:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344797855 | 2020-10-10 15:46:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344804108 | 2020-10-10 15:46:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344812856 | 2020-10-10 15:46:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344814110 | 2020-10-10 15:46:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344823394 | 2020-10-10 15:47:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344823394 | 2020-10-10 15:47:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344823408 | 2020-10-10 15:47:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344823409 | 2020-10-10 15:47:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344824112 | 2020-10-10 15:47:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344827856 | 2020-10-10 15:47:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344834114 | 2020-10-10 15:47:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344842856 | 2020-10-10 15:47:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344844115 | 2020-10-10 15:47:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344853301 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344853301 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7999   Dimensions : N/A                                                                                      |
| 1602344853301 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344853301 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344853301 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.04148e+06   Dimensions : N/A                                                                               |
| 1602344853301 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5665   Dimensions : N/A                                                                             |
| 1602344853301 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344853394 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344853394 | 2020-10-10 15:47:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344853399 | 2020-10-10 15:47:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344853399 | 2020-10-10 15:47:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344854118 | 2020-10-10 15:47:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344857856 | 2020-10-10 15:47:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344864120 | 2020-10-10 15:47:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344872856 | 2020-10-10 15:47:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344874122 | 2020-10-10 15:47:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344883394 | 2020-10-10 15:48:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344883394 | 2020-10-10 15:48:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344883412 | 2020-10-10 15:48:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344883414 | 2020-10-10 15:48:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344884124 | 2020-10-10 15:48:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344887856 | 2020-10-10 15:48:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344894126 | 2020-10-10 15:48:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344902856 | 2020-10-10 15:48:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344904128 | 2020-10-10 15:48:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344913301 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344913301 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7833   Dimensions : N/A                                                                                      |
| 1602344913301 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344913301 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344913301 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03698e+06   Dimensions : N/A                                                                               |
| 1602344913301 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5332   Dimensions : N/A                                                                             |
| 1602344913301 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344913394 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344913395 | 2020-10-10 15:48:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344913399 | 2020-10-10 15:48:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344913401 | 2020-10-10 15:48:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344914129 | 2020-10-10 15:48:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344914436 | 2020-10-10 15:48:34 DEBUG   refreshIceConfigurationCallback(): Refreshing the ICE Server Configuration                                                                                                                                                       |
| 1602344914437 | 2020-10-10 15:48:34 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000100, Next state: 0x0000000000000020                                                                                                                            |
| 1602344914437 | 2020-10-10 15:48:34 DEBUG   operator()(): Signaling client state changed to 6 - 'Get ICE Server Configuration'                                                                                                                                               |
| 1602344914461 | 2020-10-10 15:48:34 DEBUG   lwsHttpCallbackRoutine(): Client append handshake header                                                                                                                                                                         |
| 1602344914461 | 2020-10-10 15:48:34 DEBUG   lwsHttpCallbackRoutine(): Sending the body {  "ChannelARN": "arn:aws:kinesisvideo:us-west-2:232283333863:channel/webrtc-canary-runner-1-WebrtcLongRunning/1602012922349",  "ClientId": "Master",  "Service": "TURN" }, size 170  |
| 1602344914640 | 2020-10-10 15:48:34 DEBUG   lwsHttpCallbackRoutine(): Connected with server response: 200                                                                                                                                                                    |
| 1602344914640 | 2020-10-10 15:48:34 DEBUG   lwsHttpCallbackRoutine(): Received client http                                                                                                                                                                                   |
| 1602344914640 | 2020-10-10 15:48:34 DEBUG   lwsHttpCallbackRoutine(): Received client http read: 537 bytes                                                                                                                                                                   |
| 1602344914640 | 2020-10-10 15:48:34 DEBUG   lwsHttpCallbackRoutine(): Http client completed                                                                                                                                                                                  |
| 1602344914640 | 2020-10-10 15:48:34 DEBUG   lwsHttpCallbackRoutine(): Client http closed                                                                                                                                                                                     |
| 1602344914655 | 2020-10-10 15:48:34 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000020, Next state: 0x0000000000000040                                                                                                                            |
| 1602344914655 | 2020-10-10 15:48:34 DEBUG   operator()(): Signaling client state changed to 7 - 'Ready'                                                                                                                                                                      |
| 1602344914655 | 2020-10-10 15:48:34 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000040, Next state: 0x0000000000000080                                                                                                                            |
| 1602344914655 | 2020-10-10 15:48:34 DEBUG   operator()(): Signaling client state changed to 8 - 'Connecting'                                                                                                                                                                 |
| 1602344914655 | 2020-10-10 15:48:34 DEBUG   stepStateMachine(): State Machine - Current state: 0x0000000000000080, Next state: 0x0000000000000100                                                                                                                            |
| 1602344914655 | 2020-10-10 15:48:34 DEBUG   operator()(): Signaling client state changed to 9 - 'Connected'                                                                                                                                                                  |
| 1602344917856 | 2020-10-10 15:48:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344924131 | 2020-10-10 15:48:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344932857 | 2020-10-10 15:48:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344934132 | 2020-10-10 15:48:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344943395 | 2020-10-10 15:49:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344943395 | 2020-10-10 15:49:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344943422 | 2020-10-10 15:49:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344943466 | 2020-10-10 15:49:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344944134 | 2020-10-10 15:49:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344947857 | 2020-10-10 15:49:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344954137 | 2020-10-10 15:49:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344962857 | 2020-10-10 15:49:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344964139 | 2020-10-10 15:49:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344973301 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602344973301 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7999   Dimensions : N/A                                                                                      |
| 1602344973301 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602344973301 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602344973301 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03699e+06   Dimensions : N/A                                                                               |
| 1602344973301 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5333   Dimensions : N/A                                                                             |
| 1602344973301 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602344973395 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602344973395 | 2020-10-10 15:49:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602344973398 | 2020-10-10 15:49:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344973398 | 2020-10-10 15:49:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602344974141 | 2020-10-10 15:49:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344977857 | 2020-10-10 15:49:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344984143 | 2020-10-10 15:49:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602344992857 | 2020-10-10 15:49:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602344994145 | 2020-10-10 15:49:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345003395 | 2020-10-10 15:50:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602345003395 | 2020-10-10 15:50:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602345003409 | 2020-10-10 15:50:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345003412 | 2020-10-10 15:50:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345004147 | 2020-10-10 15:50:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345007857 | 2020-10-10 15:50:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345014149 | 2020-10-10 15:50:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345022857 | 2020-10-10 15:50:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345024151 | 2020-10-10 15:50:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345033301 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602345033301 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7833   Dimensions : N/A                                                                                      |
| 1602345033301 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602345033301 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602345033301 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.03247e+06   Dimensions : N/A                                                                               |
| 1602345033301 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.4998   Dimensions : N/A                                                                             |
| 1602345033301 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602345033395 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602345033395 | 2020-10-10 15:50:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602345033400 | 2020-10-10 15:50:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345033401 | 2020-10-10 15:50:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345034152 | 2020-10-10 15:50:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345037858 | 2020-10-10 15:50:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345044154 | 2020-10-10 15:50:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345052858 | 2020-10-10 15:50:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345054156 | 2020-10-10 15:50:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345063395 | 2020-10-10 15:51:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602345063395 | 2020-10-10 15:51:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602345063414 | 2020-10-10 15:51:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345063415 | 2020-10-10 15:51:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345064158 | 2020-10-10 15:51:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345067858 | 2020-10-10 15:51:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345074160 | 2020-10-10 15:51:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345082858 | 2020-10-10 15:51:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345084162 | 2020-10-10 15:51:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345093301 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602345093301 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7999   Dimensions : N/A                                                                                      |
| 1602345093301 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : NackPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                                              |
| 1602345093301 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFramesRetransmitted   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                   |
| 1602345093301 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingBitRate   Unit       : Kilobits_Second   Values     : 8.04149e+06   Dimensions : N/A                                                                               |
| 1602345093301 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingPacketsPerSecond   Unit       : Count_Second   Values     : 59.5666   Dimensions : N/A                                                                             |
| 1602345093302 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : IncomingFramesDroppedPerSecond   Unit       : Count_Second   Values     : 0   Dimensions : N/A                                                                             |
| 1602345093395 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602345093395 | 2020-10-10 15:51:33 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602345093399 | 2020-10-10 15:51:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345093401 | 2020-10-10 15:51:33 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345094164 | 2020-10-10 15:51:34 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345097858 | 2020-10-10 15:51:37 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345104165 | 2020-10-10 15:51:44 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345112858 | 2020-10-10 15:51:52 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345114167 | 2020-10-10 15:51:54 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345123396 | 2020-10-10 15:52:03 DEBUG   push(): Emitted the following metric:    Name       : EndToEndFrameLatency   Unit       : Milliseconds   Values     : -nan   Dimensions : N/A                                                                                    |
| 1602345123396 | 2020-10-10 15:52:03 DEBUG   push(): Emitted the following metric:    Name       : FrameSizeMatch   Unit       : Count   Values     : -nan   Dimensions : N/A                                                                                                 |
| 1602345123413 | 2020-10-10 15:52:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345123416 | 2020-10-10 15:52:03 ERROR   operator()(): Failed to put sample metric data: Unable to parse ExceptionName: MalformedInput Message:                                                                                                                           |
| 1602345124169 | 2020-10-10 15:52:04 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345127858 | 2020-10-10 15:52:07 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345134171 | 2020-10-10 15:52:14 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345142859 | 2020-10-10 15:52:22 DEBUG   handleStunPacket(): Received STUN binding indication                                                                                                                                                                             |
| 1602345144173 | 2020-10-10 15:52:24 DEBUG   lwsWssCallbackRoutine(): Client is writable                                                                                                                                                                                      |
| 1602345153301 | 2020-10-10 15:52:33 DEBUG   push(): Emitted the following metric:    Name       : PercentageFrameDiscarded   Unit       : Percent   Values     : 0   Dimensions : N/A                                                                                        |
| 1602345153301 | 2020-10-10 15:52:33 DEBUG   push(): Emitted the following metric:    Name       : FramesPerSecond   Unit       : Count_Second   Values     : 29.7833   Dimensions : N/A                                                                                      |
--------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------

Full Logs:
Master: WebrtcLongRunning-Master-1602306331864
Viewer: WebrtcLongRunning-Viewer-1602306331864

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions