camera sensor HDR output

[Domsall]

Over 3 years ago there was an issue regarding a 16-bit image: #157.

I couldn't find any updates on this topic. So my question is:
Has it since then become possible to output HDR images from the camera sensor and if not, is this a feature you are looking into in the near future?

It would be great to see this in the "Community friendly features".

[Domsall]

I would be very thankful to get an update on this topic :)

[stale]

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[Domsall]

what is the state of this topic?

[roque2205]

I have made my own implementation of an hdr camera which delivers 16bit float pixel values instead of 8 bit int pixels. And then I found out that I only get 256 different float values. This topic was marked as stale, but maybe @Axel1092 or @DSantosO have any hints for me?

[Domsall]

I am also still here :)
The reason is that the picture taken with the Scene-Capturer is transmitted from the server-side via 8 bit values.
I just do not know how much time this takes to implement or if an extension on this topic is coming soon.

[brscholz]

I'll check on that today, I'm afraid I can't wait for the Carla guys to deliver. :D

Edit: Just to make that clear, the transmission of the image from server-side sensor to client side already works in 16bit in my case.

Test case: In my "WriteFloatPixelsToBuffer_Vulkan" routine I do not take the pixel values retrieved by "ReadSurfaceFloatData" but replace them with real 16bit float data. My image raw_data holds exactly these values.

The problem is, that ReadSurfaceFloatData delivers 16bit float data of only 256 different possible color values. This has to do something with the UTextureRenderTarget2D that is fed into the function, I guess.

For reference: #5070

[Domsall]

You only changed the data format, the underlying data stayed the same (256 different values = 8 bit).

There may be 2 reasons:

• You still depend on the 8 bit Scene-Capturer from Carla
• You haven't changed the game settings to 12 or 16 bit. The standard game runs in 8 bit and the Scene Capturer just captures a photo of this game scene.

I would love to understand how/where you changed the files to get the 16 bit values.

[brscholz]

I intend on creating a branch and a pull request once I figure out how to do it. :)

And you're right, I only changed the pipeline from sensor to client yet. There is a parameter in the UTextureRenderTarget2D called RenderTargetFormat. UTextureRenderTarget2D is used by the SceneCaptureSensor, so right now I'm trying to change the format to RTF_RGBA16f only for my HDR Camera. Hope that will work out... Game settings are already set to HDR.

[Domsall]

that sounds great, if I can somehow help, please contact me.