Is your feature request related to a problem? Please describe
Related to the following issue: #36749
Describe the solution you'd like
A PR (#37748) was made to use fp32 accumulator when the flag is explicitly enabled, we should change this to be enabled when recognizing the input is of fp32 data type.
Describe alternatives you've considered
Currently there is an explicit flag that must be set in order to use the fp32 accumulator.