Skip to content

Implement hard sigmoid and hard swish #67

Open
@joaopauloschuler

Description

@joaopauloschuler

Use this code as inspiration:
def HardSigmoid(x):
return tensorflow.keras.layers.ReLU( 6.0 )( x + 3.0 ) * ( 1.0 / 6.0 )

def HardSwish(x):
return tensorflow.keras.layers.Multiply()([tensorflow.keras.layers.Activation(HardSigmoid)(x), x])

Metadata

Metadata

Assignees

No one assigned

    Labels

    enhancementNew feature or request

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions