Function 的激活函数

Question

is it possible to define a function of activation function? I tried to do:

def activation():
    # return nn.Sin()
    # return nn.Tanh()
    # return nn.Sigmoid()
    # return nn.Tanhshrink()
    return nn.HardTanh(-1,1)
    # return nn.Hardswish()
    # return nn.functionnal.silu()

But i get an error when trying to call it. Here is an example:

def f():
  return nn.Tanh()
input = torch.randn(2)
output = f(input)
print(output)

it outputs "TypeError: f() takes 0 positional arguments but 1 was given". It doesn't work even i gave it an argument x.

Answer 1

You can either use the object-oriented approach:

>>> f = nn.Tanh()
>>> output = f(x)

Or the functional approach where you will find the equivalent for nn.Tanh inside nn.functional as tanh .

>>> f = nn.functional.tanh
>>> output = f(x)

Answer 2

Indeed, you are not providing argument to the function. Is this what you are trying to do?

def f(x):
  return nn.Tanh(x)