feat: add act_fn param to OutValueFunctionBlock

[SauravMaheshkar]

What does this PR do?

(Hopefully) fixes #1287

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline?
• Did you read our philosophy doc (important for complex PRs)?
• Was this discussed/approved via a Github issue or the forum? Please add a link to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

Who can review?

Anyone in the community is free to review the PR once the tests have passed. Feel free to tag
members/contributors who may be interested in your PR.

Request for Review: @natolambert

[HuggingFaceDocBuilderDev]

The documentation is not available anymore as the PR was closed or merged.

[natolambert]

Let's add some folks from the Diffusers team, I'm not actively working on this anymore @patrickvonplaten

[patrickvonplaten]

I don't fully understand what this fixes. Could you maybe elaborate here @SauravMaheshkar ? :-)

[SauravMaheshkar]

I don't fully understand what this fixes. Could you maybe elaborate here @SauravMaheshkar ? :-)

Hey @patrickvonplaten thanks for getting back. This doesn't fix an issue but I rather wanted to raise the discussion about how to fix #1287. A very naive fix could be to simply change the activation to swish in prepare_init_args_and_inputs_for_common ( in tests/models/test_models_unet_1d.py) to solve the problem (and updating the OutValueFunctionBlock to not have mish)?

But if not what would you suggest is a way to fix it ? I'm afraid I can't understand #1287 (comment)

[patrickvonplaten]

TBH, I also don't fully understand the discussion of #1287 - I'm ok with merging this PR as is though if it helps for your use case :-)

[SauravMaheshkar]

Well this PR changes the activation function to be swish instead of mish so we can drop the decorators (@unittest.skipIf(torch_device == "mps", "mish op not supported in MPS")). @patrickvonplaten I made changes in this PR. LMK if they make sense.

[patrickvonplaten]

Perfect!