Fix RoPE config validation for FalconConfig + various config typos

[tomaarsen]

What does this PR do?

One change that fixes a bug:

• Fix RoPE config validation: config = FalconConfig(alibi=False, rope_scaling={"type": "linear", "factor": 2.0}) would fail. (1fbd699)

And three changes that fix typos/improve maintainability etc.

• Fix code block tag (b9e4f0a)
• Fix typos: an float -> a float (69214ce)
• Implement copy functionality for Fuyu and Persimmon (4ee278a)

I can split this up into two smaller PRs if preferred - just let me know.

Details

Fix RoPE config validation

from transformers import FalconConfig

config = FalconConfig(alibi=False, rope_scaling={"type": "linear", "factor": 2.0})

Running this on main produces:

ValueError: `rope_scaling` is not supported when `alibi` is `True`.

Which is obviously nonsensical. This is caused by if self.rotary: raise ValueError where self.rotary is just not self.alibi. So, this ValueError is thrown when alibi is False, not when it is True.

The other 3 changes speak for themselves.

Before submitting

• This PR fixes a typo or improves the docs (you can dismiss the other checks if that's the case).
• Did you read the contributor guideline,
  Pull Request section?
• Was this discussed/approved via a Github issue or the forum? Please add a link
  to it if that's the case.
• Did you make sure to update the documentation with your changes? Here are the
  documentation guidelines, and
  here are tips on formatting docstrings.
• Did you write any new necessary tests?

No new tests - I can add one for the first bug fix if preferred.

Who can review?

@gante

• Tom Aarsen

[HuggingFaceDocBuilderDev]

The docs for this PR live here. All of your documentation changes will be reflected on that endpoint.

[gante]

Thank you for fixing my sloppy english :D

[ArthurZucker]

Thanks for the nits