Feature request

The LoraConfig class should accept an optional exclude_modules list of regular expressions in an analogue to target_modules that then should be referenced when matching against entries from target_modules.

Motivation

Targeting proj_out and proj_mlp on some models greatly improves the results, but we find that the effect is more reliable and robust if the final proj_out and proj_mlp layers are excluded.

Your contribution

I can quickly integrate, test, and make use of this feature in bghira/simpletuner

I'm not sure I'll have time to submit a PR in the next two weeks, but after that perhaps I will be able to. Someone who grabs it before then will be much appreciated 💌