Hi, thanks for the great work on this library!

I'm currently working with a custom Stable Video Diffusion model, and I was wondering if there's a way to apply LoRA to layers beyond the currently supported types: {"Linear", "Embedding", "Conv1D", "Conv2D"}. My architecture includes additional layer types where I'd like to integrate LoRA, and I’m curious if there’s support for this or a recommended way to extend LoRA to custom layers.
Any guidance would be greatly appreciated!