Change of product variation image when selecting only color

Hello,

I’m using image swatches for color/size variations and the gallery image is changed when I select color and size.

The colors have different variation images but the images are the same for every size. Can I set it in a way that the gallery image changes already when only the color is selected without needing to choose the size first?

Best regards,
Stan