woocommerce variable product attribute filter

I have two types of products: 1. Simple Product 2. Variable Product

I have created an attribute called “Colors” (values: Black, White)

For the Simple Product type, I have both Black, White for “colors” attributes

For the Variable Product type, I have both Black, White for “colors” attributes as well and I used them both to create the variations.

Now the problem is the Attribute Filter Widget that comes with Woocommerce does not pick the attributes for the variable product type item. In the Category/Shop Page the widget is showing:

Black 1

White 1

Instead of showing

Black 2

White 2

If I delete the attributes for the simple product type, the widget does not even display the Attribute Filter

Could you please help me with what could possibly go wrong?