I would pull of the front of the dash off and make sure that the connectors are plugged all the way in. Just push up on the top panel of the dash and pull the bottom panel off. Unscrew all of the screws on the top and bottom and then pull the front dash panel towards you. Check the connections, unplug it and plug it back in. You can test it right then and there. Then just put it back together.
If it was a fuse, I would think that it would be the same fuse for the front windows as it would be for the back.