Window Rattle Window Up!

I need some suggestions...
I see that many people have had a rattling window when it is down about 3 inches or more but in my case, I found that the driver side door window rattles while the window is fully up! At first I thought it was in the seat belt area of the B-pillar or the handle above the door but then I found that if I just press the window out (especially towards the upper quadrant by the B-pillar) the rattling completely goes away until I let go.

I do not think it is the actuator. Can it be the weather stripping around the door that the window presses into?

This is very annoying and I will be more than happy to replace parts to make it go away but I am not sure what.