Apply caulk to all joints in the window frame, and the joint where the frame and wall meet. Hold the gun or product at a 45-degree angle, and caulk in one continuous stream. Make sure the caulk sticks to both sides of a crack. If caulk comes out of a crack, use a putty knife or screwdriver to push it back in.