Question About Insoluble Gas Displacing Water?

If an insoluble gas, such as H2, is collected by collecting it in an inverted cup over water so that it displaces some of the water, why is the pressure of the gas equal to atmospheric pressure - vapor pressure? I understand why you're subtracting vapor pressure, but why subtract from atmospheric pressure? How is the pressure of the gas related to atmospheric pressure?