If we extract oil from under the earth why doesn't the surface collapse?

In most cases it is replaced with water, either by design (when we pump it in) or by natural permeation from surrounding rocks (rain seeping through will replace it eventually). Sometimes, the surrounding earth structure is good enough to support voids in the structure.