Keep track of raw fd used for net data

Keep track of raw fd used for net data #4783