This question is already marked as answered, but I found an interesting paper (To Bundle Adjust or Not: A Comparison of Relative Geolocation Correction Strategies for Satellite Multi-View Stereo, Marí et al.) that suggests an additional way to cope with the 3D points.