It seems like there is no shortage of sensor fusion libraries that can fuse basic common odometric sensors like IMUs and GPS, but none that can fuse from an arbitrary number of sources, especially with different update rates.
For example, let's say that I have:
- 3 IMUs, for redundancy, but also different models with slightly different capabilities, with varying update rates between 500 and 1500 Hz
- 2 3-axis magnetometers with update rates of 300 Hz
- 1 GPS module at 10 Hz, but with RTK corrections at 5 Hz
- 2 low res cameras doing stereo visual odometry at 120 Hz
- 1 high res camera doing visual odometry at 45-60 Hz
Are there any fusion algorithms or libraries that gracefully handle a wide variety of sensors with different capabilities and update rates, without having to downgrade the fusion output to the lowest data rate? Would it be more effective to upsample via extrapolation or predictive methods before feeding to the fusion algorithm?