After a lot of maths, we're about to enter the testing phase of the fSpy-inspired camera matching #b3d add-on, tentatively titled Perspective Plotter.
It will work with 1, 2 or 3 perspectives and come with a few other tools too. Here is a brief glimpse of the #blender interface.