B-Splines and Fourier-Best Friends for Spatial-Temporal Video Super-Resolution