The issue was that I had a variable frame rate video, which also caused the export to break. The fix is to use Handbrake to re-encode the video with a fixed frame rate, then it worked fine.

Its important to note that this issue can cause PS24 to misbehave, so it may be important for your project that you convert the variable fps vids before trying to work with them.