It seems when Rollup is used for extra tree-shaking, the sourcemaps no longer trace back to correct positions in the source code. This makes breakpoints effectively useless.

You might be forgetting to feed the sourcemaps into Rollup?