bpm changes in mania will affect scroll speed, and if you want constant scroll speed with changing bpms, you'll have to normalize it by using SVs (slider velocity).
For example, let's say your original bpm was 150. You change the bpm of your map in the middle to be something like 180 bpm. Your scroll speed will also speed up by 180/150, or 1.2 times the original amount. To put this back to normal, you have to cancel out that speedup by adding a slider velocity of 150/180, or 0.83.
In general, to normalize scroll speed, you have to add a slider velocity with the following value:
slider velocity rate = Original BPM / New BPM