Does using the second battery also increase the power of the bike?

Yes, when you move from one battery to two batteries, there is a slight power increase from 70 Amps to 100 Amps. This results in more sustained acceleration over a greater distance.