Do batteries contain current, which comes out when they are in a circuit?

No; this is a common misconception! Batteries store energy, which is used to push electrons (charges) around a circuit. The flow of electrons is called current. As the electrons flow through the circuit they lose energy, usually because they're doing some electrical work like driving a motor or making a lightbulb light up!