"Baby, Please Don't Go" was a feature of AC/DC's live shows since their beginning. Although they have expressed their interest and inspiration in early blues songs, music writer Mick Wall identifies Them's adaptation of the song as the likely source. In November 1974, Angus Young, Malcolm Young, and Bon Scott recorded it for their 1975 Australian debut album, High Voltage. Tony Currenti is sometimes identified as the drummer for the song, although he suggests that it had been already recorded by Peter Clack. Wall notes that producer George Young played bass for most of the album, although Rob Bailey claims that many of the album's tracks were recorded with him.
