"Back Off Bitch" is a hard-charging track from Use Your Illusion I, written by Axl Rose and Paul Tobias, who would later become a controversial figure during the band's post-classic lineup era. Set in F minor at 146 BPM, the song is one of the oldest compositions on the album, with early versions dating back to the pre-Appetite for Destruction period and even to Rose's pre-GNR project Hollywood Rose. The track opens with a menacing guitar figure before launching into a driving, riff-heavy arrangement that draws on classic metal influences. Slash's electric guitar solo is one of the longer instrumental features on the album, beginning around the 2:59 mark and running for approximately forty seconds. The solo builds from measured, deliberate phrasing into increasingly frenetic runs, with Slash employing wide vibrato, aggressive pick attack, and rapid position shifts across the fretboard. His tone throughout is thick and aggressive, matching the confrontational nature of the song's lyrical content. Matt Sorum's drumming provides a powerful, steady foundation with punchy snare hits and commanding fills that propel the arrangement forward. The rhythm guitar work from Izzy Stradlin is taut and driving, underpinning Slash's lead work with churning power chords. While the song drew criticism for its lyrical content, the musical performance demonstrates the band's ability to deliver muscular, uncompromising hard rock.