Private Joy is the fourth track on Prince's fourth album Controversy, and, nine months after the album's release, it was included as the b-side of Do Me, Baby, the album's third single.
The song's music was re-used (and possibly re-recorded) from the unreleased track Dear Uncle George, recorded earlier in 1981. Basic tracking for Private Joy took place on 16 August 1981 at Sunset Sound in Hollywood, California, during a week of final work on the Controversy album, following some equipment problems at nearby Hollywood Sound Recorders in Los Angeles, California, where he had been working previously. This marks the first Prince track recorded at Sunset Sound, therefore (Prince would continue to work there throughout the 1980s, and return again in 2008).
Prince later reused the guitar solo in the track Poem (later edited to become Orgasm). Orgasm's inclusion on Come marked the first time a substantial musical segment had been used on more than one studio album.