Mark backed a long list of jazz, traditional pop, and cabaret vocalists in the '80s and/or '90s, including Peggy Lee (who he worked with for six years), Jackie & Roy, Mel Tormé, and Liza Minnelli. Another person he backed was blues/early R&B/jazz great Ruth Brown, who used Sherman on a U.S. tour and employed him on her Fantasy release Songs of My Life in 1993.
The '90s found Sherman joining forces with guitarist Larry Coryell, who has featured him as a sideman extensively; Sherman has produced a few of Coryell's albums, including I'll Be Over You for CTI in 1994 and Sketches of Coryell for Shanachie in 1996. Although Sherman kept busy as a sideman throughout the '90s, he didn't build a huge catalog during that decade; nonetheless, the late '90s did find Sherman starting his own independent record company, Mile High Productions. Sherman's Mile High releases have included The Spiral Staircase (a 1997 release), High Rollin' (released in 1998), and Daylight Calling (a date he co-led with saxophonist Tim Hegarty). In 2004, Sherman recorded his sixth album as a leader, The Motive Series, for Consolidated Artists Productions; the album, which features tenor sax heavyweight Michael Brecker on two tracks, is dominated by Sherman's own compositions.