| 1991 | Misty | Johnny Mathis | | 2 |
| 1991 | The Hits of Johnny Mathis | Johnny Mathis | | 3 |
| 1991 | Better Together: The Duet Album | Johnny Mathis | | 2 |
| 1991 | Johnny Mathis Greatest Hits | Johnny Mathis | | 1 |
| 1992 | The Very Best of | Johnny Mathis | | 1 |
| 1993 | The Music of Johnny Mathis: A Personal Collection | Johnny Mathis | | 2 |
| 1993 | 14 Special Hits | Johnny Mathis | | 1 |
| 1993 | The Christmas Music of Johnny Mathis: A Personal Collection | Johnny Mathis | | 4 |
| 1994 | 16 Most Requested Songs Encore! | Johnny Mathis | | 1 |
| 1994 | 20 Greatest Hits | Johnny Mathis | | 1 |
| 1994 | Raindrops Keep Fallin’ on My Head / Love Story | Johnny Mathis | | 1 |
| 1995 | Too Much, Too Little, Too Late | Johnny Mathis & Deniece Williams | | 1 |
| 1996 | The Love Songs | Johnny Mathis | | 1 |
| 1997 | The Global Masters | Johnny Mathis | | 2 |
| 1997 | That’s What Friends Are For / You Light Up My Life / Better Together: The Duet Album | Johnny Mathis | | 1 |
| 1997 | A Time Remembered | Johnny Mathis | | 1 |
| 1998 | The Ultimate Hits Collection | Johnny Mathis | | 2 |
| 1998 | Warm / Swing Softly | Johnny Mathis | | 1 |
| 1999 | Christmas Is... | Johnny Mathis | | 1 |
| 1999 | Super Hits | Johnny Mathis | | 4 |
| 1999 | The Impossible Dream: 22 Inspirational Favorites | Johnny Mathis | | 1 |
| 2000 | Hits You Remember | Johnny Mathis | | 1 |
| 2000 | Johnny Mathis | Johnny Mathis | | 1 |
| 2002 | The Very Best of Johnny Mathis | Johnny Mathis | | 1 |
| 2003 | The Very Best of Love | Johnny Mathis | | 2 |
| 2003 | 36 All-Time Favorites! | Johnny Mathis | | 1 |
| 2003 | Love Songs | Johnny Mathis | | 1 |
| 2003 | Night and Day | Johnny Mathis | | 1 |
| 2004 | The Essential Johnny Mathis | Johnny Mathis | | 2 |
| 2004 | Johnny’s Mood / Faithfully | Johnny Mathis | | 1 |
| 2004 | Star Portrait | Johnny Mathis | | 1 |
| 2004 | The Great Johnny Mathis | Johnny Mathis | | 1 |
| 2006 | The Very Best of Johnny Mathis | Johnny Mathis | | 1 |
| 2006 | Johnny Mathis Gold: A 50th Anniversary Celebration | Johnny Mathis | | 1 |
| 2006 | Winter Wonderland | Johnny Mathis | | 1 |
| 2008 | Misty: The Best of Johnny Mathis | Johnny Mathis | | 1 |
| 2008 | The Collection | Johnny Mathis | | 1 |
| 2008 | Classic Album & Singles Collection | Johnny Mathis | | 1 |
| 2008 | Gold: A 50th Anniversary Christmas Celebration | Johnny Mathis | | 1 |
| 2008 | Purely...Johnny Mathis | Johnny Mathis | | 2 |
| 2008 | Retro Collection Series - From The Original Masters | Johnny Mathis | | 1 |
| 2009 | I’ll Buy You a Star / Live It Up! | Johnny Mathis | | 1 |
| 2009 | People / The Impossible Dream | Johnny Mathis | | 1 |
| 2009 | Rapture / Romantically | Johnny Mathis | | 1 |
| 2009 | Those Were the Days / Love Theme From “Romeo & Juliet” | Johnny Mathis | | 1 |
| 2009 | Up, Up and Away / Love Is Blue | Johnny Mathis | | 1 |
| 2009 | The Original Johnny Mathis: 36 All-Time Favourite Songs | Johnny Mathis | | 1 |
| 2011 | The Absolutely Essential 3 CD Collection | Johnny Mathis | | 1 |
| 2011 | The Ultimate Collection | Johnny Mathis | | 2 |
| 2011 | Christmas Treasures | Frank Sinatra, Tony Bennett, Johnny Mathis, Perry Como, Elvis Presley, Doris Day, Gene Autry, Andy Williams and more | | 1 |
| 2012 | S.O.U.L. | Johnny Mathis | | 1 |
| 2012 | Love Is Everything / Broadway | Johnny Mathis | | 1 |
| 2012 | Tender Is the Night / The Wonderful World of Make Believe | Johnny Mathis | | 1 |
| 2012 | Playlist: The Very Best of Johnny Mathis | Johnny Mathis | | 1 |
| 2012 | The Sweetheart Tree / The Shadow of Your Smile | Johnny Mathis | | 1 |
| 2012 | This Is Love / Olé | Johnny Mathis | | 1 |
| 2012 | So Nice / Johnny Mathis Sings | Johnny Mathis | | 1 |
| 2013 | Seven Classic Albums | Johnny Mathis | | 1 |
| 2014 | The Classic Christmas Album | Johnny Mathis | | 2 |
| 2014 | The Complete Global Albums Collection | Johnny Mathis | | 1 |
| 2014 | Misty 101: The Best of Johnny Mathis | Johnny Mathis | | 1 |
| 2014 | The Real... Johnny Mathis | Johnny Mathis | | 1 |
| 2015 | The Singles | Johnny Mathis | | 2 |
| 2015 | You Light Up My Life / Mathis Magic | Johnny Mathis | | 1 |
| 2015 | Life Is a Song Worth Singing: The Complete Thom Bell Sessions | Johnny Mathis | | 2 |
| 2015 | The Complete Christmas Collection: 1958-2010 | Johnny Mathis | | 1 |
| 2017 | Open Fire, Two Guitars plus Swing Softly | Johnny Mathis | | 1 |
| 2017 | The Voice of Romance: The Columbia Original Album Collection | Johnny Mathis | | 1 |
| 2018 | Close to You / Love Story | Johnny Mathis | | 1 |
| 2019 | Killing Me Softly With Her Song / When Will I See You Again | Johnny Mathis | | 1 |
| 2019 | The Heart of a Woman / Feelings | Johnny Mathis | | 1 |
| 2019 | I Only Have Eyes for You / Hold Me, Thrill Me, Kiss Me | Johnny Mathis | | 1 |
| 2019 | Christmas with Johnny Mathis | Johnny Mathis | | 1 |
| 2020 | Gold | Johnny Mathis | | 1 |
| 2020 | Johnny Mathis - Platinum Selection | Johnny Mathis | | 1 |
| 2021 | The Heart of a Woman / When Will I See You Again / I Only Have Eyes for You / Mathis Is… | Johnny Mathis | | 1 |
| 2021 | People / Give Me Your Love for Christmas / The Impossible Dream / Love Theme From “Romeo and Juliet” (A Time for Us) | Johnny Mathis | | 1 |
| 2021 | You Light Up My Life / That’s What Friends Are For / The Best Days of My Life / Mathis Magic | Johnny Mathis | | 1 |
| 2021 | Up, Up and Away / Love Is Blue / Those Were the Days / Sings the Music of Bert Kaempfert | Johnny Mathis | | 1 |
| — | Legendary Singers: Johnny Mathis: Thirty Favorites | Johnny Mathis | | 1 |
| — | The Great Years | Johnny Mathis | | 1 |
