In 1959, McPhail purchased the former Melody Inn at 1122 Bladensburg Road, NE, and renamed it "Jimmy McPhail's Gold Room." The club became a magnet for jazz and R&B talent and remained active through the late 1980s. Ellington called on him for the "Concert of Sacred Music" project, which was recorded in December 1965. Through the 1970s, 80s, and 90s, McPhail was a favorite son of the Duke Ellington Society, and he continued to play international festivals as well as small jazz gigs around D.C., including some at The Departmental Progressive Club of Alexandria, Virginia.
In between his music engagements, McPhail also had a 25-year career with the D.C. Public schools, teaching at Eliot Junior High School for the entirety of his career in education.
He died at age 71, on March 16, 1998, of a heart ailment.