Brigadier General Philip Sherman was born in Baltimore, the son of Abe Sherman, a civic figure and hero of two World Wars (Silver Star) and Ann Sherman, a homemaker. He was educated in Baltimore, graduating from Polytechnic Institute in 1945. General Sherman joined the National Guard in 1944 at age 17 and over the next 43 years held numerous command and staff assignments. He retired as  Colonel.  He also served for one year with the Signal Corps in the U.S. Army. He joined the Maryland Defense Force and rose to the rank of Brigadier General. He received many awards and commendations of Defense Joint Service Commendation Medal, Selective Service Distinguished Service Award, and the Maryland Distinguished Services Cross with oak leaf cluster. 

Brigadier General Philip Sherman graduated from the University of Baltimore Law School in 1953 and was admitted to the Maryland Bar in 1955. He had a long and distinguished legal career, maintaining a general law practice in the Blaustein Building. General Sherman was an active member of the Maryland Military Monuments Commission. He was active both in the Baltimore Bar Association and Maryland State Bar Association. He was a founder of the Museum of Baltimore Legal History. He had also served as an Inquiry Panel member of the Attorney Grievance Commission. He served as the historian of the Maryland State Bar Association and as a member of the Centennial Committee.