Ward's brother, Bryant, is an assistant baseball coach at UCLA. His sister, Mary Kate, is a graduate of East Carolina University.
Born and raised in Greenville, North Carolina, James Harvey Ward graduated from the University of North Carolina-Wilmington and later from the American Academy of Dramatic Arts (New York). He is a Lifetime Member of The Actors Studio and a co-founder of the Wooden Indian Theatre Company (New York).