Richard Carpenter sat for more than 100 hours of exclusive interviews and provided some 200 photographs from his personal archive