The onetime underground rocker played for the assembled dignitaries, politicians and guests who enjoyed “Sweet Jane” as their after dinner treat