The singer’s former business manager had one hand in her pocket, admitting that he used the money to feed his gambling habit