Members of a dining club with private access to David Cameron and other Cabinet ministers have given £43 million to the Conservatives in just two years.