Spy accused Chinese businessman was invited to Buckingham Palace by duke