Andrew hated being a Senator’s junior in the constant spotlight