Japanese PM Defends Stance On Olympics