The country's foreign minister says Japanese firms are worried about the "negative impact" of a no-deal.