Yes, the countries you assign tax rates to must have markets created in your Shopify admin.