Many plants considered to be non-native are classified as invasive weeds, which need to be removed to prevent their proliferation and degradation of the environment.
Surprisingly, they have not been banned by authorities and are available to buy in plant nurseries.
Examples of these are English ivy, honeysuckle, gazania, agapanthus.
Would you knowingly buy these sorts of plants and put them in your garden because you like them?