Copper isn't toxic in the way lead is. I tend to think the whole anti-lead thing is being pushed based upon a lot of conjecture and seriously doubt whether even the most vehemently anti-lead individuals really think banning it will lead to an increase in bird species (as it must, if it's currently acting as a massive population suppressant).
However, there is no real equivalence between lead and copper. Lead has no beneficial role to play in human biology, whereas copper does. Harm can be caused by very high levels of copper, but that's true of most things - water toxaemia is a thing. The real issue with lead is how much harm it really does when introduced to the environment from shot and bullets and, where the harm is to human health, whether the choice as to take the risk of harm ought to be left to the individual, as it is with so many other things.
In any event, and to those who love to talk about 'copper toxicity' as a reason not to ban lead, what's the jacket on most rifle bullets made from?!