Current Li-ion batteries have numerous issues, but fortunately there are several alternatives too. Bringing a new battery chemistry to production scale hasn’t been easy, but we’re taking small steps like that every year.
We may still need lithium, nickel or manganese in the near future, but the demand for cobalt (per cell) has been decreasing gradually. Who knows which alternative ends up dominating the market after a few decades
Charging infrastructure is another huge bottle neck. I don’t have a charging station anywhere near my home, so even if I had an EV, I wouldn’t be able to charge it anywhere.
Then there’s also the grid. If everyone were to plug in their EVs in the afternoon, that would overload the grid beyond its capacity.