IMO, that is a silly and unfair idea, but it can be done properly. A congestion tax has been in operation in 'the city' in London almost since I was born.
https://www.citymetric.com/transport...change-it-3751
But we must remember that this tax (between £10.50 and £14.00 for each time) only applies to central London (not the whole city), and only applies between 7am and 6pm. And it works well because London has one of the best public transport systems in the world (so you can easily take the train or the bus into and across the city).
It would be unfair in an area without good public transport.