Before radial tires became popular typical caster settings were in the range from 1/2 to 2 1/2 degrees. Toe-in settings at 1/16" to 1/4" inch.
Radial tires flex and steer easier, allowing more caster without giving the driver (or the power steering pump) a workout. Typical settings are now 4-8 degrees. Toe-in at 0" to 1/16" inch.
Power steering allows more caster, and manual steering less caster. Dialing in caster results in more steering effort to overcome the self centering effect of caster or kingpin rake, and additonal caster places more load on the suspension components due to the forces involved (why it feels harder to steer).
Toe-in also adds self steering effect, similar to caster, and non-radial tire set-ups ran less caster and more toe-in. Radials use more caster and less toe-in.
What is too little caster? When the steering is so light it wanders and fails to self center the steering.
What is too much caster? When the steering is heavy and sluggish to drive with excessive steering effort.
Variable assist (speed sensitive, slow at high speed) power steering cars run around 8-degrees, and variable rate (slow at center position) power steering cars run around 4 degrees.
Zero degrees is too little caster, most power steering vehicles with radials run 4 degrees or more of caster.
Caster is a tuning tool, to trade straight-line stability for steering effort. The stability comes at the price of added force on the steering system and pump, and the same forces transmitted into steering effort (with the power steering boost reducing the impact on the driver directly). Even if you as a driver do not feel the forces of excessive caster, the suspension components and bushings still have to resist the effort.