Really, call the cam manufacturer. Few people know more about stuff then the people that make it.
With out knowing that much about the motor. I would go to the safe side and say yes. Replace with at least good stockers if the Cam Man don't call for better.
Comp Cams actually doesn't know much about the 4.0l engine. The kit for that cam comes with springs for a 4.2 head, even though it is said to work on the 4.0L head. They have been notified about that several times and refuse to offer a spring option for the 4.0L head. One person called and Comp's solution was just to grind a cam to work with the stock springs.