Actually, depending on the year, there is a check valve. My 98 has one as did the 97 I had.
But the most likely candidate for the problem is a leak. Get a vacuum gauge form NAPA or any where and go hunting for it. Personally, I like to start at the manifold and work my way back with the caveat that on XJs I look at the reservoir connection first. Time and temperature tend to "cook" out the elastomers in the rubber allowing each connector to release it's hold on the device or line it is connected to. Easy to repair, just take a little time.
In my case, the reservoir on the 98 had micro-fractures in it. I gave it a coating of fibreglass cloth (one wrap of 2oz cloth) and picked up 2" of mercury for the effort. This, after replacing the connector at the reservoir.