You have to loosen up the whole driveway and grade it out again. The stuff you put in the holes gets pushed out again because the surrounding stuff is packed. You have to unpack the whole lot, grade it and then repack it.
They had heard of the DR Graders from other friends, easy to use, did a good job fixing potholes, so they each purchased one. With extremely long driveways, having them full of potholes can be expensive on your vehicle maintenance, slows you down going in or out, will make a bad loader out of your horse getting a terrible ride in the trailer.
They say the DR grader is easy to run on a weekend, keeps the surfaces in good shape, smooths out the lumps and holes quickly on just one pass. Easier than running the blade on the tractor down the driveway, leaves a better surface and less work needed.
Might be worth going to see one in action, or have them come demo one at your house, to decide if it would work for you.
This is funny, what was it, a month ago that someone wanted to know how to ADD potholes/bumps to slow people down on the driveway? Yes, you need to grade it or the rock just comes back out. I would start calling around and see if anyone around has one that can come and do it, or even is friendly with the local Township road people, oftentimes if you grease the wheels right they can be persuaded to make a detour down a driveway if they're in the area with the grader.
If push comes to shove you *can* do it with the bucket of a larger tractor after a very heavy rain, but it's nowhere near as nice.
As you are grading your driveway, make sure that you allow for a crown or slope to the drive, so that when it rains again the water will get off the drive . If the drive way drains correctly your grading work will last longer.
Box Blade or in a pinch we have the skid loader w/ blade scrape whole drive, break down center crown and usually the holes level out.
Where we keep getting them in same place year after year we have checked for run off to divert water from pooling and in some cases dug the hole out and rebuilt it w/ new base.