The whole point of a pardon is “we know you did the crime, but don’t think you should be punished.” It can only come about if there’s an ulterior motive, like corruption or if you agree to work with the government towards their goals, initially working on dangerous projects etc. Allowing it to be overturned later would undermine that as it wouldn’t make the danger worth it.