Yes, if you're hammering the pin, this job is a pain.
Use a motorcycle chain tool instead (I got one from Hazard Fraught), and replacing the distributor shaft seal becomes an easy job.
OP, you only need to replace that seal if the old seal is allowing oil into the distributor - if it is...