I just did the same thing with my 95 yj. I have the 4 banger though. Anyhow I put on the new starter and left my friends place and made 2 more stops. Then when I went ot leave I turned the key and the starter never shut off I unhooked the batter. Then I took all of the wires off of the starter and tightend them down again and it has been ok for about 5 days now.