Do I need to remove the buttstock to take out the take down lever?

yes. there is a little screw on the end of the lower that holds it captive.