I inherited a fixed non qualified annuity. I have been taking yearly minimums,?

but would like to take more out.Is there a penalty I need to account for or should I just have my normal tax rate withheld. I don't really have a personal tax advisor, and the insurance company and bank say they cannot advise on tax related issues. No estate taxes involved due to the size of the inheritance.