If you decide to borrow from your cash value, be aware that you will have to repay the loan or pay a penalty. Some whole life policies also allow you to borrow or withdraw from the cash value, but any outstanding loan balance will reduce the death benefit your beneficiaries receive.