Trying to choose a lender can be a difficult task. Start by asking for referrals from friends, family, neighbors and your real estate agent. If you are building, ask the builder for a referral, since most are willing to help you find financing. Find out what kind of rates the lender offers and the terms of the loan, especially on adjustable rate mortgages (ARM). Find out what their "junk" fees are.