And that's not the end of the poor retirement diagnosis: 48 percent aren't maxing out their contributions to a qualified workplace plan, such as a 403(b) retirement savings plan.

Female physicians are lagging the crowd worse than males, too; 58 percent aren't hitting the max, compared with 45 percent of their male counterparts.

And overall, 71 percent are not contributing to a nonqualified retirement plan, such as a 457(b).

According to Fidelity's Money FIT Physicians Study, 45 percent of physicians feel they can't afford to max out their workplace retirement plan.

This is despite the fact that doctors are in one of the most highly compensated professions—Fidelity data indicate that physicians earn an average of $300,000 per year.

Read: 4 ways of view risk–Americans and retirement saving

But, to give them their due, they also carry a heavy student debt load.

Industry research indicates that 84 percent of medical students graduate with student debt averaging more than $176,000. And then there are the costs of getting a practice up and running—not cheap either.

They may know their way around an operating room, but finances? Not so much.

The study also found that 61 percent of physicians are at least a little confused about how to navigate their financial path for the future.

Not that they're taking advantage of workplace retirement guidance; just 21 percent utilize this resource. And that's an improvement over 2012, when just 17 percent reported doing so.

Why not? They say they don't have the time. But if they don't make time they'll be in the same boat as other unprepared workers—not ready for retirement.