Filing When You Have Mixed Income: Pension, Social Security, Part-Time Work, and IRA Withdrawals

Many retirees draw from multiple income streams at once - a pension, Social Security, some part-time work, and withdrawals from a retirement account. Each of these sources is treated differently for federal tax purposes, and when they combine, the total can affect how much tax you owe in ways that are not always obvious. This guide explains how each type of income is handled and how they interact when they all land in the same tax year.

How Each Income Type Is Taxed

Income Type	How It's Taxed
Pension payments	Generally fully taxable as ordinary income if contributions were made pre-tax. Some pensions may be partially tax-free if you made after-tax contributions.
Social Security	0% to 85% may be taxable depending on your combined income. See the Social Security tax guide for details.
Traditional IRA / 401(k) withdrawals	Fully taxable as ordinary income. Each dollar withdrawn adds to your AGI for the year.
Roth IRA withdrawals	Qualified distributions are tax-free and do not add to your AGI - a key planning advantage.
Part-time wages	Taxable as ordinary income. Also subject to payroll taxes (Social Security and Medicare) unless you are working as an independent contractor, in which case self-employment tax applies.
Interest and dividends	Ordinary dividends and bank interest are taxable as ordinary income. Qualified dividends and long-term capital gains are generally taxed at lower rates (0%, 15%, or 20% depending on your total income).
Rental income	Net rental income is generally taxable. Allowable expenses (repairs, depreciation, insurance) can offset gross rental receipts.

How It All Adds Up

When you have multiple income sources, the IRS stacks them all together to determine your adjusted gross income (AGI). Your AGI is the starting point for several calculations: it determines your tax bracket, it feeds into the Social Security combined income formula, and it affects whether you owe Medicare surcharges known as IRMAA (Income-Related Monthly Adjustment Amount).

This stacking effect means that adding one income source can trigger consequences for another. For example, taking a larger IRA distribution in one year to cover a major expense can push your combined income above the threshold where more of your Social Security becomes taxable. It can also bump your Medicare premiums for the following year if it crosses an IRMAA income tier.

The IRMAA Ripple Effect

IRMAA is worth understanding if your income is in a moderate-to-high range. Medicare Part B and Part D premiums are set by default, but if your income from two years prior exceeds certain thresholds, you pay a surcharge on top of the standard premium. The thresholds are based on your Modified Adjusted Gross Income (MAGI), and large IRA withdrawals, RMDs, or a one-time event like selling a home or receiving an inheritance can push you into a higher tier for the following two years.

If a one-time income event caused your IRMAA to increase and your income has since returned to a lower level, you can appeal the surcharge through the Social Security Administration using Form SSA-44. This is worth knowing if your situation changed.

Withholding and Quarterly Payments

Unlike a paycheck where taxes are withheld automatically, most retirement income streams require you to either request withholding or make quarterly estimated tax payments yourself. Pension payers usually let you elect withholding on Form W-4P. IRA and 401(k) custodians withhold a default 10% unless you choose otherwise, though you can request a higher or lower rate or opt out. Part-time wages have normal withholding through your employer.

Social Security withholding can be elected on Form W-4V, choosing a rate of 7%, 10%, 12%, or 22%.

If you find you are consistently owing money at tax time or are unsure whether enough is being withheld across all your sources, the IRS Tax Withholding Estimator (linked below) is a useful free tool for estimating your total liability and checking whether your withholding is on track.

Forms to Expect Each Year

When tax season arrives, look for these documents from each income source:

• Form 1099-R - reports distributions from pensions, IRAs, and 401(k)s
• Form SSA-1099 - reports your Social Security benefits for the year
• Form W-2 - reports wages from part-time employment
• Form 1099-INT - reports bank interest
• Form 1099-DIV - reports dividends from investments
• Schedule K-1 - if you have income from a partnership, trust, or S corporation

Keeping these in one place as they arrive in January and February makes filing much smoother - and helps you catch if any are missing before the deadline.