Filing When You Have Mixed Income: Pension, Social Security, Part-Time Work, and IRA Withdrawals

Many retirees draw from multiple income streams at once - a pension, Social Security, some part-time work, and withdrawals from a retirement account. Each of these sources is treated differently for federal tax purposes, and when they combine, the total can affect how much tax you owe in ways that are not always obvious. This guide explains how each type of income is handled and how they interact when they all land in the same tax year.

How Is Each Type of Retirement Income Taxed?

Each income source in retirement follows its own tax rules. Pension payments and traditional IRA or 401(k) withdrawals are generally fully taxable as ordinary income. Social Security may be 0% to 85% taxable depending on your combined income. Roth IRA withdrawals are typically tax-free. Part-time wages are taxed as ordinary income and also subject to payroll taxes.

Income Type	How It's Taxed
Pension payments	Generally fully taxable as ordinary income if contributions were made pre-tax. Some pensions may be partially tax-free if you made after-tax contributions.
Social Security	0% to 85% may be taxable depending on your combined income. See the Social Security tax guide for details.
Traditional IRA / 401(k) withdrawals	Fully taxable as ordinary income. Withdrawals from certain accounts may affect your adjusted gross income for the year, depending on the account type and your tax situation.
Roth IRA withdrawals	Some qualified distributions — such as those from Roth accounts — can be tax-free and won't add to your AGI. However, most qualified distributions from traditional retirement accounts are still subject to income tax and do count toward your AGI.
Part-time wages	Taxable as ordinary income. Also subject to payroll taxes (Social Security and Medicare) unless you are working as an independent contractor, in which case self-employment tax applies.
Interest and dividends	Ordinary dividends and bank interest are taxable as ordinary income. Qualified dividends and long-term capital gains are generally taxed at lower rates (0%, 15%, or 20% depending on your total income).
Rental income	Net rental income is generally taxable. Allowable expenses (repairs, depreciation, insurance) can offset gross rental receipts.

How Does It All Add Up?

The IRS combines all your retirement income sources into your Adjusted Gross Income (AGI). That single number determines your tax bracket, how much of your Social Security is taxable, and whether you'll owe Medicare surcharges. Adding one income stream — even a one-time IRA withdrawal — can trigger consequences across the others in ways that aren't always obvious until tax time.

When you have multiple income sources, the IRS stacks them all together to determine your adjusted gross income (AGI). Your AGI is the starting point for several calculations: it determines your tax bracket, it feeds into the Social Security combined income formula, and it affects whether you owe Medicare surcharges known as IRMAA (Income-Related Monthly Adjustment Amount).

This stacking effect means that adding one income source can trigger consequences for another. For example, taking a larger IRA distribution in one year to cover a major expense can push your combined income above the threshold where more of your Social Security becomes taxable. It can also bump your Medicare premiums for the following year if it crosses an IRMAA income tier.

The IRMAA Ripple Effect

IRMAA is worth understanding if your income is in a moderate-to-high range. Medicare Part B and Part D premiums are set by default, but if your income from two years prior exceeds certain thresholds, you pay a surcharge on top of the standard premium. The thresholds are based on your Modified Adjusted Gross Income (MAGI), and large IRA withdrawals, RMDs, or a one-time event like selling a home or receiving an inheritance can push you into a higher tier for the following two years.

If a one-time income event caused your IRMAA to increase and your income has since returned to a lower level, you can appeal the surcharge through the Social Security Administration using Form SSA-44. This is worth knowing if your situation changed.

Withholding and Quarterly Payments

Unlike a paycheck where taxes are withheld automatically, most retirement income streams require you to either request withholding or make quarterly estimated tax payments yourself. Pension payers usually let you elect withholding on Form W-4P. For IRA distributions, custodians withhold a default 10% federal income tax, but you can choose a different rate (anywhere from 0% to 100%) using Form W-4R. For 401(k) distributions that are not directly rolled over, a mandatory 20% federal income tax withholding applies, and you cannot choose a lower rate. Part-time wages have normal withholding through your employer.

You may be able to elect federal tax withholding from your Social Security benefits by submitting a withholding form to the Social Security Administration. Please check with SSA or a tax professional for the current withholding rate options available.

If you find you are consistently owing money at tax time or are unsure whether enough is being withheld across all your sources, The IRS offers a free Tax Withholding Estimator tool on its website that may help you estimate your tax liability and check whether your withholding is on track.

Forms to Expect Each Year

When tax season arrives, look for these documents from each income source:

• Form 1099-R - reports distributions from pensions, IRAs, and 401(k)s
• Form SSA-1099 - reports your Social Security benefits for the year
• Form W-2 - reports wages from part-time employment
• Form 1099-INT - reports bank interest
• Form 1099-DIV - reports dividends from investments
• Schedule K-1 - if you have income from a partnership, trust, or S corporation

Keeping these in one place as they arrive in January and February makes filing much smoother - and helps you catch if any are missing before the deadline.