We demonstrate a high-average-power optical parametric amplifier directly pumped by a cavity-dumped Yb:KYW mode-locked laser oscillator at $1\mathrm{MHz}$ repetition rate. The two-stage system uses periodically poled lithium niobate crystals both for optical parametric generation and for power amplification. We obtain average powers as high as $190\mathrm{mW}$ with $220\mathrm{fs}$ average pulse widths and wavelength tunability in the $1.3–1.6\mu \mathrm{m}$ (signal) and $3.1–4.6\mu \mathrm{m}$ (idler) range.