We demonstrate what we believe to be a novel tunable IR optical parametric amplifier (OPA) with the passively stabilized carrier-envelope phase (CEP), in which a hollow fiber is used to improve the output beam quality and to overcome the spatial chirp issue. Pumped by an 800 nm pump source, the output pulses are tunable from 1.2 to $2.4\mu \text{m}$ with the CEP stabilization. The maximum output average energy can reach $\sim \left(1.2\text{\hspace{0.17em} W}/40\text{\hspace{0.17em} fs}\right)/1\text{\hspace{0.17em} kHz}$ with the total of (6.8 W/40 fs)/1 kHz pump energy. Further, the high-order harmonic generation driven by the tunable phase-stabilized OPA has been demonstrated.