No, I wouldn't do this.
Considering the amount spent for CRT, I would want to savor every moment and not rush through. I agree with the PP that said to allow 90 minutes for this experience, and then you've got to factor in getting from the middle of the park over to Adventureland and potential wait time to be seated.
For what it is worth, POTC lines are really manageable without a fast pass. Right now, there is a 15 minute wait during what is normally a busy time of day.