Stored memories may be drawn upon when accomplishing goals. In two experiments, we investigated limits on the ability to use episodic memories to support planning in 3- and 4-year-old children. We designed a new memory-guided planning task that required children to both retrieve memories and apply those memories to accomplish multiple, nested goals. We manipulated the difficulty of the task by varying the number of steps required to achieve the goals, and examined the impact of this manipulation on both memory retrieval and planning. We found that, overall, 4-year-olds outperformed 3-year-olds, but as task difficulty increased, all children made more errors. Analysis of these errors suggested that retrieval and planning processes might impose separate limits on memory-guided planning in early childhood, but that these limits may ease across early childhood.