Several recent studies have reported enhanced memory when retrieval is preceded by repetitive horizontal eye movements, relative to vertical or no eye movements. The reported memory boost has been referred to as the Saccade-Induced Retrieval Enhancement (SIRE) effect. Across two experiments, memory performance was compared following repetitive horizontal or vertical eye movements, as well as following a control condition of no eye movements. In Experiment 1, we conceptually replicated Christman and colleagues’ seminal study, finding a statistically significant SIRE effect, albeit with weak Bayesian evidence. We therefore sought to conduct another close extension. In Experiment 2, horizontal and vertical eye movement conditions were manipulated separately, and sample size was increased. No evidence of a SIRE effect was found: Bayesian statistical analyses demonstrated significant evidence for a null effect. Taken together, these experiments suggest that the SIRE effect is inconsistent. The current experiments call into question the generalizability of the SIRE effect and suggest that its presence is very sensitive to experimental design. Future work should further assess the robustness of the effect before exploring related theories or underlying mechanisms.