LLMs Are Already Good Tutors: Training-Free Prompt Optimization for Pedagogical Math Tutoring

Aligning LLMs for math tutoring typically requires RL-based training with multi-GPU infrastructure. We investigate whether training-free prompt optimization-evolving only the system prompt via API calls-can serve as a practical alternative. We adapt 7 published methods and propose 5 education-specia...