NeuroProlog Applies Multi-Task Fine-Tuning to Neurosymbolic Math Reasoning
A revised arXiv paper introduces NeuroProlog, a neurosymbolic approach that pairs language models with symbolic reasoning to improve mathematical problem solving. The authors use multi-task fine-tuning and describe a "cocktail effect," where combining several training tasks yields better results than training on them individually. The work targets a known weakness in LLMs, which often produce fluent but logically inconsistent math solutions.