Hot AI

SQuaD-SQL: Efficient Text-to-SQL with Small Language Models via LLM-Guided Knowledge Distillation

AI·SQuaD-SQL uses LLM-guided synthetic data and LoRA fine-tuning to train 1.5B-parameter SLMs to reach 86.9% execution accuracy on WikiSQL, matching large models while requiring only one consumer GPU and delivering faster, lower-memory inference.

arXiv cs.CL·arxiv.org·23h ago·1.6Researchtext-to-sql small-language-models knowledge-distillation