Xiang Zhang, Khatoon Khedri, Reza Rawassizadeh
We have not lifted any functions out of this paper's repositories yet, so there is nothing we have run. The repositories linked to it are listed below.
Some links come from the archived Papers with Code dataset (CC BY-SA 4.0): attribution and licence.
Large Language Models (LLMs) can automate or substitute different types of tasks in the software engineering process. This study evaluates the resource utilization and accuracy of LLM in interpreting and executing natural language queries against traditional SQL within relational database management systems. We empirically examine the resource utilization and accuracy of nine LLMs varying from 7 to 34 Billion parameters, including Llama2 7B, Llama2 13B, Mistral, Mixtral, Optimus-7B, SUS-chat-34B, platypus-yi-34b, NeuralHermes-2.5-Mistral-7B and Starling-LM-7B-alpha, using a small transaction dataset. Our findings indicate that using LLMs for database queries incurs significant energy overhead (even small and quantized models), making it an environmentally unfriendly approach. Therefore, we advise against replacing relational databases with LLMs due to their substantial resource utilization.
The same record, over MCP at https://syntology.ai/mcp:
get_harvested_code_for_paper("2404.08727")
get_code_for_paper("2404.08727")
have("2404.08727")
The run record, dated, one paper per request, free:
curl https://syntology.ai/api/ran/2404.08727.json
A badge for a README (the split and the date, never a ratio):
[](https://syntology.ai/paper/2404.08727)
Connect an agent — have() is free.