Skip to main content

Locally Deployable Enterprise Search and Q&A Solution

SECTOR: Digital Transformation
TECHNOLOGY USED: LLM
COUNTRY: Italy

Short description of the innovation study

This project aims to develop a locally deployable AI-based enterprise search and question-answering solution for underserved European languages, particularly Balto-Slavic ones. It will create a secure, scalable, and customisable system that integrates seamlessly with organisations while ensuring data privacy and compliance.

A key focus is fine-tuning large language models such as Llama 3.1 and TildeLM using curated multilingual datasets to enhance accuracy in these languages. The models will be optimised for speed and efficiency in resource-constrained environments. The final system will be evaluated to ensure it meets business needs, delivering a secure, high-performance multilingual information management solution.

 

Organisations involved: 

End User: Tilde