On Device AI Assistant: Revolutionizing Real-Time API Interactions with Privacy Preserving Intelligence

Short description of the innovation study

Our innovation study focuses on developing an AI-powered API Agent that goes beyond traditional chat-based AI platforms to actively perform tasks. Instead of just answering questions, it will interact with online services via APIs to book trips, manage schedules, and automate workflows.  The goal is to create an action-oriented AI assistant capable of understanding complex requests, reasoning through multi-step interactions, and adapting to real-world conditions. Designed for seamless integration across platforms, including mobile devices and automobiles, it will provide personalised, hands-free assistance.  Key challenges include precise API execution, multi-turn interactions, and state-aware decision-making powered by LLMs, ensuring efficiency and security.  For development, we enhance open-source models like DeepSeek, LLaMA, and Phi using synthetic data generation, knowledge distillation, and validation to build an adaptive, high-performance API Agent, setting a new standard in AI-driven automation.

Organisations involved: 

End User: ArtificaX Technologies

HPC provider: Barcelona Supercomputing Center

Technology expert: Turkcell Global Bilgi