San Diego, USA – October 25, 2024 – Qualcomm Technologies has announced a strategic collaboration with Meta and Ollama to enhance the on-device AI capabilities using improved quantized models of Llama 3.2. This partnership is a great leap in closing the gap in the application of powerful AI technologies in ordinary day to day tasks.
The newly optimized models are even capable of achieving an improvement in performance metrics, with processing speed reaching 2 to 3 times faster, and a model size as well as memory requirement that is reduced by 60% at most. Such advancements are of great importance in areas such as knowledge retrieval, summarisation, and instruction following tasks where the models perform better than the currently used ones.
The focus of the integration is for use with the Snapdragon X Elite and Snapdragon X Plus processors, allowing developers to incorporate this model into their applications through Ollama. This optimization addresses specifically AI PCs and enhances the already existing architecture for next-generation computing experiences.
This alliance is a cause for celebration for there is hope for the latest technologies to be made available to more and more people while maintaining efficient resource utilization. The collaboration between the companies also underscores their commitment to pushing the limits of what’s possible with on-device AI.
New possibilities arise for developers, especially in adding capabilities like RAG (Retrieval-Augmented Generation) and Function calling, as seen in the initiative. The strategies are expected to improve the overall experience across various applications without losing the high efficiency of the Snapdragon X series compute platforms.
This is an important step in the evolution of on-device AI technology, setting new standards for performance and efficiency in mobile computing applications.
Latest Stories:
Capgemini Restructures Leadership with Key Appointments
Salesforce Integrates AI in Manufacturing for Better Asset Tracking
Infosys Unveils AI Innovation Hub with Meta to Drive Open-Source Growth
What is your reaction?
