Liquid Foundation Models (LFM 2) define a new class of small language models designed to deliver strong reasoning and instruction-following capabilities directly on edge devices. Unlike large cloud-centric LLMs, LFM 2 focuses on efficiency, low latency, and memory awareness while still maintaining competitive performance. This design makes it a compelling choice for applications on mobile […]
The post Preference Fine-Tuning LFM 2 Using DPO appeared first on Analytics Vidhya.
from Analytics Vidhya https://ift.tt/jcQZTDl
Tags:
Analytics Vidhya