Are you passionate about the latest in #AI? Here's your chance to shine!
Join the #InfoQ Annual Article Writing Competition!
Win a #FreeTicket to #QCon or #InfoQDevSummit!
Submit by March 30, 2025: https://bit.ly/417KPtk
Which AI topic are you most excited to explore?
Explore topics like #LLMs, #SLMs, #vLLMs, #GenAI, #VectorDatabases, #ExplainableAI, #RAG, and more!
The Big Power of Small #AI in 2025
An IBM VP explains how small language models are a boon for companies of all sizes, enabling them to overcome resource and budget constraints to tap into the business value of AI.
MIT names 10 breakthrough technologies to watch in 2025
https://bgr.com/tech/mit-names-10-breakthrough-technologies-to-watch-in-2025/
"To prevent AI models from memorizing their input, we know exactly one robust method: differential privacy (DP). But crucially, DP requires you to precisely define what you want to protect. For example, to protect individual people, you must know which piece of data comes from which person in your dataset. If you have a dataset with identifiers, that's easy. If you want to use a humongous pile of data crawled from the open Web, that's not just hard: that's fundamentally impossible.
In practice, this means that for massive AI models, you can't really protect the massive pile of training data. This probably doesn't matter to you: chances are, you can't afford to train one from scratch anyway. But you may want to use sensitive data to fine-tune them, so they can perform better on some task. There, you may be able to use DP to mitigate the memorization risks on your sensitive data.
This still requires you to be OK with the inherent risk of the off-the-shelf LLMs, whose privacy and compliance story boils down to "everyone else is doing it, so it's probably fine?".
To avoid this last problem, and get robust protection, and probably get better results… Why not train a reasonably-sized model entirely on data that you fully understand instead?"
Small language models: 10 Breakthrough Technologies 2025
Large language models unleashed the power of AI. Now it’s time for more efficient AIs to take over.
"Rather than building massive, complex large language models, many organizations choose smaller language models that focus on niche applications such as supply chain management or inventory control. This is the “lean AI” concept, and it entails purpose-built models able to deliver value without the high costs and complexity associated with larger systems, according to Linthicum.
“We have Agentic AI and certainly using things like small language models where we’re leveraging generative AI and AI in general for more tactical implementation,” he said. “It’s dealing with supply chain integration, dealing with inventory control. We’re not building LLMs, and I don’t think the businesses out there are going to get the value from building huge LLMs that they think they’re going to get.”"
https://siliconangle.com/2024/12/31/gen-ai-hype-analyzing-tactical-cio-approach-cubeconversations/
Dives into the world of #GenerativeAI & #SmallLanguageModels - #SLMs!
"So latest trend in the language model evolution are the small language models or SLMs that offer many of the same benefits as LLMs, but they're smaller in size, they're trained using smaller data sets and they don't require a lot of computing resources." - Namee Oberst, Co-Founder of LLMWare
Listen now: https://bit.ly/4f9M5Sz
