As businesses head into 2025, the pace of technological change shows no signs of slowing. At Dufrain, we’ve worked with organisations across industries, helping them harness data and AI for transformative growth. This unique perspective gives us a front-row seat to emerging trends that will shape the year ahead. From the rise of proprietary AI models to the evolution of data platforms like Microsoft Fabric, we explore the key shifts that will define 2025.
Written by Dufrainians who live and breathe data every day, this is our expert take on what’s next – and how businesses can prepare to stay ahead.
1. AI: The Rise of Proprietary Models and Responsible AI
Proprietary models will rise to the fore and unlock deep, verticalised business benefits. The reliance on general-purpose model usage has propelled many into the world of AI but the next iteration is the development of private LLMs trained on internal datasets. These internally trained and developed LLMs will answer a lot of privacy related queries but also improve operational efficiencies with high accuracy insights and reporting across their domain-specific data.
Responsible AI and Governance Frameworks will start to be engrained into organisations Data Strategies, products and development lifecycles. We have seen businesses implement AI ethics policies and quick frameworks to apply controls on how employees leverage AI, but we will see this increase in oversight. Platforms and frameworks for AI observability, privacy controls and overall management will be brought in to regulate powerful AI systems to provide transparency across all the business functions using AI.
Human and AI synergy will continue to grow through Virtual Workforces, powered by AI Agents. As models become more refined, the opportunity for businesses to leverage deep vertical AI solutions to augment their physical, human workforce, will drive efficiencies and cost savings across the business. The human will always remain integral but with powerful AI assistants to boost performance and overall company revenue.
Sustainability and AI will be a prominent feature of 2025 as business look to adopt new and exciting technology through Infrastructure Development. With its introduction, it also brings the requirement for companies to modernise their technology stack to take maximal advantage of AI. New hardware, cloud services and skills will all be pertinent to the success businesses get. Major benefits will be realised through reduced legal, commercial and social pressures to improve sustainability by reducing organisations carbon footprints of legacy infrastructure.
2. Data Management: AI-Driven Quality, Governance, and Innovation
AI will be truly integrated into data management – harnessing AI to enable better data quality (DQ) management
Data lineage is finally becoming easier to understand and capture in a largely automated way, though there is still work required in this space. Agentic AI will be able to utilise good quality metadata regarding the lineage of the data, combining this with historic data, and global data quality rules to inform on both potential quality rules / controls going forward along with flagging potential DQ errors without needing traditional controls being pre-built.
Data governance will be further enhanced to successfully and ethically govern AI and the newly expanding agentic layer
The agentic AI layer will form a new layer across the data landscape, this needs governing from a security, privacy, ethical, quality and transparency perspective. Structured data management and unstructured data management implementations need to work harmoniously as more and more AI use cases incorporate both structured and unstructured data.
Data governance and management processes and controls will mature to govern and manage both data fabric and data mesh implementations
Data mesh requires tweaks and enhancements to legacy data governance and management implementations and ways of working. Most data mesh implementations are still at a low level of maturity with some aspects working well whilst work is still being undertaken to truly define and embed the process and controls and ways of working. Tooling will be enhanced to better meets the data mesh data management ways of working.
3. Modern Data Platforms and Real-Time Insights: The Next Frontier
Fabric will shift to becoming a leader in the modern data platform space.
Microsoft Fabric is set to redefine the modern data landscape, seamlessly integrating tools, processes, and data at scale. Its unified approach to analytics, governance, and collaboration positions it as a one-stop shop for organisations looking to simplify complexity. Think of it as the Swiss Army knife for data professionals – combining versatility, power, and elegance in one platform. As adoption grows, Fabric is likely to set a new benchmark for what a modern data platform should deliver.
Real-time analytics will finally become something achievable for all organisations.
The dream of harnessing real-time data insights is no longer reserved for tech giants or specialised industries. Innovations in tools, infrastructure, and processing capabilities are democratising real-time analytics, making it accessible even to organisations with modest budgets or resources. It’s akin to moving from snail mail to instant messaging – decisions can now be informed in the moment, reshaping industries from retail to healthcare with speed and precision.
Co-pilot will become ubiquitous and will start to lean heavily on Data Engineering to feed it.
The rise of Co-pilot represents a fundamental shift in how organisations leverage AI, embedding intelligence into day-to-day operations. But like any engine, it’s only as good as the fuel it runs on – and that’s where data engineering comes in. Structured, high-quality data pipelines will be critical to unlocking Co-pilot’s full potential. Picture Co-pilot as a Michelin-star chef: its brilliance depends on the quality and preparation of the ingredients supplied.
Data engineers will play a pivotal role in setting this table for success. This is just the beginning. In the coming weeks, we’ll be diving deeper into industry-specific trends, exploring how data and AI are shaping sectors like banking, insurance. Keep an eye out, we’ll share actionable insights and tailored strategies to help businesses gain advantage.
Want to stay ahead of the curve with the latest Data & AI trends? Sign up for our LinkedIn Data Dive newsletter for frequent insights.
If you missed the latest trends in BI, Dive into our Business customer intelligence page where you can discover how to optimise, migrate and choose the right tools for your business.