Real-time Analytics with Fabric

09:00AM – 05:00PM, THURSDAY 13TH

About the Training day

The velocity of data is getting faster across many industries, fuelled by the business demand to gain insights and value from sources in near real-time. This necessity is then allowing decision makers to pivot and ultimately stay ahead of the competition. Furthermore, the growth of the internet of things and ‘smart’ devices now means the volume of that high velocity data has exploded. Meeting this demand requires new concepts and new designs for data/solution architects, with high throughput ingestion endpoints and query stream tools that can perform aggregations ‘on the fly’.

In this full day of training, we will address the above requirements head on. Discussing and designing architectures that can scale and burst for high throughput events. Querying using both SQL and KQL to blend stream and batch data feeds for downstream reporting. Our unified tool of choice to deliver these capabilities will be Microsoft Fabric. Working with Event Stream and Kusto items to deliver a real-time analytics solution.

Breakdown

• The theory and history behind lambda and kappa architecture design patterns.
• The role of structured and semi-structured data as part of streaming solution.
• How technology has evolved to simplify our designs when handling data at any velocity.
• What ingestion resources are needed for both batch and stream data handling.
• How to combine batch and stream datasets into a comprehensive data model, supporting the serving of both source input types.
• Aggregating streaming datasets using sliding, hoping, and tumbling compute windows.
• How to create a common serving endpoint for business users.
• Building a connected solution in Microsoft Fabric.

Modules

1. Architecture, context, and tooling. Microsoft Fabric vs Microsoft Azure.
2. Creating a real-time data source.
3. Handling messages with a Fabric Event Stream.
4. Querying Event Streams via Kusto and Lakehouse artifacts.
5. Consuming real-time data in Power BI.
6. Using Data Activator to action data streams.

Co-Founder & CTO of Cloud Formations | Microsoft MVP

Paul Andrew

Paul (AKA @mrpaulandrew) is the Founder & CTO of Cloud Formations, a specialist data consultancy based in the UK. With nearly 20 years’ experience designing and delivering Microsoft data architectures, Paul leads a passionate team of engineers, supporting businesses small and large with scalable cloud platforms. Business value delivered through data insights. Over the years, Paul has covered the breadth and depth of design patterns and industry leading concepts, including Lambda, Kappa, Delta Lake, Data Mesh and Data Fabric.

Paul is also a Microsoft Data Platform MVP, organiser for the Data Relay community conference, East Midlands user group leader, book author and mentor. In addition to the day job(s), Paul is a father of three, husband, foodie, runner, blood donor, geek, Lego, and Star Wars fan! Lastly, Paul confesses to enjoying a Ramstein playlist when given half a chance to do some coding for a customer project.