Skip to content

Real-Time Intelligence with Fabric

09:00AM – 05:00PM, THURSDAY 13TH

About the Training day

The velocity of data is getting faster across many industries, fuelled by the business demand to gain insights and value from sources in near real-time. This necessity is then allowing decision makers to pivot and ultimately stay ahead of the competition. Furthermore, the growth of the internet of things and ‘smart’ devices now means the volume of that high velocity data has exploded. Meeting this demand requires new concepts and new designs for data/solution architects, with high throughput ingestion endpoints and query stream tools that can perform aggregations ‘on the fly’. Microsoft Fabric answers this challenges with the Real-time Hub and Real-time Intelligence Experiences, bringing data streams together to rapid handling and serving with a full complement of downstream events to Data Activator, but other Fabric Items as well.

In this full day of training, we will address the above requirements head on. Discussing and designing architectures that can scale and burst for high throughput events. Querying using both SQL and KQL to blend stream and batch data feeds for downstream reporting. Our unified tool of choice to deliver these capabilities will be Microsoft Fabric. Working with Event Streams, Event House, and the Real-time Intelligence Hub to deliver analytics at speed and scale. Building a connected solution in Microsoft Fabric.

Breakdown

  • The theory and history behind lambda and kappa architecture design patterns.
  • The role of structured and semi-structured data as part of streaming solution.
  • How technology has evolved to simplify our designs when handling data at any velocity.
  • What ingestion resources are needed for both batch and stream data handling.
  • How to combine batch and stream datasets into a comprehensive data model, supporting the serving of both source input types.
  • Aggregating streaming datasets using sliding, hoping, and tumbling compute windows.
  • How to create a common serving endpoint for business users.

Modules

  1. Architecture, context, and tooling. Microsoft Fabric vs Microsoft Azure.
  2. Creating a real-time data source.
  3. Handling messages with Microsoft Fabric Real-time Hub Experiences.
  4. Querying and reacting to event streams from multiple use cases.
  5. Consuming real-time data and exposing it to business users.
  6. Using Data Activator to create power event actions.

Co-Founder & CTO of Cloud Formations | Microsoft MVP

Paul Andrew

Paul (AKA @mrpaulandrew) is the Founder & CTO of Cloud Formations, a specialist data consultancy based in the UK. With nearly 20 years’ experience designing and delivering Microsoft data architectures, Paul leads a passionate team of engineers, supporting businesses small and large with scalable cloud platforms. Business value delivered through data insights. Over the years, Paul has covered the breadth and depth of design patterns and industry leading concepts, including Lambda, Kappa, Delta Lake, Data Mesh and Data Fabric.

Paul is also a Microsoft Data Platform MVP, organiser for the Data Relay community conference, East Midlands user group leader, book author and mentor. In addition to the day job(s), Paul is a father of three, husband, foodie, runner, blood donor, geek, Lego, and Star Wars fan! Lastly, Paul confesses to enjoying a Ramstein playlist when given half a chance to do some coding for a customer project.

Principal Program Manager at Microsoft

Devang Shah

Devang is a Principal Program Manager specializing in working on terabyte to petabyte-scale big data analytics projects in the EMEA region. He specializes in product innovation, product evangelization, community building, and product adoption strategies. With a strong educational and professional background in technology, software development, cloud adoption, and data analytics, he has spent the last decade advising clients on implementing large-scale and complex software systems, and data analytics solutions. Devang has been involved in producing training content, and tutorials for Microsoft Fabric experiences.

Sign up for the newsletter!

Be sure to get the latest and greatest from the Data Platform Next Step Conference.