Kafka fundamentals for java developers

Kafka fundamentals for java developers

What you’ll learn

Learn what Kafka is and why is is so popular
Learn where and who uses Kafka
Understand the architectural components of Kafka
Learn how Kafka differs from traditional messaging systems
Install Kafka on your machine
Use the Kafka command line to create topics ,send/receive messages
Learn the Kafka Producer Concepts , API and send messages
Use the Kafka Consumer API and receive messages
Create custom serializers and deserializers to work with object type
Use Avros inbuilt serializers and deserializers
Use Confluent Schema Registry
Learn Advanced Producer configuration
Master the concepts of Consumer Groups and Rebalancing
Learn the different ways to commit offsets
Understand advanced consumer configuration
Learn the concepts of Kafka Streaming API
Create a Streaming application while understanding the fundamentals of streaming
Work on a small use case and lean more transformation methods from the Streaming API
Use Springs Support for Kafka to create producers and consumers as well
All in simple steps

Requirements

Knowledge of Java and micro service development
Knowledge of messaging will help but not required

Description

This course is for beginners who wants to master Kafka and use it one their projects and also for the experienced who want to get the fundamentals of Kafka right. Adding Kafka to your resume will not only increase the number of opportunities you will get but also the salary. Thousands of companies including Netflix, Twitter, LinkedIn, Uber use Kafka as a messaging engine or a data streaming platform . From this course you willLearn what Kafka is and why is is so popularLearn where and who uses KafkaUnderstand the architectural components of KafkaLearn how Kafka differs from traditional messaging systemsInstall Kafka on your machineUse the Kafka command line to create topics ,send/receive messagesLearn the Kafka Producer Concepts , API and send messagesUse the Kafka Consumer API and receive messagesCreate custom serializers and deserializers to work with object typeUse Avros inbuilt serializers and deserializersUse Confluent Schema RegistryLearn Advanced Producer configuration Master the concepts of Consumer Groups and RebalancingLearn the different ways to commit offsetsUnderstand advanced consumer configurationLearn the concepts of Kafka Streaming APICreate a Streaming application while understanding the fundamentals of streamingWork on a small use case and lean more transformation methods from the Streaming APIUse Springs Support for Kafka to create producers and consumers as wellAll in simple stepsWhat are the requirements?Knowledge of Java and micro service developmentKnowledge of messaging will help but not requiredWhat is not Covered?This course does not teach how to create advanced streaming applications but will introduce you to streaming

Overview

Section 1: Introduction

Lecture 1 Introduction

Lecture 2 How to make the best of this course

Lecture 3 Completed projects on GitHub

Lecture 4 Slides Used In the Course

Lecture 5 Download Assignment Solutions

Section 2: The Fundamentals

Lecture 6 What is Kafka

Lecture 7 Why Kafka

Lecture 8 Usecases

Lecture 9 Where is Kafka being used

Lecture 10 Who is Using Kafka

Lecture 11 Kafka Architectural Components

Lecture 12 Kafka Record

Lecture 13 Topics Partitions Offsets and Replication

Lecture 14 Consumer Groups

Lecture 15 Batching

Section 3: Kafka in action

Lecture 16 Introduction

Lecture 17 Java Version

Lecture 18 Install on windows

Lecture 19 Install on MAC

Lecture 20 Kafka Commandline

Lecture 21 Kafka APIs

Lecture 22 Documentation

Section 4: Create Producers and Consumers

Lecture 23 Kafka Producer

Lecture 24 Producer API Walkthrough

Lecture 25 Create a Producer Project

Lecture 26 Create a Producer

Lecture 27 Sync Send

Lecture 28 ASync Send

Lecture 29 API Walkthrough

Lecture 30 Create a Consumer Project

Lecture 31 Consume Messages

Section 5: Use Custom Serializers and Deserializers

Lecture 32 Introduction

Lecture 33 Create a Serializer

Lecture 34 Create a Deserializer

Section 6: Use Avro

Lecture 35 Introduction

Lecture 36 Schema Registry

Lecture 37 The magic behind the scenes

Lecture 38 Launch Confluent Schema Registry

Lecture 39 Create Avro Schema

Lecture 40 API Walkthrough

Lecture 41 Configure Maven Avro Plugin

Lecture 42 Create Producer

Lecture 43 Create Consumer

Lecture 44 Test

Lecture 45 GenericRecord type

Lecture 46 Create a GenericRecord Producer

Lecture 47 Create a Consumer

Lecture 48 Schema Evolution

Lecture 49 Schema Compatibility

Lecture 50 Consumers in real time

Lecture 51 Stop Confluent Platform

Section 7: More about Producers

Lecture 52 Introduction

Lecture 53 Create a topic

Lecture 54 Create Custom Partitioner

Lecture 55 ProducerConfig Class

Lecture 56 Acknowledgements and More

Lecture 57 Three More Properties

Section 8: Message Delivery and Transactions

Lecture 58 Introduction

Lecture 59 Message Delivery Semantics

Lecture 60 Transactions

Lecture 61 Use a transaction

Lecture 62 Few pointers about transactions

Section 9: More about Consumers

Lecture 63 Introduction

Lecture 64 Consumer Groups

Lecture 65 Consumer Group Rebalancing

Lecture 66 How rebalancing works

Lecture 67 Offset Commits

Lecture 68 Auto Commit

Lecture 69 Sync Commit

Lecture 70 Async Commit

Lecture 71 Commit Custom Offset

Lecture 72 Create a RebalanceListener

Lecture 73 Commit last offset processed

Lecture 74 Using ConsumerConfig class

Lecture 75 Min Fetch Size and Timeouts

Lecture 76 Four more properties

Lecture 77 Partition Assignor Strategy

Section 10: Create a Simple Consumer

Lecture 78 Introduction

Lecture 79 Create a Simple Consumer

Lecture 80 Create a producer and test

Lecture 81 Few important points

Section 11: Stream Processing

Lecture 82 Introduction

Lecture 83 Usecase and API

Lecture 84 Create Topics

Lecture 85 Create Project

Lecture 86 Step 1 – Configure Properties

Lecture 87 Step 2 – Create Topology

Lecture 88 Step 3 – Start and Stop Stream

Lecture 89 Test

Lecture 90 Describe Topology

Lecture 91 Write to output topic

Lecture 92 Use Filter Method

Lecture 93 Use map methods

Lecture 94 Word Count Usecase

Lecture 95 KTable

Lecture 96 Create Topics

Lecture 97 Implement Word Count

Lecture 98 Aggregate using groupBy and count

Lecture 99 Test

Section 12: Spring Boot and Kafka

Lecture 100 Introduction

Lecture 101 API Walkthrough

Lecture 102 Create Producer Project

Lecture 103 Create the Producer Service

Lecture 104 Create the REST Endpoint

Lecture 105 Create the Consumer

Lecture 106 Configure

Lecture 107 Test

Lecture 108 Use Object Type

Lecture 109 Configure JsonDeserializer

Lecture 110 Test

Section 13: Wrap Up

Lecture 111 Bonus Lecture

For beginners who is getting started with Kafka,For the experienced who want to get the fundamentals right,This course does not teach how to create advanced streaming applications but will introduce you to streaming

Course Information:

Udemy | English | 5h 12m | 2.27 GB
Created by: Bharath Thippireddy

You Can See More Courses in the IT & Software >> Greetings from CourseDown.com