Kafka wire protocol packet diagrams

One page per Kafka API, generated from the message schemas on apache/kafka branch 4.0. Each page encodes a minimal example of the request and the response at the highest valid version and draws it as an RFC-style byte grid, an expanded object tree and the raw schema. 84 APIs.

Records

0 Produce (v12) 1 Fetch (v17) 2 ListOffsets (v10)

Consumer groups

8 OffsetCommit (v9) 9 OffsetFetch (v9) 10 FindCoordinator (v6) 11 JoinGroup (v9) 12 Heartbeat (v4) 13 LeaveGroup (v5) 14 SyncGroup (v5) 15 DescribeGroups (v6) 16 ListGroups (v5) 42 DeleteGroups (v2) 47 OffsetDelete (v0) 68 ConsumerGroupHeartbeat (v1) 69 ConsumerGroupDescribe (v1)

Share groups

76 ShareGroupHeartbeat (v0) 77 ShareGroupDescribe (v0) 78 ShareFetch (v0) 79 ShareAcknowledge (v0) 83 InitializeShareGroupState (v0) 84 ReadShareGroupState (v0) 85 WriteShareGroupState (v0) 86 DeleteShareGroupState (v0) 87 ReadShareGroupStateSummary (v0)

Transactions

22 InitProducerId (v5) 24 AddPartitionsToTxn (v5) 25 AddOffsetsToTxn (v4) 26 EndTxn (v5) 27 WriteTxnMarkers (v1) 28 TxnOffsetCommit (v5) 61 DescribeProducers (v0) 65 DescribeTransactions (v0) 66 ListTransactions (v1) 67 AllocateProducerIds (v0)

Topics and partitions

3 Metadata (v13) 19 CreateTopics (v7) 20 DeleteTopics (v6) 21 DeleteRecords (v2) 23 OffsetForLeaderEpoch (v4) 34 AlterReplicaLogDirs (v2) 35 DescribeLogDirs (v4) 37 CreatePartitions (v3) 43 ElectLeaders (v2) 45 AlterPartitionReassignments (v0) 46 ListPartitionReassignments (v0) 56 AlterPartition (v3) 73 AssignReplicasToDirs (v0) 75 DescribeTopicPartitions (v0)

Security and ACLs

17 SaslHandshake (v1) 29 DescribeAcls (v3) 30 CreateAcls (v3) 31 DeleteAcls (v3) 36 SaslAuthenticate (v2) 38 CreateDelegationToken (v3) 39 RenewDelegationToken (v2) 40 ExpireDelegationToken (v2) 41 DescribeDelegationToken (v3) 50 DescribeUserScramCredentials (v0) 51 AlterUserScramCredentials (v0)

Configuration and quotas

32 DescribeConfigs (v4) 33 AlterConfigs (v2) 44 IncrementalAlterConfigs (v1) 48 DescribeClientQuotas (v1) 49 AlterClientQuotas (v1)

Cluster and KRaft

18 ApiVersions (v4) 52 Vote (v2) 53 BeginQuorumEpoch (v1) 54 EndQuorumEpoch (v1) 55 DescribeQuorum (v2) 57 UpdateFeatures (v2) 58 Envelope (v0) 59 FetchSnapshot (v1) 60 DescribeCluster (v2) 62 BrokerRegistration (v4) 63 BrokerHeartbeat (v1) 64 UnregisterBroker (v0) 70 ControllerRegistration (v0) 71 GetTelemetrySubscriptions (v0) 72 PushTelemetry (v0) 74 ListClientMetricsResources (v0) 80 AddRaftVoter (v0) 81 RemoveRaftVoter (v0) 82 UpdateRaftVoter (v0)