4 Pull requests merged by 2 people

• Migrate to orjson (JSON library) for better performance

  #2016 merged Aug 11, 2025

• Fix URLs in SchemaRegistryClient docs

  #2014 merged Aug 7, 2025

• Upgrade cel-python to 0.4.0 and update usage

  #2015 merged Aug 5, 2025

• DGS-21268 Add support for full payload encryption

  #2011 merged Jul 18, 2025

4 Pull requests opened by 4 people

• [KIP-848] Added online upgrade and downgrade test

  #2012 opened Jul 17, 2025

• Add missing endpoints to SchemaRegistryClient

  #2017 opened Aug 8, 2025

• DGS-21595 Allow alternate KMS key IDs on a KEK

  #2018 opened Aug 8, 2025

• Fix error propagation rule for Python's C API

  #2019 opened Aug 12, 2025

71 Issues closed by 4 people

• Differentiate Schema Registry Communication Failure From SerializerError

  #1325 closed Jul 28, 2025

• get_latest_schema() doesn't raise for log error for all the codes. It makes it difficult to debug

  #584 closed Jul 28, 2025

• Clarification on partitioner usage: discrepancy between known issue comment in Producer.c and test case test_set_partitioner_murmur2_random

  #1993 closed Jul 25, 2025

• Docs Bug: ConfigResource uses incremental_configs but mentions add_incremental_configs in description

  #1979 closed Jul 25, 2025

• Documentation page is not up to date with latest 2.10 release

  #1977 closed Jul 25, 2025

• [HELP] - Kafka Producer IAM Role Authentication Fails After Idle Period with MSK

  #1960 closed Jul 25, 2025

• handshake failed with brokers, broker certificate could not be verified,

  #1936 closed Jul 24, 2025

• [Question] Reacting to deletion of a topic being read through a consumer

  #1907 closed Jul 24, 2025

• schema registry protobuf serialization exception after upgrading to 2.7.0

  #1904 closed Jul 24, 2025

• Feature support for paralell cosumers

  #1884 closed Jul 24, 2025

• httpx migration problems

  #1882 closed Jul 24, 2025

• Unrecognized field: schemaType (HTTP status code 422, SR code 422)

  #1876 closed Jul 24, 2025

• PyPI package is badly built

  #1712 closed Jul 24, 2025

• Version 2.6.0 produces error "The request was rejected by firewall checks" on Azure EventHub/Kubernetes

  #1838 closed Jul 23, 2025

• Schema Registry SSL authentication with SchemaRegistryClient class

  #1819 closed Jul 23, 2025

• Schema Registry authentication using OAuth instead of username password with SchemaRegistryClient

  #1816 closed Jul 23, 2025

• A correction in the Apache Kafka for Python Developers Course

  #1815 closed Jul 23, 2025

• Package v2.5.0 causes broker null pointer exception

  #1799 closed Jul 23, 2025

• Errors while installing latest version

  #1784 closed Jul 23, 2025

• Metrics Discrepancies Between Produced and Consumed Messages in Kafka Confluent Platform

  #1781 closed Jul 23, 2025

• How to produce the undelivered messages after timeout of producer.flush(1.0)

  #1774 closed Jul 23, 2025

• `Consumer.poll` goes into infinite loop

  #1767 closed Jul 23, 2025

• Problem importing cimpl.

  #1785 closed Jul 23, 2025

• Pickle KafkaException

  #1749 closed Jul 23, 2025

• Cannot Unit test producer that takes confluent_kafka.Producer as dependency

  #1738 closed Jul 23, 2025

• Initializing producer throws segfault

  #1728 closed Jul 23, 2025

• Install failed when using 32bit python3.12 on Windows

  #1725 closed Jul 23, 2025

• SASL Authentication issue

  #1718 closed Jul 23, 2025

• Kafka returning same set of records even after full records fetched from the table

  #1717 closed Jul 23, 2025

• SSL communication and Segment fault issue in version 2.0.2 & above

  #1690 closed Jul 23, 2025

• Prioritizing poll between topics in single consumer

  #1676 closed Jul 21, 2025

• Disconnected while requesting ApiVersion - Kubernetes Only

  #1675 closed Jul 21, 2025

• it's bound to keep throwing BufferError after a few hours(unpredictable) of running

  #1673 closed Jul 21, 2025

• Inaccurate documentation for `SerializationContext` `field` parameter regarding `MessageField` usage

  #1657 closed Jul 18, 2025

• Sometimes data cannot be consumed (disappears after restarting)

  #1653 closed Jul 18, 2025

• Not all messages are produced to a Kafka topic

  #1644 closed Jul 18, 2025

• How to set delivery.reports to false ?

  #1637 closed Jul 18, 2025

• AttributeError: 'NoneType' object has no attribute value

  #1632 closed Jul 18, 2025

• Trying to connect to MSK With SASL_SSL

  #1588 closed Jul 17, 2025

• Unable to install confluent-kafka library from source in docker container

  #1567 closed Jul 17, 2025

• "module 'os' has no attribute 'add_dll_directory'"

  #1530 closed Jul 17, 2025

• AttributeError: module 'os' has no attribute 'add_dll_directory' - Python 3.9 - Lambda Function in AWS

  #1528 closed Jul 17, 2025

• Segfault of binary wheel on Red Hat Enterprise 8 Python 3.6/3.8

  #1519 closed Jul 17, 2025

• Recommended way to partial historical data?

  #1509 closed Jul 17, 2025

• Kafka client keeps disconnecting after moving to SSL

  #1494 closed Jul 17, 2025

• oauth token not refreshing

  #1485 closed Jul 17, 2025

• Error, when installing requirements in docker-compose. Macbook M2

  #1482 closed Jul 17, 2025

• Unable to connect to confluent cloud

  #1479 closed Jul 17, 2025

• AttributeError: module 'os' has no attribute 'add_dll_directory' - Python 3.8 - Function Azure

  #1462 closed Jul 17, 2025

• how to know if kafka is down or up

  #1459 closed Jul 17, 2025

• No module named 'confluent_kafka.cimpl' - Python 3.7 and confluent-kafka - functions Azure

  #1453 closed Jul 17, 2025

• SerializingProducer is much slower than Producer in Python

  #1440 closed Jul 17, 2025

• Consumer looses partitons after restart connection

  #1305 closed Jul 17, 2025

• Schema registry API response don't match docs for schemas with references

  #1303 closed Jul 17, 2025

• No module named 'confluent_kafka.cimpl' AWS Lambda / Python 3.9

  #1295 closed Jul 15, 2025

• Use function consume lost message after call seek

  #1270 closed Jul 14, 2025

• Best practice to work with django and confluent_kafka consmer/producer

  #1215 closed Jul 14, 2025

• How to deal with msg.error() in batch API

  #1195 closed Jul 14, 2025

• Consumer.offsets_for_times() returns the same offset for different timestamps

  #1178 closed Jul 14, 2025

• Cannot create local docker-compose file for Confluent Cloud env replication

  #1176 closed Jul 14, 2025

• How can I use protobuf deserializer intergrated with spark streaming?

  #1136 closed Jul 14, 2025

• AdminClient creating topic nondeterministically fails with "The active controller appears to be node x"

  #1132 closed Jul 14, 2025

• Python Dictionary to Class Handling (How/Why)

  #1100 closed Jul 14, 2025

• Question: Slowness in the consumer polling config Info -> One Producer-One Topic-One Partition-One Consumer

  #1077 closed Jul 14, 2025

• Consumer performance problems in 1.6.0

  #1054 closed Jul 14, 2025

• Erroneous Connection does not fail

  #1048 closed Jul 14, 2025

• Very first message in a topic is skipped by the consumer

  #1046 closed Jul 14, 2025

• For new group I can't get the consumer to instantiate the group

  #1038 closed Jul 14, 2025

• depends on not widely available librdkafka version

  #1032 closed Jul 14, 2025

• Python client doesn't support hyphens in schema namespace

  #936 closed Jul 14, 2025

• Bug in protobuf serializer: unnecessary roundtrip to schema registry

  #935 closed Jul 14, 2025

1 Issue opened by 1 person

• documentation on Schema, register schema and details on the SchemaRegistryClient are missing

  #2013 opened Jul 18, 2025

111 Unresolved conversations

Sometimes conversations happen on old items that aren’t yet closed. Here is a list of all the Issues and Pull Requests with unresolved conversations.

• Added contributor.md and updated code block styles to better fix github markdown patterns

  #1997 commented on Jul 25, 2025 • 12 new comments

• Fix SchemaRegistryClient docs

  #1595 commented on Aug 1, 2025 • 3 new comments

• Manifest tweak

  #2001 commented on Jul 24, 2025 • 2 new comments

• Consumer doesn't detect that it cannot consume from the topic

  #1787 commented on Jul 23, 2025 • 0 new comments

• When consumer is paused check if it's paused

  #1793 commented on Jul 23, 2025 • 0 new comments

• Segmentation faults (and the like) and failure to get assignments in multithreaded/asyncio pytest environment

  #1797 commented on Jul 23, 2025 • 0 new comments

• DeserializingConsumer does not return a regular Message when used with AvroDeserializer

  #1800 commented on Jul 23, 2025 • 0 new comments

• Synchronous Commit from confluent kafka python consumer client causes a consumer hang once in a while

  #1801 commented on Jul 23, 2025 • 0 new comments

• flush leaves messages remaining

  #1817 commented on Jul 23, 2025 • 0 new comments

• Memory leak because of stats collection

  #1820 commented on Jul 23, 2025 • 0 new comments

• Multiple calls to list_offsets() may cause memory leaks

  #1901 commented on Jul 23, 2025 • 0 new comments

• Producer silently swallows produce error if it does not have Write permissions

  #1847 commented on Jul 24, 2025 • 0 new comments

• Python SchemaRegistryClient failed to connect to SchemaRegistry Server

  #1850 commented on Jul 24, 2025 • 0 new comments

• Topic.Id corrupted on windows x86

  #1864 commented on Jul 24, 2025 • 0 new comments

• Allow SchemaRegistryClient to pass ssl.key.password as confluent_kafka.Producer

  #1905 commented on Jul 24, 2025 • 0 new comments

• Issue with ssl.ca.location schema registry client option after migration to httpx

  #1909 commented on Jul 24, 2025 • 0 new comments

• Update minor+patch dependencies (master)

  #1957 commented on Aug 1, 2025 • 0 new comments

• Failed to retrieve OIDC token in serverless architecture

  #1782 commented on Jul 23, 2025 • 0 new comments

• Broker certificate could not be verified.

  #1610 commented on Jul 23, 2025 • 0 new comments

• GroupCoordinator: SASL authentication error: SaslAuthenticateRequest failed: Local: Broker transport failure (after 0ms in state DOWN)

  #1780 commented on Jul 23, 2025 • 0 new comments

• Expose partitioners to python

  #1759 commented on Jul 23, 2025 • 0 new comments

• Access denied error for IAM role based AWS MSK cluster while using confluent-kafka python library

  #1739 commented on Jul 23, 2025 • 0 new comments

• AdminClient caching all topics in metadata request calls

  #1737 commented on Jul 23, 2025 • 0 new comments

• Not support validating fields with the `format: email` in JSON Schema.

  #1727 commented on Jul 23, 2025 • 0 new comments

• confluent-kafka-python vs aiokafka for Asynchronous applications

  #1723 commented on Jul 23, 2025 • 0 new comments

• OverflowError: Python int too large to convert to C int when using confluent_kafka Avro deserializer

  #1716 commented on Jul 23, 2025 • 0 new comments

• AdminClient is stuck at `CONNECT` when using `OAUTHBEARER` with `SASL_SSL` protocol

  #1713 commented on Jul 23, 2025 • 0 new comments

• Improper handling of Python C-API exceptions

  #1708 commented on Jul 23, 2025 • 0 new comments

• please help me! I encountered difficulties using the "AdminClient. list_offsets" method

  #1696 commented on Jul 23, 2025 • 0 new comments

• Continuous fuzzing by way of OSS-Fuzz

  #1415 commented on Jul 17, 2025 • 0 new comments

• Run soak tests from EC2

  #1908 commented on Aug 8, 2025 • 0 new comments

• SchemaRegistryClient caches incorrect entries ( or does not invalidate ) when using the `get_schema()` and `get_latest_version()` APIs.

  #1950 commented on Aug 7, 2025 • 0 new comments

• `enable.ssl.certificate.verification` must be a string and not a boolean

  #1633 commented on Aug 7, 2025 • 0 new comments

• Consumer compatible with asyncio

  #1017 commented on Aug 6, 2025 • 0 new comments

• Add `SchemaRegistryClient` methods for all schema/subject REST endpoints

  #1429 commented on Aug 1, 2025 • 0 new comments

• SystemError when a callback raises

  #865 commented on Jul 30, 2025 • 0 new comments

• Faster json library?

  #1177 commented on Jul 30, 2025 • 0 new comments

• Guidance on standalone consumer implementation

  #1961 commented on Jul 30, 2025 • 0 new comments

• String representation of a TopicPartition raises a SystemError on Windows with Python 3.12.1 and Confluent Kafka Python 2.3.0

  #1715 commented on Jul 28, 2025 • 0 new comments

• segfault on unknown list_consumer_group_offsets

  #1982 commented on Jul 28, 2025 • 0 new comments

• Unit Tests don't clean up docker containers

  #1311 commented on Jul 25, 2025 • 0 new comments

• Segmentation fault on GC runs in multithreaded context

  #1761 commented on Jul 25, 2025 • 0 new comments

• On new version of httpx SSL throws an error

  #2010 commented on Jul 25, 2025 • 0 new comments

• Docs Bug: `fetch.wait.max.ms` in consumer config but shows `fetch.max.wait.ms` in official docs

  #1991 commented on Jul 25, 2025 • 0 new comments

• Provide wheel for Windows ARM64

  #1981 commented on Jul 25, 2025 • 0 new comments

• Kafkacat Error While Running Example File

  #1964 commented on Jul 25, 2025 • 0 new comments

• AWS MSK broker certificate validation fails with custom CA

  #1962 commented on Jul 25, 2025 • 0 new comments

• list_consumer_group_offsets_request support multiple consumer groups

  #1947 commented on Jul 24, 2025 • 0 new comments

• Attempting to call list_topics() on a closed Kafka Consumer object results in a segmentation fault.

  #1942 commented on Jul 24, 2025 • 0 new comments

• Issue- Python kafka producer to send the data using the kerberos authentication.

  #1934 commented on Jul 24, 2025 • 0 new comments

• Producer request timeout in container

  #1915 commented on Jul 24, 2025 • 0 new comments

• [AdminClient] Getting segmentation fault for describe acls

  #1859 commented on Jul 24, 2025 • 0 new comments

• Consumer performance benchmarking

  #1853 commented on Jul 24, 2025 • 0 new comments

• Periodically error on committing offset

  #1843 commented on Jul 24, 2025 • 0 new comments

• ALL_BROKERS_DOWN on Producer

  #1813 commented on Jul 24, 2025 • 0 new comments

• SR API coverage still not quite complete when it comes to soft/hard delete

  #1912 commented on Jul 24, 2025 • 0 new comments

• Add typing support

  #1408 commented on Jul 17, 2025 • 0 new comments

• How to check for SASL Authentication Errors?

  #1398 commented on Jul 17, 2025 • 0 new comments

• Updating manylinux version?

  #1377 commented on Jul 17, 2025 • 0 new comments

• suspicious memory leak in producer (rdkafka)

  #1361 commented on Jul 17, 2025 • 0 new comments

• PEP517

  #1357 commented on Jul 17, 2025 • 0 new comments

• automated style checking

  #1351 commented on Jul 17, 2025 • 0 new comments

• VALUE_DESERIALIZATION - Connection reset by peer

  #1334 commented on Jul 17, 2025 • 0 new comments

• Producer logging thousands of errors in a very short timespan (Broker transport failure)

  #1328 commented on Jul 17, 2025 • 0 new comments

• Type hint missing for "from confluent_kafka import Message"

  #1310 commented on Jul 17, 2025 • 0 new comments

• "Handle is terminating" exception when calling `delete_topics`

  #1298 commented on Jul 15, 2025 • 0 new comments

• How to correctly handle a message.error() for a corrupted message vs retryable error ?

  #1275 commented on Jul 15, 2025 • 0 new comments

• Support Python context managers/with statement

  #1244 commented on Jul 14, 2025 • 0 new comments

• Future hangs indefinetly when removed from the dict it is returned with.

  #1242 commented on Jul 14, 2025 • 0 new comments

• Add AggregateSerializer, AggregateDeserializer

  #1237 commented on Jul 14, 2025 • 0 new comments

• About creating consumers

  #1232 commented on Jul 14, 2025 • 0 new comments

• Enhancement - use schema registry to validate provided schemas for Protobuf and Json deserialisers

  #1210 commented on Jul 14, 2025 • 0 new comments

• Message.__len__ fails if the value has been deserialized to a type that does not support __len__

  #1192 commented on Jul 14, 2025 • 0 new comments

• Producer hide librdkafka failures and silently return None as message on poll

  #1187 commented on Jul 14, 2025 • 0 new comments

• Termination has been stuck

  #1185 commented on Jul 14, 2025 • 0 new comments

• Describe log dirs partitions size in admin client ?

  #1179 commented on Jul 14, 2025 • 0 new comments

• is there a way to override the producer partitioner?

  #1107 commented on Jul 14, 2025 • 0 new comments

• Support for connect_cb

  #1097 commented on Jul 14, 2025 • 0 new comments

• Admin client raises _TIMED_OUT error rather than SASL authentication error when topic creation fails

  #1034 commented on Jul 14, 2025 • 0 new comments

• Certificate Param in Config

  #977 commented on Jul 14, 2025 • 0 new comments

• Producer goes to retry-backoff by send_offsets_to_transaction() thus degrading performance

  #967 commented on Jul 14, 2025 • 0 new comments

• multiprocessing Python Kafka consumer client not getting back messages

  #925 commented on Jul 14, 2025 • 0 new comments

• Update README.md to reflect the legacy status of AvroProducer and AvroConsumer

  #910 commented on Jul 14, 2025 • 0 new comments

• Schema Registry: Support custom schemaId framing

  #1688 commented on Jul 23, 2025 • 0 new comments

• Consumers get revoked juste after been assigned for 3 consecutives days every week

  #1684 commented on Jul 23, 2025 • 0 new comments

• Provide proper documentation and type hints for supported config options

  #1683 commented on Jul 23, 2025 • 0 new comments

• List topics call doesn't cache topic metadata on producer instance

  #1679 commented on Jul 23, 2025 • 0 new comments

• Add broker-loggers support to AdminAPI

  #1678 commented on Jul 21, 2025 • 0 new comments

• Different per-topic timeout configuration

  #1671 commented on Jul 21, 2025 • 0 new comments

• assign() does NOT work inside on_assign-Callback if assignor is configured/seek() does NOT work inside on_assign-Callback

  #1669 commented on Jul 21, 2025 • 0 new comments

• Fix docs about `logger` argument of Consumer and Producer

  #1668 commented on Jul 21, 2025 • 0 new comments

• consumer hangs on consumer.close()

  #1667 commented on Jul 18, 2025 • 0 new comments

• Consumer commit() None parameters

  #1642 commented on Jul 18, 2025 • 0 new comments

• confluent_kafka/cimpl.cpython-36m-x86_64-linux-gnu.so: undefined symbol: rd_kafka_event_AlterConsumerGroupOffsets_result

  #1639 commented on Jul 18, 2025 • 0 new comments

• Docs should be updated to include the extended return value for the oauth_cb callback

  #1634 commented on Jul 18, 2025 • 0 new comments

• manual checkpoint

  #1617 commented on Jul 18, 2025 • 0 new comments

• Failed to load OpenSSL provider "legacy": error:07880025:common libcrypto routines::reason(524325)

  #1596 commented on Jul 18, 2025 • 0 new comments

• Crash (SEGV) in Producer class

  #1590 commented on Jul 17, 2025 • 0 new comments

• Create user for setting ACL rule over topic

  #1589 commented on Jul 17, 2025 • 0 new comments

• Feature request: cimpl.Message.set_error

  #1585 commented on Jul 17, 2025 • 0 new comments

• Question: Do not understand DeserializingConsumer error behaviour. How to construct a robust consumer?

  #1572 commented on Jul 17, 2025 • 0 new comments

• on_revoke callback passed partition list with partition not already in assignment after consumer group session timeout

  #1551 commented on Jul 17, 2025 • 0 new comments

• feature request: make Message type user-instantiable

  #1535 commented on Jul 17, 2025 • 0 new comments

• pip install --no-binary :all: confluent-kafka Deprecation Warning

  #1507 commented on Jul 17, 2025 • 0 new comments

• Don't understand ssl.ca.pem format

  #1500 commented on Jul 17, 2025 • 0 new comments

• Strange output to the console

  #1478 commented on Jul 17, 2025 • 0 new comments

• Consumer not consuming from all assigned partitions

  #1477 commented on Jul 17, 2025 • 0 new comments

• Producer. Connection or connection error handling

  #1472 commented on Jul 17, 2025 • 0 new comments

• Custom Protobuf Options / Schema Registry Support

  #1470 commented on Jul 17, 2025 • 0 new comments

• Allow strict validation with `fastavro`, to fail when extra fields are present in the records

  #1423 commented on Jul 17, 2025 • 0 new comments

• Number of file handles does not scale with number of Consumer(s)

  #1417 commented on Jul 17, 2025 • 0 new comments