OffsetCommitRequest not supported by Kafka server

[dpkp]

The OffsetCommitRequest API is currently only available in Kafka server development branch (i.e., build from source). It is not supported in 0.8.0 or earlier.

Kafka-python should try to handle this more gracefully. Perhaps make the default auto_commit=False in Consumer while 0.8.1 remains unreleased? Try/catch the OffsetCommitRequest request ?

Is there a way to get the server version via the API (I only see api versioning)?

[mumrah]

There isn't a way to get the current version from Kafka, although this would be really nice. There are a number of improvements planned in Kafka to make developing clients a bit easier. Getting the version out is one of them (not sure if there's a JIRA yet)

[rdiomar]

@muhammadomair I moved your comment to #120 since it's not related.

[dpkp]

We should be able to catch this error from kafka server (i.e., the server doesn't recognize the api request key, here 8 and 9)

kafka 0.8:
https://github.com/apache/kafka/blob/0.8/core/src/main/scala/kafka/api/RequestKeys.scala

kafka trunk:
https://github.com/apache/kafka/blob/trunk/core/src/main/scala/kafka/api/RequestKeys.scala

[frgtn]

+1 on making auto_commit=False the default. This will avoid a lot of confusion since most of library users will be using 0.8.0 for at least a few more months.

I also suggest adding an explanation to the exception description along the lines of OffsetCommitRequest method not supported by Kafka broker, set auto_commit=False or Offset commit functionality not supported by Kafka broker.

[mumrah]

@dpkp is this still relevant?

[dpkp]

Technically this is still relevant for anyone using kafka server 0.8.0 . Less pressing I think because most folks have upgraded to 0.8.1 / 0.8.1.1.

Nonetheless we should keep this open. I'll try to put a PR together on this.