client.chat.completions.create() not taking logprobs and top_logprobs as arguments

[az-2os]

Confirm this is an issue with the Python library and not an underlying OpenAI API

• This is an issue with the Python library

Describe the bug

I just updated to 1.4.0, and the client.chat.completions.create() in python library is not taking logprobs or top_logprobs as arguments but these arguments are already enabled if I access them through http request.

To Reproduce

To reproduce:

from openai import OpenAI
client = OpenAI()

completion = client.chat.completions.create(
  model="gpt-3.5-turbo",
  messages=[
    {"role": "system", "content": "You are a helpful assistant."},
    {"role": "user", "content": "Hello!"}
  ],
 logprobs=True,
)

Then it will return:
TypeError: Completions.create() got an unexpected keyword argument 'logprobs'

But you can use:

import requests

url = "https://api.openai.com/v1/chat/completions"
headers = {
    "Content-Type": "application/json",
    "Authorization": f"Bearer {OPENAI_API_KEY}"
}
data = {
    "model": "gpt-3.5-turbo",
    "messages": [
        {
            "role": "system",
            "content": "You are a helpful assistant."
        },
        {
            "role": "user",
            "content": "Hello!"
        }
    ],
    'logprobs': True,
}

response = requests.post(url, headers=headers, json=data)

And you will get a response with logprobs.

Code snippets

No response

OS

macOS

Python version

Python v3.11.5

Library version

openai v1.4.0

[rattrayalex]

Sorry about this – we're working on it and should have it out soon.

[rattrayalex]

This has been released.

[yash-quizizz]

Hey @rattrayalex, Is there a release planned for logprobs of fine tuned models ? As of now I am getting an error This model does not support the \'logprobs\' parameter.

[rattrayalex]

cc @enochcheung

[enochcheung]

Thanks for the CC! logprobs is being rolled out to finetuned models as well, but currently not fully rolled out.

[yash-quizizz]

Thanks a ton
@enochcheung @rattrayalex

[natty-zs]

Oddly, I'm getting the Error code: 400 - {'error': {'message': "This model does not support the 'logprobs' parameter.", 'type': 'invalid_request_error', 'param': 'logprobs', 'code': None}} intermittently on gpt-3.5-turbo-1106, but seems stable on gpt-3.5-turbo.

[gonghaohuang]

Oddly, I'm getting the Error code: 400 - {'error': {'message': "This model does not support the 'logprobs' parameter.", 'type': 'invalid_request_error', 'param': 'logprobs', 'code': None}} intermittently on gpt-3.5-turbo-1106, but seems stable on gpt-3.5-turbo.

I have the same problem

[ruleGreen]

me too, the problem happens somtimes

[eyb1]

I'm just migrating our fine-tuned curie/davinci completion models over to the new GPT3.5 Turbo chat models (for the Jan 4th deprecation deadline), and the only roadblock is the seemingly lack of logprobs support:

Error code: 400 - {'error': {'message': "This model does not support the 'logprobs' parameter.", 'type': 'invalid_request_error', 'param': 'logprobs', 'code': None}}

I get this both via the OpenAI Python Module and a direct POST request. I am using my fine-tuned model (on gpt-3.5-turbo-0613), haven't tried on others. We used the logprobs as a integral part of determining whether or not we should use the output of the model, will this be returning any time soon? @enochcheung I see you mentioned it above 2 weeks ago --- are we going to have to re-think our algo within the next 4 days?

[mohoyer]

FYI: @eyb1: I had the same issue, but logprops appear to work for fine-tuned models as well now. In my case this includes models that were trained when the feature wasn't ready yet.

[jhallard]

Hello all,

Logprobs has been enabled for fine tuned models based on the turbo-1106 models as of 2023-11-27. We will also enable support for fine-tunes based on the turbo-0613 models today (2024-01-02). I will comment back in this thread once that has been deployed.

Apologies for the inconvenience