Error result: Streaming is strongly recommended for operations that may take longer than 10 minutes.

Question

Accepted Answer

I solved this problem.

The reason of this problem: since the input is too long, it will spend more time to acquire the response. Thus, the method will wait for the response more than 10 minutes. This kind of synchronous method is easy to have timeout problems.
Solution: Use the following stream method.

json_text = ""
    collecting_json = False
    with client.messages.stream(
            mo Solution: Use the following stream method. collecting_json = False
    with client.messages.stream(
            model=api_model,
            max_tokens=32000,
            messages=[{"role": api_role2, "content": api_content2}],
    ) as stream:
        for text in stream.text_stream:
             print(text, end="", flush=True)

Error result: Streaming is strongly recommended for operations that may take longer than 10 minutes.

Problem

Error Output

1 Fix

Solution: Error result: Streaming is strongly recommended for operations that may take longer than 10 minutes.

The reason of this problem: since the input is too long, it will spend more time

json_text = ""

Validation

Verification Summary

Environment

Submitted by

Tags