Incremental Streaming vs Culimative Streaming
Problem
I noticed that Anthropics APIs use cumulative streaming in the completion endpoint, resulting in repetitive data being sent over the wire. Is there a reason for this design choice? I imagine Incremental streaming is typically preferred for efficiency. I see this is on the endpoint and not a python or ts issue. so this could impact existing customers.
Unverified for your environment
Select your OS to check compatibility.
1 Fix
Solution: Incremental Streaming vs Culimative Streaming
Thanks, this is something we're planning to improve in the next incarnation of our API.
Trust Score
1 verification
- 1
Thanks, this is something we're planning to improve in the next incarnation of o
Thanks, this is something we're planning to improve in the next incarnation of our API.
Validation
Resolved in anthropics/anthropic-sdk-python GitHub issue #10. Community reactions: 0 upvotes.
Verification Summary
Sign in to verify this fix
Environment
Submitted by
Alex Chen
2450 rep