Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Producer throughput regression #761

Open
svroonland opened this issue Sep 12, 2022 · 2 comments
Open

Producer throughput regression #761

svroonland opened this issue Sep 12, 2022 · 2 comments

Comments

@svroonland
Copy link
Owner

svroonland commented Sep 12, 2022

The latest ZIO 2 compatible release has a Producer throughput regression from about 57K records/s to about 46K records/s in the ProducerTest produce records to Kinesis successfully and efficiently test. This could be an issue in the test driver as well as the Producer itself.

@svroonland
Copy link
Owner Author

svroonland commented Jan 28, 2023

timestamp=2023-01-28T07:43:34.038993Z level=WARN thread=#zio-fiber-812658 message="Error producing records, will retry if recoverable: software.amazon.awssdk.core.exception.SdkClientException: Unable to execute HTTP request: The connection was closed during the request. The request will usually succeed on a retry, but if it does not: consider disabling any proxies you have configured, enabling debug logging, or performing a TCP dump to identify the root cause. If this is a streaming operation, validate that data is being read or written in a timely manner. Channel Information: ChannelDiagnostics(channel=[id: 0xb9cb185e, L:/192.168.1.158:65029 - R:kinesis.eu-west-1.amazonaws.com/99.80.34.136:443](H2 - 363), channelAge=PT0.881808S, requestCount=1) Parent Channel Information: ChannelDiagnostics(channel=[id: 0xb9cb185e, L:/192.168.1.158:65029 - R:kinesis.eu-west-1.amazonaws.com/99.80.34.136:443], channelAge=PT54.660472S, requestCount=0)" location=nl.vroste.zio.kinesis.client.producer.ProducerLive.processBatch file=ProducerLive.scala line=123

@svroonland
Copy link
Owner Author

Has improved again with zio 2.0.12 thanks to zio/zio#7994.

See #775 for WIP

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant