镜像站点 · 本页由第三方 GitHub 只读镜像提供,非 GitHub 官方站点,不接受任何登录或凭据输入。前往 github.com
Skip to content

DOC-7265 Update RDI FAQ throughput to the Flink baseline - #4475

Open
andy-stark-redis wants to merge 1 commit into
mainfrom
DOC-7265
Open

andy-stark-redis wants to merge 1 commit into
mainfrom
DOC-7265

Conversation

@andy-stark-redis

@andy-stark-redis andy-stark-redis commented Nov 5, 2026 •

Copy link
Copy Markdown
Contributor

Summary

  • Updates the RDI FAQ answer to "How much data can RDI process?" to the Flink processor baseline from When to use RDI: 20K records per second for CDC, 60K for full sync, at about 1KB per record with no transformations. The classic processor supports about half.
  • Removes the processing-unit wording, which only applied to the old 10,000 records per second figure.

Ticket: DOC-7265

For reviewers

  • Figures are copied from content/embeds/rdi-when-to-use.md, not re-measured.
  • Please confirm with engineering that dropping the "one processing unit is enough" guidance is right for the Flink processor.
  • Out of scope: the High throughput bullet in redis-data-integration/_index.md still says about 10,000 records per second.

🤖 Generated with Claude Code


Note

Low Risk
Documentation-only change to FAQ throughput figures; no code or runtime behavior is affected.

Overview
Updates the FAQ answer for How much data can RDI process? to reflect Flink and classic processor limits instead of the old processing-unit model (~10K records/sec per CPU core).

The new text states up to 20K records/sec for CDC and 60K for full sync with Flink (about half for classic), with the same ~1KB, no-transformations assumptions, and points readers to When to use RDI for full throughput and data-size guidance. The one processing unit is enough wording is removed.

Reviewed by Cursor Bugbot for commit e07bc83. Bugbot is set up for automated code reviews on this repo. Configure here.

Replace the 10,000 records per second per processing unit answer in the FAQ with the
Flink processor figures from the "When to use RDI" page (20K CDC, 60K full sync, about
1KB records, no transformations), note that the classic processor supports about half,
and link to that page.

I removed the processing-unit sentences, including "one processing unit is enough for a
relational database", because they only made sense with the old per-core figure and
nothing on the Flink side confirms the concept still applies. The same 10,000 figure
remains in the High throughput bullet of the RDI overview page; it is deliberately out
of scope here and noted on the ticket. Mirko Ortensi flagged the FAQ as outdated in a
review comment on the RDI + Azure Managed Redis blog draft.

Learned: FAQ throughput figures should track rdi-when-to-use.md, not be restated independently
Directive: do not reintroduce a per-processing-unit throughput claim without engineering confirming it for the Flink processor
Gaps: figures copied from the when-to-use embed, not re-measured; overview page still says 10,000
Ticket: DOC-7265
Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Nov 5, 2026 •

Copy link
Copy Markdown
Contributor

DOC-7265

@github-actions

github-actions Bot commented Nov 5, 2026

Copy link
Copy Markdown
Contributor

@github-actions

github-actions Bot commented Nov 5, 2026 •

Copy link
Copy Markdown
Contributor

@andy-stark-redis
andy-stark-redis requested review from a team and mortensi November 5, 2026 09:49
@andy-stark-redis andy-stark-redis self-assigned this Nov 5, 2026

@dwdougherty dwdougherty left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM.

@andy-stark-redis

Copy link
Copy Markdown
Contributor Author

Thanks @dwdougherty !

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants