Skip to content

ticdc: clarify Kafka message size configuration - #24594

Open
asddongmen wants to merge 3 commits into
pingcap:masterfrom
asddongmen:docs/ticdc-kafka-message-too-large-en
Open

asddongmen wants to merge 3 commits into
pingcap:masterfrom
asddongmen:docs/ticdc-kafka-message-too-large-en

Conversation

@asddongmen

@asddongmen asddongmen commented Oct 29, 2026 •

Copy link
Copy Markdown
Contributor

What is changed, added, or deleted? (Required)

Replace outdated broker-level advice for the Kafka Message was too large error with a procedure that aligns the TiCDC Sink URI max-message-bytes setting and the actual Kafka Topics' max.message.bytes settings. Add commands to identify dispatched Topics, update and verify their limits, update the complete Sink URI, and confirm that the changefeed resumes.

Which TiDB version(s) do your changes apply to? (Required)

Tips for choosing the affected version(s):

By default, CHOOSE MASTER ONLY so your changes will be applied to the next TiDB major or minor releases. If your PR involves a product feature behavior change or a compatibility change, CHOOSE THE AFFECTED RELEASE BRANCH(ES) AND MASTER.

For details, see tips for choosing the affected versions.

  • master (the latest development version)
  • v9.0 (TiDB 9.0 versions)
  • v8.5 (TiDB 8.5 versions)
  • v8.1 (TiDB 8.1 versions)
  • v7.5 (TiDB 7.5 versions)
  • v7.1 (TiDB 7.1 versions)
  • v6.5 (TiDB 6.5 versions)

What is the related PR or file link(s)?

AI agent involvement

  • The changes in this PR were primarily made by an AI agent on behalf of the PR author.

Do your changes match any of the following descriptions?

  • Delete files
  • Change aliases
  • Need modification after applied to another branch
  • Might cause conflicts after applied to another branch

Summary by CodeRabbit

  • Documentation
    • Updated the Kafka “Message was too large” troubleshooting guide with steps to align the TiCDC Sink URI’s message-size limit with the applicable Kafka Topic limit.
    • Added guidance for identifying the default and dispatcher-selected Topics, configuring and verifying Topic limits, and updating the Sink URI.
    • For running changefeeds, the guide now covers pausing before an update and resuming afterward, then checking the URI, changefeed state, and checkpoint progress.
    • Replaced broker-level configuration instructions.

@ti-chi-bot ti-chi-bot Bot added the missing-translation-status This PR does not have translation status info. label Oct 29, 2026
@ti-chi-bot

ti-chi-bot Bot commented Oct 29, 2026

Copy link
Copy Markdown

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by:
Once this PR has been reviewed and has the lgtm label, please assign qiancai for approval. For more information see the Code Review Process.
Please ensure that each of them provides their approval before proceeding.

The full list of commands accepted by this bot can be found here.

Details Needs approval from an approver in each of these files:

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

@asddongmen asddongmen added area/ticdc Indicates that the Issue or PR belongs to the area of TiCDC. translation/from-docs-cn This PR is translated from a PR in pingcap/docs-cn. labels Oct 29, 2026
@ti-chi-bot ti-chi-bot Bot added size/M Denotes a PR that changes 30-99 lines, ignoring generated files. and removed missing-translation-status This PR does not have translation status info. labels Oct 29, 2026
@coderabbitai

coderabbitai Bot commented Oct 29, 2026 •

Copy link
Copy Markdown

Review in Change Stack →

Walkthrough

The troubleshooting guide now covers aligning TiCDC’s max-message-bytes with Kafka topic max.message.bytes. It adds steps to inspect topic routing, configure topic limits, update a changefeed, and verify its state and checkpoint.

Changes: Kafka message size troubleshooting

Layer / File(s) Summary
Configure topic and changefeed limits
ticdc/troubleshoot-ticdc.md
The guide identifies the default and dispatcher-selected topics, explains how to set and verify their max.message.bytes limits, and adds steps to update the changefeed Sink URI and verify its state and checkpoint.

Priority: Normal

Estimated code review effort: 2 (Simple) | ~8 minutes

Change: Other

Suggested reviewers: hfxsd, qiancai

Merge Risk: Minimal · up to 2c552

The updated troubleshooting workflow is supported and has no established merge-blocking risk.

Pre-merge checks: Passed 5
Check name Status Explanation
Title check Passed The title clearly and concisely describes the main documentation change: clarifying Kafka message size configuration for TiCDC.
Description check Passed The description includes the required change summary and affected version, and it provides related PR information, AI involvement, and change-type checklist details.
Docstring Coverage Passed No eligible functions found in the changed files. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff with cyclomatic complexity of at least 2. Documentat…
Linked Issues check Passed Check skipped because no linked issues were found for this pull request.
Out of Scope Changes check Passed Check skipped because no linked issues were found for this pull request.
Full details: Docstring Coverage

Explanation

No eligible functions found in the changed files. Skipping docstring coverage check. Docstring coverage is scoped to functions touched by this diff with cyclomatic complexity of at least 2. Documentation-only edits and deletions within surviving functions are included; unchanged diff context and fully deleted functions are excluded. Analyzed 0 functions across 0 files. (1 skipped: 1 unsupported.)

Finishing Touches
🧪 Generate unit tests (beta)
  • Create a new PR
  • Autofix · Keep fixing CodeRabbit findings and required CI, and resolving merge conflicts

Thanks for using CodeRabbit! It's free for OSS, and your support helps us grow. If you like it, consider giving us a shout-out.

❤️ Share

Comment @coderabbitai help to get the list of available commands.

@coderabbitai coderabbitai Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Actionable comments posted: 2


Review info
Run configuration
  • Source mode: Auto
  • Repository: pingcap/docs
  • Branch: master
  • File: .coderabbit.yaml
  • Commit: e5e80ae
  • Layers: Repository YAML
  • Review profile: ASSERTIVE
  • Plan: Advanced
  • Run ID: 0d260c60-e1fa-4dc9-8ae0-cf91bce119ba
Commits

Reviewing files that changed from the base of the PR and between e5e80ae and 8a1aed4.

Files selected for processing: 1
  • ticdc/troubleshoot-ticdc.md

Included review availability: This review used your included allowance. Your plan provides up to 4 included reviews per hour; 3 remain after this review.

Comment thread ticdc/troubleshoot-ticdc.md Resolved
Comment thread ticdc/troubleshoot-ticdc.md Resolved
@qiancai qiancai added the needs-cherry-pick-release-8.5 Should cherry pick this PR to release-8.5 branch. label Oct 29, 2026
asddongmen and others added 2 commits October 30, 2026 09:44
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Co-authored-by: coderabbitai[bot] <136622811+coderabbitai[bot]@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

area/ticdc Indicates that the Issue or PR belongs to the area of TiCDC. needs-cherry-pick-release-8.5 Should cherry pick this PR to release-8.5 branch. size/M Denotes a PR that changes 30-99 lines, ignoring generated files. translation/from-docs-cn This PR is translated from a PR in pingcap/docs-cn.

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants