Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

改进数据同步算法 #6945

Closed
88250 opened this issue Dec 29, 2022 · 0 comments
Closed

改进数据同步算法 #6945

88250 opened this issue Dec 29, 2022 · 0 comments
Assignees
Milestone

Comments

@88250
Copy link
Member

88250 commented Dec 29, 2022

  1. 在判断本地 upserts 时如果迭代过程中个别文件失败则会直接返回,这样可能会造成重复上传对象,应该改为 continue 继续判断后续文件
    image
  2. 将索引过程从 2 并行任务改为串行,避免潜在的竞态问题
@88250 88250 added this to the 2.6.1 milestone Dec 29, 2022
@88250 88250 self-assigned this Dec 29, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant