Skip to content

改进内核任务调度机制提升稳定性 #7113

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom
Closed
88250 opened this issue Jan 18, 2023 · 1 comment
Closed

改进内核任务调度机制提升稳定性 #7113

88250 opened this issue Jan 18, 2023 · 1 comment
Assignees
@88250
Labels
Enhancement
Milestone
2.7.1

Comments

@88250
Copy link
Member

88250 commented Jan 18, 2023 •
edited
Loading

在用户在相继执行一些耗时操作后容易导致竞态，虽然之前通过一些锁尽量避免竞态，但是随着业务操作种类的增加，难免会遗漏处理一些场景，从而导致系统不稳定报错，这部分实现代码的维护也较为困难。

需要一个统一的任务调度机制来确保可能导致竞态操作的序列化执行，比较好的实现方式就是使用队列，将较为耗时且可能并发的操作按顺序阻塞执行，目前包括：

  • 从快照中检出
  • 重建索引
  • 数据库索引队列
  • 数据库索引引用
  • 数据库索引订正
  • 图片 OCR 提取文本
  • 生成文件历史
  • 嵌入块索引 嵌入块支持搜索 #7112
@88250 88250 added the Refactor label Jan 18, 2023
@88250 88250 self-assigned this Jan 18, 2023
@88250 88250 mentioned this issue Jan 18, 2023
Closed
@88250 88250 changed the title 重构内核任务调度 重构内核任务调度机制提升稳定性 Jan 18, 2023
@88250 88250 changed the title 重构内核任务调度机制提升稳定性 改进内核任务调度机制提升稳定性 Jan 18, 2023
@88250 88250 mentioned this issue Jan 18, 2023
Closed
@88250 88250 added this to the 2.7.1 milestone Jan 18, 2023
88250 added a commit that referenced this issue Jan 18, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
4923894
88250 added a commit that referenced this issue Jan 18, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
c40355e
88250 added a commit that referenced this issue Jan 18, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
2d94fd2
@88250 88250 closed this as completed Jan 18, 2023
88250 added a commit that referenced this issue Jan 18, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
0da0fb6
88250 added a commit that referenced this issue Jan 19, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
89fd4d9
88250 added a commit that referenced this issue Jan 19, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
b44f7b3
88250 added a commit that referenced this issue Jan 19, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
adf3796
88250 added a commit that referenced this issue Jan 19, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
2574163
@88250 88250 reopened this Jan 22, 2023
@88250 88250 mentioned this issue Jan 22, 2023
Closed
2 tasks
@Soltus
Copy link
Contributor

Soltus commented Jan 22, 2023

点赞

This was referenced Jan 23, 2023
Closed
Closed
88250 added a commit that referenced this issue Jan 23, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
6141be7
88250 added a commit that referenced this issue Jan 23, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
6ed1c5d
88250 added a commit that referenced this issue Jan 23, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
a83a08b
88250 added a commit that referenced this issue Jan 23, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
72093f7
88250 added a commit that referenced this issue Jan 23, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
a452015
88250 added a commit that referenced this issue Jan 23, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
76bed6c
88250 added a commit that referenced this issue Jan 23, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
d32dedf
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
1fec932
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
df7f576
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
b5fc879
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
430c8cb
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
9d009fe
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
9b28cdf
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
3158ec9
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
c130b01
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
6b356ba
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
07ad00e
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
a4d7792
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
fdc2f19
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
3f1ec36
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
07abcd0
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
4916baf
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
d7419e8
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
c1ff45f
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
7d1b501
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
85481e5
88250 added a commit that referenced this issue Jan 25, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
430bf34
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
db777af
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
5aff312
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
e214543
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
81df075
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
3c79a22
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
f8ef563
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
b1cccc1
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
0a2d095
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
13e6ff8
88250 added a commit that referenced this issue Jan 26, 2023
@88250
🎨 改进内核任务调度机制提升稳定性 #7113
f6d290b
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees

@88250 88250

Labels
Enhancement
Projects
None yet
Milestone
2.7.1
Development

No branches or pull requests
2 participants
@88250 @Soltus