Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Disk-backed Persistent queue for channels in Raccoon #52

Open
stym06 opened this issue Nov 29, 2022 · 3 comments
Open

Disk-backed Persistent queue for channels in Raccoon #52

stym06 opened this issue Nov 29, 2022 · 3 comments

Comments

@stym06
Copy link

stym06 commented Nov 29, 2022

Summary
Currently, Raccoon uses Channels for the intermediate processing of EventRequests, which are then forwarded to the message broker. But it does not solve the problem of loss of events that are there in the channel and could not get forwarded to Kafka when the server dies.

Proposed solution
Implement some disk-backed queueing for intermediate persistence, similar to this project.
https://github.com/jhunters/bigqueue

@AkbaraliShaikh
Copy link
Member

we are already working on the event guarantee delivery proposal, will share the proposal soon, thanks.

@stym06
Copy link
Author

stym06 commented Nov 29, 2022

Is there a running Design Doc for this? Would love to see the progress and the approach.

@stym06
Copy link
Author

stym06 commented Mar 1, 2023

Guys, is there any progress on this? Is there a design doc that I can look into?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
Status: Future
Development

No branches or pull requests

3 participants