Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DM-49645: Update index.md with documentation on a new event-based architecture #3

Merged
merged 3 commits into from
Mar 26, 2025

Conversation

stvoutsin
Copy link
Member

Updates to technote describing a new system architecture which uses an event-bus between TAP and Kafka

@stvoutsin stvoutsin requested a review from afausti March 24, 2025 19:23
Copy link
Member

@afausti afausti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

The document reads great, there are a lot of details we'll iron out during the implementation. At this point we can use this as a living document to define the interfaces with TAP, Sasquatch and QServ. We talked about the Kafka users and the topic names that we are going to create next in the lsst.tap namespace in Sasquatch. The schemas for each of those topics provide a very good start, we'll certainly iterate on them and then we can update the doc with the corresponding Avro schemas. The support to synchronous queries and TAP "upload and query" will require more discussion but I think we should leave as is for the moment and start working on the asynchronous query implementation.

@stvoutsin
Copy link
Member Author

Thanks for the review, hopefully I've hopefully addressed all your suggestions, let me know if not!

Copy link
Member

@afausti afausti left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks great, thanks!

@stvoutsin stvoutsin merged commit c73dbed into main Mar 26, 2025
2 checks passed
@stvoutsin stvoutsin deleted the tickets/DM-49645 branch March 26, 2025 02:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants