Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set up Kafka Open edX event bus. #180

Conversation

MichaelRoytman
Copy link
Member

@MichaelRoytman MichaelRoytman commented Sep 22, 2023

JIRA: None.

Description: This pull requests adds necessary configuration and packages to run the Kafka implementation of the Open edX event bus.

Author concerns: None.

Dependencies: None.

Installation instructions: None.

Testing instructions:

None.

Merge checklist:

  • All reviewers approved
  • CI build is green
  • Changelog record added
  • Documentation updated (not only docstrings)
  • Commits are squashed

Post merge:

  • Delete working branch (if not needed anymore)

@MichaelRoytman MichaelRoytman changed the title Set up Open edX events. Set up Kafka Open edX event bus. Sep 22, 2023
@MichaelRoytman MichaelRoytman changed the base branch from main to MST-1789-downstream-triggers September 22, 2023 13:57
@MichaelRoytman MichaelRoytman force-pushed the michaelroytman/openedx_events_setup branch 3 times, most recently from 736a806 to 0c724fd Compare September 29, 2023 18:08
EVENT_BUS_CONSUMER = 'edx_event_bus_kafka.KafkaEventConsumer'
EVENT_BUS_KAFKA_SCHEMA_REGISTRY_URL = 'http://edx.devstack.schema-registry:8081'
EVENT_BUS_KAFKA_BOOTSTRAP_SERVERS = 'edx.devstack.kafka:29092'
EVENT_BUS_TOPIC_PREFIX = 'dev'
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Are we also supposed to add a blank value for EVENT_BUS_PRODUCER_CONFIG per the plan that Becca gave, or is that supposed to be done when we pushed to prod?

Copy link
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think it makes sense to add here as well. Otherwise, it won't work in development. I'll add it.

We'll have to add all of this configuration to the stage and production configuration files at some point, which is where that setting will really matter.

@MichaelRoytman MichaelRoytman force-pushed the michaelroytman/openedx_events_setup branch from 0c724fd to 77ea87c Compare September 29, 2023 19:30
Copy link
Member

@ilee2u ilee2u left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM pt. II

@MichaelRoytman MichaelRoytman force-pushed the michaelroytman/openedx_events_setup branch from 77ea87c to 2d4abd7 Compare September 29, 2023 19:32
@MichaelRoytman MichaelRoytman force-pushed the michaelroytman/openedx_events_setup branch from 2d4abd7 to 4128c05 Compare September 29, 2023 19:43
@MichaelRoytman MichaelRoytman merged commit 6321690 into MST-1789-downstream-triggers Sep 29, 2023
5 checks passed
@MichaelRoytman MichaelRoytman deleted the michaelroytman/openedx_events_setup branch September 29, 2023 19:53
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants