Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Set up db connections to use SOCKS proxy in Development environment #756

Merged
merged 5 commits into from
Aug 19, 2024

Conversation

audiodude
Copy link
Member

Previously, the development environment only needed to connect to the English wikipedia replica database, so it was enough to set up a ssh tunnel and connect through that. However, in future versions of the code, we will need to connect to a variety of wiki replica database, in order to select links and lang_links. So, for example, for French wikipedia, we will need to connect to frwiki.analytics.db.svc.wikimedia.cloud. In fact, we will need to connect to all db replicas for all wikipedia languages.

This code will not be used in production, it is only for development. In production, the *.analytics.db.svc.wikimedia.cloud hosts are all reachable from the production cloud VPS server. For local testing and debugging, we need the SOCKS proxy.

@audiodude
Copy link
Member Author

Part of #171

@audiodude audiodude changed the title Set up db connections to use SOCKS proxy Set up db connections to use SOCKS proxy in Development environment Aug 18, 2024
Copy link

codecov bot commented Aug 18, 2024

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 90.99%. Comparing base (67a081f) to head (2c2a2b1).
Report is 5 commits behind head on main.

Additional details and impacted files
@@            Coverage Diff             @@
##             main     #756      +/-   ##
==========================================
+ Coverage   90.95%   90.99%   +0.03%     
==========================================
  Files          64       65       +1     
  Lines        3396     3411      +15     
==========================================
+ Hits         3089     3104      +15     
  Misses        307      307              

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

@audiodude audiodude requested a review from rgaudin August 18, 2024 19:32
@audiodude
Copy link
Member Author

@rgaudin can you do a sanity check please?

Copy link
Member

@rgaudin rgaudin left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@audiodude audiodude merged commit df1d02c into main Aug 19, 2024
5 checks passed
@audiodude audiodude deleted the socks-proxy branch August 19, 2024 17:03
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants