Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Rearchitecture MWOffliner HTML/CSS/JS scraping (part #1) #1839

Merged
merged 31 commits into from
Aug 24, 2023
Merged

Rearchitecture MWOffliner HTML/CSS/JS scraping (part #1) #1839

merged 31 commits into from
Aug 24, 2023

Commits on Aug 24, 2023

  1. finish adding clear separation between API endpoints, finish unit tes… 

    …ts for directors
    @DonAlexandro @kelson42
    DonAlexandro authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    7eaae1c View commit details
    Browse the repository at this point in the history

  2. rearchitecture treatment methods from saveArticle.ts file

    @DonAlexandro @kelson42
    DonAlexandro authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    0211e6a View commit details
    Browse the repository at this point in the history

  3. rearchitecture render article methods from articleRenderers.ts file

    @DonAlexandro @kelson42
    DonAlexandro authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    3485934 View commit details
    Browse the repository at this point in the history

  4. Remove mobile-director test, resolve rebase conflicts

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    b0046f5 View commit details
    Browse the repository at this point in the history

  5. Update downloader tests, refactor article renderer

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    0f5bfa0 View commit details
    Browse the repository at this point in the history

  6. Increase test timeout for article treatment test

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    a6cf366 View commit details
    Browse the repository at this point in the history

  7. Abstract renderers for Parsoid HTML and Visual Editor (partial impl)

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    061df37 View commit details
    Browse the repository at this point in the history

  8. Minor fixes for abstract renderers and tests (partial impl)

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    1b76939 View commit details
    Browse the repository at this point in the history

  9. Wrap renderers using Builder pattern, refactor Render instantiation

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    1c63a52 View commit details
    Browse the repository at this point in the history

  10. Refactor renderer classes and invocation of getting article

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    cbe598b View commit details
    Browse the repository at this point in the history

  11. Suppress tests for VE, fix tests related to parsoid html renderer

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    fd2c47b View commit details
    Browse the repository at this point in the history

  12. Fix Visual Editor renderer

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    06369dd View commit details
    Browse the repository at this point in the history

  13. Replace mwCapabilities to Mediawiki class (partial impl)

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    454c0b1 View commit details
    Browse the repository at this point in the history

  14. Fix mw capabilities in setting URLs method

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    a3fb4a5 View commit details
    Browse the repository at this point in the history

  15. Add method to check coordination param availability

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    cac1006 View commit details
    Browse the repository at this point in the history

  16. Refactor Mediawiki API capabilities

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    781dc4a View commit details
    Browse the repository at this point in the history

  17. Temporary remove isMainPage condition while choosing renderers

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    1dd1930 View commit details
    Browse the repository at this point in the history

  18. Document Downloader class

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    1c264fa View commit details
    Browse the repository at this point in the history

  19. Minor fixes related to naming

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    6b44200 View commit details
    Browse the repository at this point in the history

  20. Make placeholder for WikimediaMobile rendering, refactor isMainPage c… 

    …ondition
    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    eb7ec21 View commit details
    Browse the repository at this point in the history

  21. Create renderer builder

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    3774efd View commit details
    Browse the repository at this point in the history

  22. Document URLBuilder class

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    d07d3ae View commit details
    Browse the repository at this point in the history

  23. Add unit tests for the renderer builder

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    a17a7f6 View commit details
    Browse the repository at this point in the history

  24. Fix typo

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    5e47491 View commit details
    Browse the repository at this point in the history

  25. Refactor Mediawiki class to act as a singleton

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    9fac280 View commit details
    Browse the repository at this point in the history

  26. Update error handling for the renderer builder, minor fixes

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    763328d View commit details
    Browse the repository at this point in the history

  27. Update Downloader class notation

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    2fc046d View commit details
    Browse the repository at this point in the history

  28. Add reset method to Mediawiki, improve Renderer builder

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    261a0ef View commit details
    Browse the repository at this point in the history

  29. Add temporary workaround for article treatment to bypass test/e2e/cmd… 

    ….e2e.test.ts
    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    85a32d5 View commit details
    Browse the repository at this point in the history

  30. Refactor Renderer builder, replace types and interfaces to the Abstra… 

    …ct renderer
    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    28f26b1 View commit details
    Browse the repository at this point in the history

  31. Move getArticleIds to mw-api, minor fixes

    @VadimKovalenkoSNF @kelson42
    VadimKovalenkoSNF authored and kelson42 committed Aug 24, 2023
    Configuration menu
    Copy the full SHA
    d949fd8 View commit details
    Browse the repository at this point in the history