Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Upgrade puppeteer and other dependencies #102

Draft
wants to merge 19 commits into
base: main
Choose a base branch
from
Draft

Upgrade puppeteer and other dependencies #102

wants to merge 19 commits into from

Commits on Sep 3, 2024

  1. Show absolute numbers in progress bar

    @muodov
    muodov committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    09922cb View commit details
    Browse the repository at this point in the history

  2. Speed up url filtering

    @muodov
    muodov committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    7a5bec9 View commit details
    Browse the repository at this point in the history

  3. log how many URLs were skipped

    @muodov
    muodov committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    c56379b View commit details
    Browse the repository at this point in the history

  4. upgrade puppeteer (still old)

    @muodov
    muodov committed Sep 3, 2024
    Configuration menu
    Copy the full SHA
    4983060 View commit details
    Browse the repository at this point in the history

Commits on Sep 4, 2024

  1. WIP: manage browsers on a lower level 

    (cherry picked from commit 8451d39)
    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    fee07fd View commit details
    Browse the repository at this point in the history

  2. remove some selenium-related stuff

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    40e8fc7 View commit details
    Browse the repository at this point in the history

  3. download chromium to a local dir 

    (cherry picked from commit 24f8060)
    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    dd615d7 View commit details
    Browse the repository at this point in the history

  4. download chromium in crawler 

    (cherry picked from commit c317cb9)
    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    030866c View commit details
    Browse the repository at this point in the history

  5. Wait for full init on main page before reporting 

    (cherry picked from commit e029d54)
    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    f2f9f23 View commit details
    Browse the repository at this point in the history

  6. remove unnecessary imports

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    69f8154 View commit details
    Browse the repository at this point in the history

  7. Use raw CDP in CMP collector

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    79510f5 View commit details
    Browse the repository at this point in the history

  8. Update chalk, node types and remove pre-push (tests are run in CI)

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    73c38db View commit details
    Browse the repository at this point in the history

  9. Remote unnecessary @types/stack-utils and upgrade tldts

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    b6ec60c View commit details
    Browse the repository at this point in the history

  10. Upgrade commander

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    8cf124f View commit details
    Browse the repository at this point in the history

  11. Upgrade async library

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    4bd1822 View commit details
    Browse the repository at this point in the history

  12. Fix some unit tests

    @muodov
    muodov committed Sep 4, 2024
    Configuration menu
    Copy the full SHA
    f4ae631 View commit details
    Browse the repository at this point in the history

Commits on Sep 5, 2024

  1. Fix more tests after chromium upgrade

    @muodov
    muodov committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    fc49507 View commit details
    Browse the repository at this point in the history

  2. Add missing typings

    @muodov
    muodov committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    fc83426 View commit details
    Browse the repository at this point in the history

  3. Disable some API attribution tests due to a known bug

    @muodov
    muodov committed Sep 5, 2024
    Configuration menu
    Copy the full SHA
    f4e80bf View commit details
    Browse the repository at this point in the history