Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Desenvolvimento do webscraping - LinkedIn] Acessar análises da página oficial do SJ #18

Open
renata-olivmachado opened this issue Apr 24, 2024 · 1 comment
Assignees
Milestone

Comments

@renata-olivmachado
Copy link

renata-olivmachado commented Apr 24, 2024

Tarefa da Story: #16

Desenvolver webscraping Python, podendo usar selenium ou outra lib.
O webscraping deve logar no LinkedIn, acessar a página do SJ e extrair os dados para o AWS S3.

@Moscarde
Copy link

Arquivo da classe ScraperLinkedin no repositório

Após confirmação de login é possivel rodar um loop para acessar cada página de extração:

    extraction_urls = [
            f"https://www.linkedin.com/company/{self.company_code}/admin/analytics/updates/",
            f"https://www.linkedin.com/company/{self.company_code}/admin/analytics/visitors/",
            f"https://www.linkedin.com/company/{self.company_code}/admin/analytics/followers/",
            f"https://www.linkedin.com/company/{self.company_code}/admin/analytics/competitors/",
        ]

        for url in extraction_urls:
            self.driver.get(url)

Esse trecho de código está presente na função ScraperLinkedin.extract_data

@Moscarde Moscarde moved this from Backlog da Sprint de Dev to Em Desenvolvimento in IlimiDados (Dashboards) Apr 25, 2024
@Moscarde Moscarde moved this from Em Desenvolvimento to Validação Senior in IlimiDados (Dashboards) Apr 25, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
Archived in project
Development

No branches or pull requests

3 participants