Code

V2.0.0#1732

Code

Open

d116626 wants to merge 234 commits intomasterbasedosdados/sdk:masterfrom v2.0.0basedosdados/sdk:v2.0.0Copy head branch name to clipboard

+20-10

Commits

Commits on Nov 3, 2022

• [infra] Version 1.7.0 python-package

  lucascr91

  committed
  77540ab

• [infra] fix update_columns test

  lucascr91

  committed
  b0f5dfe

• [infra] remove unused import

  lucascr91

  committed
  17ba1ba

Commits on Nov 7, 2022

• [infra] add to_partition utility function

  lucascr91

  committed
  a3f71df

• [infra] add test for to_partitions

  lucascr91

  committed
  91ea441

Commits on Nov 8, 2022

• Merge branch 'master' of https://github.com/basedosdados/mais into v1.7.0

  lucascr91

  committed
  c51b4aa

• [infra] pump package version 1.6.9-b2

  lucascr91

  committed
  0cba449

Commits on Nov 9, 2022

• [infra] add break_file feature

  lucascr91

  committed
  6aaa1b1

• Revert "[infra] pump package version 1.6.9-b2"

  Show description for bef2953
  mfagundes

  committed
  bef2953

Commits on Nov 30, 2022

• feat: add connection_id to external data configuration

  gabriel-milan

  committed
  2640684

• fix(Datatype): add connection id for external configuration

  gabriel-milan

  committed
  dffb8ab

• feat: add automatic management of BQ connection

  gabriel-milan

  committed
  cbfdeca

• chore: fix linting issues

  gabriel-milan

  committed
  d10cee8

Commits on Dec 1, 2022

• feat: add test folder to gitignore

  d116626

  committed
  69555f0

• feat: release beta version

  d116626

  committed
  4ca854f

• feat(Connection): add service_account property

  gabriel-milan

  committed
  61a6f88

• feat(Base): add IAM stuff

  gabriel-milan

  committed
  34fe6eb

• chore: fix linting issues

  gabriel-milan

  committed
  5122127

• feat: automatic granting roles to BigLake service account

  gabriel-milan

  committed
  e701d06

• feat: better error handling, set biglake permissions is now optional

  gabriel-milan

  committed
  43f7913

• feat: release beta version

  d116626

  committed
  39e700a

Commits on Dec 5, 2022

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  8294db7

Commits on Dec 6, 2022

• chore: modify log message

  gabriel-milan

  committed
  1f4ab2e

Commits on Dec 7, 2022

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  99c0911

Commits on Dec 8, 2022

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  69ed7ef

Commits on Dec 12, 2022

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  7a2536e

• chore: make all partitions string

  d116626

  committed
  d2d6b28

Commits on Dec 13, 2022

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  e468f5d

Commits on Dec 14, 2022

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  2f61e97

• Merge branch 'master' into v1.7.0

  d116626

  committed
  278cbda

• chore: merge master

  d116626

  committed
  77bd36f

• Merge branch 'v1.7.0' into feat/add-biglake-tables

  d116626

  authored
  5b74d01

• add __version__ atribute (#1488)

  Show description for 417aa6e
  

  fernandascovino

  and

  mergify[bot]

  authored
  417aa6e

• add option to change copied table name (#1489)

  Show description for 0e74206
  

  fernandascovino

  and

  mergify[bot]

  authored
  0e74206

• Merge branch 'v1.7.0' into feat/add-biglake-tables

  mergify[bot]

  authored
  a9dccb9

• fix: pylint

  d116626

  committed
  1f651d6

• Merge branch 'v1.7.0' into feat/add-biglake-tables

  mergify[bot]

  authored
  a904c66

Commits on Dec 21, 2022

• changing python_path fixture

  mfagundes

  committed
  70acbda

• adding shapely as dependency to downgrade if already installed, like Colab

  mfagundes

  committed
  2da91f8

• pylinting files

  mfagundes

  committed
  78c3574

Commits on Dec 22, 2022

• Merge branch 'master' into fix/shapely-dependency

  mergify[bot]

  authored
  cad1400

• bump version 1.6.10-beta.1

  mfagundes

  committed
  fc983fa

• Merge remote-tracking branch 'origin/fix/shapely-dependency' into fix/shapely-dependency

  mfagundes

  committed
  221a137

Commits on Jan 9, 2023

• Merge branch 'master' into fix/shapely-dependency

  mfagundes

  committed
  a570f45

• bump version 1.6.10

  mfagundes

  committed
  4e6792b

Commits on Jan 12, 2023

• Merge branch 'master' into python-1.6.10

  mfagundes

  committed
  3c16959

Commits on Jan 17, 2023

• Merge branch 'master' into v1.7.0

  mfagundes

  committed
  0e530da

• updating version

  mfagundes

  committed
  667fce1

Commits on Jan 23, 2023

• Merge branch 'python-1.6.10' into v1.7.0

  mfagundes

  committed
  8b2e5e6

• return update_columns to Table class

  mfagundes

  committed
  4e4f381

Commits on Jan 25, 2023

• authentication methods in base class

  mfagundes

  committed
  2cab54d

• method to return dataset id from slug using graphql

  mfagundes

  committed
  c427511

• method to return table id from slug of dataset and table using graphql

  mfagundes

  committed
  bc038d4

• using variables in graphql query

  mfagundes

  committed
  218aea9

Commits on Jan 26, 2023

• change default & log downloaded path

  fernandascovino

  committed
  119c7b6

• Merge branch 'master' into fix/python-storage-download-path

  mergify[bot]

  authored
  ed55994

• authentication with graphql

  mfagundes

  committed
  d44c874

Commits on Jan 27, 2023

• change version in pyproject.toml

  mfagundes

  committed
  cca4333

• fix: merge master

  d116626

  committed
  7349e93

• chore: refactor connection imports and make working dir default for storage download

  d116626

  committed
  dbf3b91

• chore: make staging the default mode for storage download

  d116626

  committed
  04216fe

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  5c337cd

• chore: make staging the default mode for storage download

  d116626

  committed
  0ee6dad

• Merge branch 'feat/add-biglake-tables' of https://github.com/basedosdados/mais into feat/add-biglake-tables

  d116626

  committed
  3b286a4

• fix: pylint

  d116626

  committed
  b8f7b6e

• chore: release new beta version

  d116626

  committed
  7bb5f16

Commits on Jan 28, 2023

• small corrections in 1.6.11

  mfagundes

  committed
  1a956f0

• Merge branch 'master' into python-1.6.11

  mfagundes

  committed
  06c28cb

Commits on Jan 30, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  37f7d6a

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  07ee69a

Commits on Jan 31, 2023

• methods to retrieve metadata from graphql api

  mfagundes

  committed
  6726d6d

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  17345c5

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  6987083

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  6569ac1

Commits on Feb 1, 2023

• adding data to api_data_dict

  mfagundes

  committed
  f14d882

• adding exists_in_api method

  mfagundes

  committed
  b297d24

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  b72f65a

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  6e1d35d

• changing is_updated method

  mfagundes

  committed
  bcc147c

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  8155b76

Commits on Feb 2, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  7930e25

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  b613043

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  aee249a

Commits on Feb 6, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  fa7f28f

• method to get a request in graphql

  mfagundes

  committed
  7f6686c

• logging errors with loguru, instead of print

  mfagundes

  committed
  cbe8acd

Commits on Feb 8, 2023

• writing yaml files before updating the database

  mfagundes

  committed
  83e44f0

• helper to convert case from snake_case to camelCase and vice versa

  mfagundes

  committed
  b075602

Commits on Feb 9, 2023

• start refactoring the query to use alias

  mfagundes

  committed
  2600f47

• refactoring: clean edges and nodes from graphql response

  mfagundes

  committed
  dd6ef1a

Commits on Feb 12, 2023

• moving graphql queries for separated files and others

  mfagundes

  committed
  4bb261d

Commits on Feb 13, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  dcfd441

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  2b2f1b1

Commits on Feb 14, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  e57db4c

• improving unit tests and graphql for api_metadata

  mfagundes

  committed
  3d5ebe9

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  92ca3d4

Commits on Feb 15, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  4d6c364

Commits on Feb 16, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  dc97bd6

Commits on Feb 17, 2023

• changing api_response for compatibility with current yamls

  mfagundes

  committed
  ad0f30f

• Hotfix storage init args (#1576)

  Show description for 0e6a386
  

  10 peopleauthored
  0e6a386

• Merging version 1.6.11 into 1.7.0

  mfagundes

  committed
  76dc755

Commits on Feb 22, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  ca47458

Commits on Feb 24, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  83c452d

Commits on Feb 27, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  c993639

Commits on Feb 28, 2023

• removing coverage from query

  mfagundes

  committed
  8ff247b

• fixes in dataset and table config files creation

  mfagundes

  committed
  e029536

• owner_org and exists_in_api methods

  mfagundes

  committed
  df57a7a

Commits on Mar 1, 2023

• removing references to REST API and treat errors in login

  mfagundes

  committed
  aa14e0e

• adjustments in data_dict, tests for publish

  mfagundes

  committed
  7d98b9e

• initializing RemoteAPI for mutations

  mfagundes

  committed
  92464a8

Commits on Mar 2, 2023

• mutation to create a dataset

  mfagundes

  committed
  6d7cba6

Commits on Mar 3, 2023

• adjustments in data_dict and others

  mfagundes

  committed
  7833b29

Commits on Mar 4, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  3d2928d

Commits on Mar 6, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  7ac8b9b

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  2baf9d1

Commits on Mar 7, 2023

• corrections and new table for publish tests

  mfagundes

  committed
  a3d798b

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  42cea57

Commits on Mar 8, 2023

• Merge branch 'master' into v1.7.0

  Show description for b3ecbb6
  mfagundes

  committed
  b3ecbb6

• removing IDE settings from project

  mfagundes

  committed
  5a8fef9

• prevent exclusion of tmp_bases when it already exists

  mfagundes

  committed
  6c2a003

• change filename to avoid conflict in tests

  mfagundes

  committed
  d7af38b

• commiting notebook file as it does not rollback, despite the fact that contents are identical

  mfagundes

  committed
  bc59197

Commits on Mar 9, 2023

• stable exists method

  mfagundes

  committed
  0960516

Commits on Mar 10, 2023

• metadata_modified as datetime

  mfagundes

  committed
  fb3aaa4

Commits on Mar 13, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  ca101cc

Commits on Mar 14, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  996d732

Commits on Mar 15, 2023

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  6499f23

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  9245b43

• Merge branch 'master' into feat/add-biglake-tables

  mergify[bot]

  authored
  ca4a61e

Commits on Apr 3, 2023

• chore: remove yaml dependecy from metadata.py

  d116626

  committed
  9f6d686

• chore: remove yaml dependecy from metadata.py

  d116626

  committed
  fa7c081

• feat: remove more code

  d116626

  committed
  507621b

• feat: remove more code

  d116626

  committed
  a216095

Commits on Apr 5, 2023

• initial structure

  d116626

  committed
  be52f98

• chore: refactor graphql requests

  d116626

  committed
  4588881

• chore: refactor graphql requests

  d116626

  committed
  d04d88b

• chore: refactor graphql requests

  d116626

  committed
  107d65d

Commits on Apr 10, 2023

• chore: make publish_sql

  d116626

  committed
  ad33499

Commits on May 8, 2023

• feat: add backend class for handling interaction with graphql

  gabriel-milan

  committed
  a471546

Commits on May 9, 2023

• chore: clean some code and comment parts where table_config are needed

  d116626

  committed
  58b091b

• chore: clean some code and comment parts where table_config are needed

  d116626

  committed
  e78e8ec

• chore: add dataset config query

  d116626

  committed
  c711bd7

• chore: add table config query

  d116626

  committed
  723436b

• feat: create dataset and use API metadata

  d116626

  committed
  325efc7

• chore(deps): remove unnecessary deps

  gabriel-milan

  committed
  1327588

• chore: minor cleanup

  gabriel-milan

  committed
  626a83f

• chore: delete file

  gabriel-milan

  committed
  79205e8

• feat: fix occurences of table_config

  gabriel-milan

  committed
  743491c

• feat: add API url to config init

  gabriel-milan

  committed
  bd48905

• feat: add structure for Metadata.create

  gabriel-milan

  committed
  e7eb09f

Commits on May 10, 2023

• chore: more table modifications

  d116626

  committed
  54902fb

• merge biglake branch

  d116626

  committed
  31c42fc

• feat: table create using data_columns and partitioned data

  d116626

  committed
  87b2c0b

• feat: some refactor and finish table.create

  d116626

  committed
  68aa341

• chore: better casing

  d116626

  committed
  c01d07a

• chore: better casing

  d116626

  committed
  e18a528

• chore: better logging

  d116626

  committed
  571c070

• chore: update table.create docstring

  d116626

  committed
  89e7c9f

• chore: clean config files

  d116626

  committed
  ba81cfa

Commits on May 11, 2023

• feat: refactor table.publish and table.update

  d116626

  committed
  2e96ee5

• chore: make publish.sql from staging schema

  d116626

  committed
  acf67a4

• feat: get partition dict from storage

  d116626

  committed
  87f85aa

• chore: rename some methods

  d116626

  committed
  0b68fdd

• chore: update and publish only acts in prod and uses the staging table schema to generate the prod publish query and update schema

  d116626

  committed
  4e753f2

Commits on May 12, 2023

• chore: load schema using SchemaField, remove code that depends on template

  d116626

  committed
  3a974ea

• chore: refactor init process

  d116626

  committed
  c68b47e

• chore: remove upload function from cli

  d116626

  committed
  d324a25

• chore: remove upload function from cli

  d116626

  committed
  510aaf9

• chore: clean unused imports, redo poetry packages and release 2.0.0-b1

  d116626

  committed
  b4f8f03

Commits on May 13, 2023

• chore: add a new dependencie requests-toolbelt

  d116626

  committed
  4ab9959

• chore: add tomlkit and better error if columns does not have name

  d116626

  committed
  3f7f2ac

Commits on May 15, 2023

• chore: error handling and make publish and update get info from api if existis

  d116626

  committed
  0ec5286

• fix: typo in _get_columns_from_data and better infos

  d116626

  committed
  77d522e

• chore: add tomlkit

  d116626

  committed
  82eeeef

• chore: error handling in case that API is off

  d116626

  committed
  76a1637

Commits on May 16, 2023

• chore: error handling in case that API is off

  d116626

  committed
  0e97037

Commits on May 17, 2023

• hotfix: chang metadata base_url

  d116626

  committed
  6355196

• chore: get backend metadata from cloud tables

  d116626

  committed
  09ecafc

• feat: bump beta version

  d116626

  committed
  144e08e

Commits on May 19, 2023

• chore: change mode in table.delete

  d116626

  committed
  b7e825b

• chore: pump version

  d116626

  committed
  47efb6c

Commits on Jun 26, 2023

• chore: no more version number on files

  gabriel-milan

  committed
  bf9320e

• feat: implement external warnings and messages

  gabriel-milan

  committed
  acb5854

Commits on Aug 21, 2023

• feat: add csv_delimiter and allow csv_allow_jagged_rows

  d116626

  committed
  db51c49

• fix: pump bd version and add new parameters csv_delimiter and csv_allow_jagged_rows

  d116626

  committed
  7c6ee34

Commits on Aug 23, 2023

• chore: cleanup

  gabriel-milan

  committed
  6ccceda

• chore: remove compressed r package

  gabriel-milan

  committed
  0863bdb

Commits on Aug 24, 2023

• chore: refactor dependency management

  gabriel-milan

  committed
  bb48ea2

• chore: fix linting issues

  gabriel-milan

  committed
  39ad10d

• chore: remove pylint action

  gabriel-milan

  committed
  ce96f58

• fix: change install instructions

  d116626

  committed
  3748388

• feat: pump bd version

  d116626

  committed
  b98aeb6

• fix: change install instructions

  d116626

  committed
  f3e6c69

• feat: pump bd version

  d116626

  committed
  00dc835

• feat: add new parameter csv_skip_leading_rows and setup.py

  d116626

  committed
  6b937ca

• feat: pump bd version

  d116626

  committed
  216894d

• chore: merge branch v1.7.0 and feat/add-biglake-tables

  d116626

  committed
  33d492f

Commits on Aug 25, 2023

• chore: merge master and fix conflicts

  d116626

  committed
  884ce26

• Merge branch 'master' into feat/remove_yamls

  mergify[bot]

  authored
  a791652

• chore: fix conflicts

  d116626

  committed
  75aa2f4

• Merge branch 'feat/remove_yamls' of https://github.com/basedosdados/mais into feat/remove_yamls

  d116626

  committed
  c33a431

• chore: add all extra

  gabriel-milan

  committed
  ef46c4d

• chore: lint

  gabriel-milan

  committed
  7369617

Commits on Aug 28, 2023

• Merge branch 'master' into feat/remove_yamls

  mergify[bot]

  authored
  146afc2

Commits on Aug 30, 2023

• feat: create branch v2.0.0

  d116626

  committed
  7dca3b6

Commits on Sep 2, 2023

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  c69f84d

Commits on Sep 12, 2023

• fix: add csv delimiter to schema

  d116626

  committed
  2e856e9

• Merge branch 'v2.0.0' of https://github.com/basedosdados/mais into v2.0.0

  d116626

  committed
  50cd8ec

Commits on Sep 21, 2023

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  125f28f

Commits on Sep 26, 2023

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  0635373

Commits on Oct 3, 2023

• feat: expand credential scope to drive and bq

  d116626

  committed
  61d2655

Commits on Jan 8, 2024

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  bb26637

Commits on Jan 11, 2024

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  84b8b5c

Commits on Jan 21, 2024

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  ea62797

Commits on Feb 20, 2024

• chore: start cleaning tests

  d116626

  committed
  14c0ee9

Commits on Mar 5, 2024

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  653f256

Commits on Mar 23, 2024

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  ed85bb5

Commits on Apr 1, 2024

• Merge branch 'master' into v2.0.0

  mergify[bot]

  authored
  dab0051

Commits on Apr 2, 2024

• chore: add timeout to pypi warning

  d116626

  committed
  4562113

Commits on Jul 24, 2024

• fix: log in wrong position

  d116626

  committed
  ce941af

• fix: log in wrong position

  d116626

  committed
  f6b4265

• fix: log in wrong position

  d116626

  committed
  1918719

• fix: fix conflicts

  d116626

  committed
  aae3cf8

• fix: fix conflicts

  d116626

  committed
  f27f4d3

• Fix #1718 (#1719)

  Show description for c61cf96
  

  16 peopleauthored
  c61cf96

• feat: pump bd version

  d116626

  committed
  0baab83

• Merge branch 'v2.0.0' of https://github.com/basedosdados/mais into v2.0.0

  d116626

  committed
  b925445

• chore: remove deprecated actions

  d116626

  committed
  7a91bc3

• chore: add core.base in init

  d116626

  committed
  e998c82

• chore: add core.base in init

  d116626

  committed
  42c86d5

• chore: add core.base in init

  d116626

  committed
  abf73f2

• Merge branch 'master' of https://github.com/basedosdados/mais into v2.0.0

  d116626

  committed
  4302b9d

Commits on Sep 30, 2024

• fix _set_config_variables is not defined (#1729)

  aspeddro

  authored
  5e11cac

Commits on Dec 19, 2024

• fix: chage c_file path to get config file from core

  d116626

  committed
  840a87d