Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Update Pandas Parser to add more read functions #30

Open
sgoldenCS opened this issue Apr 12, 2024 · 0 comments
Open

Update Pandas Parser to add more read functions #30

sgoldenCS opened this issue Apr 12, 2024 · 0 comments
Assignees
Labels
enhancement New feature or request Priority #3
Milestone

Comments

@sgoldenCS
Copy link
Contributor

Currently the PandasParser only allows for the following file_formats:

  • csv
  • feather
  • json
  • pickle

A trivial improvement would be to add other functions that are already supported by Pandas including:

  • html
  • excel
  • fwf
  • table
  • sql
  • clipboard
  • parquet
  • orc
  • xml
  • stata
  • sas
  • spss

It might not be worthwhile to include all of them, but some might be more useful than others (excel, parquet, xml?).

Additionally, I think we could write a custom function that reads numpy files that would look something like the following:

def read_numpy(path, **kwargs):
    data = np.load(path)
    return pd.DataFrame(data, **kwargs)

The current structure of the PandasParser should allow any simple function that returns a pd.DataFrame to be used with only minor modifications to the parser module. This saves the work of re-writing an entire parser module that outputs a Pandas DataFrame for a new file format.

@Kishanrajput Kishanrajput added this to the May Release milestone May 1, 2024
@Kishanrajput Kishanrajput added enhancement New feature or request Priority #3 labels May 1, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request Priority #3
Projects
None yet
Development

No branches or pull requests

2 participants