Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Allow long running Exprs to report status to the system #8

Open
GoogleCodeExporter opened this issue Feb 14, 2016 · 0 comments
Open

Comments

@GoogleCodeExporter
Copy link

Long running functions can timeout during map/reduce when one record is
processed for a long time.  We should provide a way that any Expr can
report that progress is being made.  This probably involves placing the
hadoop reporter inside the jaql runtime context, but we will probably want
to abstract away from hadoop a little bit so it works in serial code as well.

This feature should consider a larger feature of reporting on the status of
a query, even when multiple map/reduce jobs are running concurrently.  It
should also include reporting of things besides progress, eg, number of
exceptions that were handled.

Original issue reported on code.google.com by [email protected] on 12 Mar 2009 at 8:26

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

1 participant