Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Online training - networked options #23

Open
gnperdue opened this issue Oct 11, 2019 · 1 comment
Open

Online training - networked options #23

gnperdue opened this issue Oct 11, 2019 · 1 comment
Milestone
low-latency-on-bo...

Comments

@gnperdue
Copy link
Contributor

Suppose we attempt to train online in tandem with some networked PC - how do we collect and communicate experience (to a replay buffer style system, for example)? How do return gradients? (Do we rebuild the FPGA and re-flash or write to registers)? What is the right timing for that?

Likely some overlap with this issue and #12
@gnperdue gnperdue added this to the low-latency-on-board-model milestone Dec 4, 2019
@gnperdue
Copy link
Contributor Author

It will also be important to weigh this against #22

A key issue will be making the system robust enough to work for production operations.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
low-latency-on-board-model
Development

No branches or pull requests
1 participant
@gnperdue