Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Data structures for approximate queries. #88

Closed
wants to merge 27 commits into from
Closed

Data structures for approximate queries. #88

wants to merge 27 commits into from

Conversation

ujvl
Copy link
Collaborator

@ujvl ujvl commented Mar 12, 2018

PR for #86.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/241/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/242/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/243/
Test PASSed.

@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/246/
Test PASSed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/248/
Test FAILed.

ujvl added 8 commits July 10, 2018 19:12
@ujvl
Initial generic count-min-sketch implementation.
c6543e8 
* Generic interface for arbitrary types.

* Hash manager for sharing hash functions between sketches.

* No concurrency guarantees yet.
@ujvl
Bug fixes, count-min-sketch test.
bd73a85
@ujvl
* Count-min-sketch now thread safe.
b220632 
* Templated counter type for potentially better configurable space savings.
@ujvl
Count-sketch implementation, using writh median finding algorithm.
7eae4d0 
* Can use thread-local median buffers for estimate().
@ujvl
Convencience constructors for monologs, hashing changes.
9eaf74a 
* Less support for arbitrary T.

* But faster hashing with std::hash.
@ujvl
Universal monitor.
830afed
@ujvl
Predictable behavior from count-sketch.
2996b33 
* Size of sketch and accuracy of estimates are correlated.

* Verified that estimates are not guaranteed to be non-negative and that this is correct behavior.
@ujvl
Universal Sketch working.
d56e5ca
@ujvl ujvl force-pushed the approx-queries branch from 81772cd to d56e5ca Compare July 17, 2018 17:07
@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/303/
Test PASSed.

@ujvl
Complete universal sketch (correct & predictable behavior)
26da3d1 
* Using PQ to track heavy hitters gives precise results

* Using PQ approximation (hash map) gives less predictable results
@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/304/
Test PASSed.

@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/305/
Test PASSed.

ujvl added 2 commits July 23, 2018 04:40
@ujvl
Minor changes.
05ea229
@ujvl
Test with zipf, change error measurements.
3d46249 
* Measure errors for elements with frequencies exceeding alpha threshold (count sketch). This shows a much more reasonable trend in the errors (parameters respected). Doesn't make sense to measure median over all errors since this includes infrequent elements.

* Zipf handled well by universal sketch.

* Need to rewrite tests / remove heavy computation from them and put somewhere else (only test correctness).
@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/306/
Test FAILed.

@ujvl
Testing universal sketch adding layers behavior
8c033c2 
* Increasing the number of layers only helps until a point, and then query accuracy decreases(although seems to still be within guaranteed bounds under current tests).

* Minor changes.

* Removed class templating.

* Commented out univmon dependency.
@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/307/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/308/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/309/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/310/
Test FAILed.

@ujvl ujvl force-pushed the approx-queries branch from b602fc2 to 33e2708 Compare July 24, 2018 03:06
@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/311/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/312/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/313/
Test FAILed.

@ujvl ujvl force-pushed the approx-queries branch from 11af5a5 to 0bc97dd Compare July 24, 2018 04:15
@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/314/
Test PASSed.

@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/315/
Test PASSed.

@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/316/
Test PASSed.

@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/317/
Test PASSed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/318/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test FAILed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/319/
Test FAILed.

@AmplabJenkins
Copy link
Collaborator

Test PASSed.
Refer to this link for build results (access rights to CI server needed):
https://amplab.cs.berkeley.edu/jenkins//job/confluo-prb/320/
Test PASSed.

@ujvl
Copy link
Collaborator Author

ujvl commented Dec 27, 2018

Closing, will create new PR.

@ujvl ujvl closed this Dec 27, 2018
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
2 participants
@ujvl @AmplabJenkins