Skip to content
This repository has been archived by the owner on Aug 29, 2023. It is now read-only.

Complete rewrite of the Storage system #46

Open
wants to merge 149 commits into
base: master
Choose a base branch
from
Open

Complete rewrite of the Storage system #46

wants to merge 149 commits into from

Conversation

luxas
Copy link
Contributor

@luxas luxas commented Jan 26, 2021

TODO to add more description here, but overall:

  • make the system way more pluggable and interface-driven
  • implement the controller-runtime Client interface for great interopability
  • use existing libraries in k8s.io/apimachinery to an even greater extent

luxas added 30 commits December 28, 2020 21:58
@luxas
Guard against nil in GVKForObject
6e1bed1
@luxas
Handle the case where the kind directory does not exist when listing
35ed90d
@luxas
Handle the case in Storage.Patch where the underlying RawStorage retu…
69e47d6 
…rns YAML
@luxas
Add a labels filter, split name & namespace to separate filters, impl…
2693d1d 
…ement controller-runtime-style options, and relevant opt interfaces for interoperability.
@luxas
Make pretty encoding catch also cases when the target object implemen…
9c060fb 
…ts MarshalJSON(), by always first encoding "non-pretty", and indenting the JSON a configurable amount of spaces after encoding, but before handing the data to the framewriter.
@luxas
Make FrameReader thread-safe, and implement a Single-Frame FrameReader
b644f73
@luxas
Handle updated kyaml in tests
6d64cff
@luxas
Always add the mutex when creating the framewriter in test
29e4ca6
@luxas
Move common functions to an utils file. Add a mutex to guard the sche…
21b8571 
…me in the serializer. Add a JSONTransformer interface, and make ContentType implement it.
@luxas
Never convert unknown, unstructured or partial objects
a9985cc
@luxas
Guard the AddKnownTypes call to the scheme by a mutex, to avoid race …
7106536 
…conditions.
@luxas
Make it possible for the codec used internally to recognize partial o…
5864288 
…bjects and lists by their embedded TypeMeta info.
@luxas
Use the upstream YAML MetaFactory.
951a162
@luxas
Fix the code getting the extension from the content-type, earlier it …
1dd8632 
…was racy.
@luxas
Use the "functional" options pattern from controller-runtime in the s…
73f90ba 
…erializer.
@luxas
Create pluggable namespace-related bridges between our Storage system…
143839c 
… and the rest of Kubernetes.
@luxas
Add IntPtr to utils.
df6dc0d
@luxas
Add a new Patcher interface to the serializer, that can patch both ty…
590b98d 
…ped and unstructured objects.
@luxas
Fix default value in godoc
da0e977
@luxas
update import
02e0e44
@luxas
Add context & a Namespacer to RawStorage, and support a bit more vari…
23b74bf 
…ety of paths
@luxas
Rewrite patchutil to only operate on bytes, and add support for diffe…
4ec5457 
…rent patch types. The "object patching" part has been moved to the serializer.
@luxas
Rewrite the key system; import most things from pkg/client
173c31a
@luxas
First snapshot of the storage system rewrite.
97db70a
@luxas
Check in all the really core interfaces of the storage system
d1f6dc0
@luxas
Check in a filesystem abstraction layer that will be used across the …
f50276b 
…system.
@luxas
format.go contains common interfaces and implementations of content-t…
51f6a88 
…ype and file-extension lookups
@luxas
Implementations for (Unversioned)ObjectID
8324247
@luxas
A set of common error creation and check functions
a039e08
@luxas
Implement a default ObjectRecognizer
eb6af4c
luxas added 20 commits February 5, 2021 20:33
@luxas
Reject expired contexts in the backend
cf792b0
@luxas
Unify some locking code in the txclient
60c90f2
@luxas
Move the singleframereader, update it slightly, and add a singleframe…
2e257ae 
…writer implementation too
@luxas
Use the singleframewriter in the backend to support any content type.
5847540
@luxas
Implement ListGroupKinds in storage.Lister across the system.
e8949ff
@luxas
Fix small bug
653075a
@luxas
Fix minor bugs in the txclient, and move one func to utils.go
8230bcc
@luxas
Create a btree high-level implementation that supports indexing and m…
9320092 
…ulti-versioning
@luxas
Add a helper function to list unique submatches
ca752ab
@luxas
Refactor the unstructured FileFinder to work with the BTree instead
fdca597
@luxas
Add new versionref-related functions to the unstructured FileFinder, …
c33cbd5 
…and automatically use it when syncing the unstructured Storage.
@luxas
Remove the old mapped cache
0d4cfd6
@luxas
Create a hook for automatically doing a copy-on-write for a new branc…
0babdfd 
…h transaction
@luxas
go mod tidy
7df21b4
@luxas
Document the btree index from the ground up, and implement Find/List …
5785701 
…in a good manner, instead of the prior hacks. Add a generic string-string ValueItem, and expose the queries publicly.
@luxas
Add unit test for the btree index impls.
2844d8c
@luxas
Improve ListUnique greatly, remove the hacky AdvanceLastChar, and add…
eb2a8a2 
… unit tests and comments
@luxas
Update the unstructured filefinder to use the latest BTree impl
c879b47
@luxas
Initial stab at a git interface internally
b492c2d
@luxas
WIP
72aa730
@luxas luxas mentioned this pull request Jul 7, 2021
Open
Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.
1 participant
@luxas