Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable caching in flyte-core helmchart #5739

Merged
merged 2 commits into from
Sep 18, 2024
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
7 changes: 4 additions & 3 deletions charts/flyte-core/templates/propeller/configmap.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -48,9 +48,10 @@ data:
{{- end }}
storage.yaml: | {{ tpl (include "storage" .) $ | nindent 4 }}
cache.yaml: |
cache:
max_size_mbs: {{ .Values.flytepropeller.cacheSizeMbs }}
target_gc_percent: 70
storage:
cache:
max_size_mbs: {{ .Values.flytepropeller.cacheSizeMbs }}
target_gc_percent: 70
{{- with .Values.configmap.task_logs }}
task_logs.yaml: | {{ tpl (toYaml .) $ | nindent 4 }}
{{- end }}
Expand Down
11 changes: 6 additions & 5 deletions deployment/eks/flyte_aws_scheduler_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -513,9 +513,10 @@ data:
limits:
maxDownloadMBs: 10
cache.yaml: |
cache:
max_size_mbs: 1024
target_gc_percent: 70
storage:
cache:
max_size_mbs: 1024
target_gc_percent: 70
task_logs.yaml: |
plugins:
logs:
Expand Down Expand Up @@ -1278,7 +1279,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "33bc4dd986fdb015ce49d998deedf122e119579ec09db311e67276230678a70"
configChecksum: "16400bbf28ab823ca433a04379f00fecb11530c3c265dd1bdc3e30209ac6a6d"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -1362,7 +1363,7 @@ spec:
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.13.1
annotations:
configChecksum: "33bc4dd986fdb015ce49d998deedf122e119579ec09db311e67276230678a70"
configChecksum: "16400bbf28ab823ca433a04379f00fecb11530c3c265dd1bdc3e30209ac6a6d"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand Down
11 changes: 6 additions & 5 deletions deployment/eks/flyte_helm_dataplane_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -177,9 +177,10 @@ data:
limits:
maxDownloadMBs: 10
cache.yaml: |
cache:
max_size_mbs: 1024
target_gc_percent: 70
storage:
cache:
max_size_mbs: 1024
target_gc_percent: 70
task_logs.yaml: |
plugins:
logs:
Expand Down Expand Up @@ -429,7 +430,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "33bc4dd986fdb015ce49d998deedf122e119579ec09db311e67276230678a70"
configChecksum: "16400bbf28ab823ca433a04379f00fecb11530c3c265dd1bdc3e30209ac6a6d"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -513,7 +514,7 @@ spec:
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.13.1
annotations:
configChecksum: "33bc4dd986fdb015ce49d998deedf122e119579ec09db311e67276230678a70"
configChecksum: "16400bbf28ab823ca433a04379f00fecb11530c3c265dd1bdc3e30209ac6a6d"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand Down
11 changes: 6 additions & 5 deletions deployment/eks/flyte_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -544,9 +544,10 @@ data:
limits:
maxDownloadMBs: 10
cache.yaml: |
cache:
max_size_mbs: 1024
target_gc_percent: 70
storage:
cache:
max_size_mbs: 1024
target_gc_percent: 70
task_logs.yaml: |
plugins:
logs:
Expand Down Expand Up @@ -1408,7 +1409,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "33bc4dd986fdb015ce49d998deedf122e119579ec09db311e67276230678a70"
configChecksum: "16400bbf28ab823ca433a04379f00fecb11530c3c265dd1bdc3e30209ac6a6d"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -1492,7 +1493,7 @@ spec:
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.13.1
annotations:
configChecksum: "33bc4dd986fdb015ce49d998deedf122e119579ec09db311e67276230678a70"
configChecksum: "16400bbf28ab823ca433a04379f00fecb11530c3c265dd1bdc3e30209ac6a6d"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand Down
11 changes: 6 additions & 5 deletions deployment/gcp/flyte_helm_dataplane_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -180,9 +180,10 @@ data:
limits:
maxDownloadMBs: 10
cache.yaml: |
cache:
max_size_mbs: 1024
target_gc_percent: 70
storage:
cache:
max_size_mbs: 1024
target_gc_percent: 70
task_logs.yaml: |
plugins:
k8s-array:
Expand Down Expand Up @@ -437,7 +438,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "64a3f5e546eddd8126d03c005460b964f428a0da31c0bfac5f70c63fbf3d635"
configChecksum: "b11d6c5dd0dd16bced82fb44fd2fb31c2f27a134543ab7edaf060da42ab27e4"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -520,7 +521,7 @@ spec:
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.13.1
annotations:
configChecksum: "64a3f5e546eddd8126d03c005460b964f428a0da31c0bfac5f70c63fbf3d635"
configChecksum: "b11d6c5dd0dd16bced82fb44fd2fb31c2f27a134543ab7edaf060da42ab27e4"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand Down
11 changes: 6 additions & 5 deletions deployment/gcp/flyte_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -560,9 +560,10 @@ data:
limits:
maxDownloadMBs: 10
cache.yaml: |
cache:
max_size_mbs: 1024
target_gc_percent: 70
storage:
cache:
max_size_mbs: 1024
target_gc_percent: 70
task_logs.yaml: |
plugins:
k8s-array:
Expand Down Expand Up @@ -1431,7 +1432,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "64a3f5e546eddd8126d03c005460b964f428a0da31c0bfac5f70c63fbf3d635"
configChecksum: "b11d6c5dd0dd16bced82fb44fd2fb31c2f27a134543ab7edaf060da42ab27e4"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -1514,7 +1515,7 @@ spec:
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.13.1
annotations:
configChecksum: "64a3f5e546eddd8126d03c005460b964f428a0da31c0bfac5f70c63fbf3d635"
configChecksum: "b11d6c5dd0dd16bced82fb44fd2fb31c2f27a134543ab7edaf060da42ab27e4"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand Down
11 changes: 6 additions & 5 deletions deployment/sandbox/flyte_helm_generated.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -683,9 +683,10 @@ data:
limits:
maxDownloadMBs: 10
cache.yaml: |
cache:
max_size_mbs: 0
target_gc_percent: 70
storage:
cache:
max_size_mbs: 0
target_gc_percent: 70
task_logs.yaml: |
plugins:
logs:
Expand Down Expand Up @@ -7182,7 +7183,7 @@ spec:
template:
metadata:
annotations:
configChecksum: "84d449758d51dc641aff55ae07f4376a860b5038e8407cb9d2444c4f895d953"
configChecksum: "8a003fdbed4b3801328c26cb5c202e4ca113875347388366d29a302d610e7e4"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
labels:
Expand Down Expand Up @@ -7258,7 +7259,7 @@ spec:
app.kubernetes.io/name: flyte-pod-webhook
app.kubernetes.io/version: v1.13.1
annotations:
configChecksum: "84d449758d51dc641aff55ae07f4376a860b5038e8407cb9d2444c4f895d953"
configChecksum: "8a003fdbed4b3801328c26cb5c202e4ca113875347388366d29a302d610e7e4"
prometheus.io/path: "/metrics"
prometheus.io/port: "10254"
spec:
Expand Down
4 changes: 2 additions & 2 deletions docker/sandbox-bundled/manifests/complete-agent.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -816,7 +816,7 @@ type: Opaque
---
apiVersion: v1
data:
haSharedSecret: bTM0eldMZ3IxWE1jZXZ3cg==
haSharedSecret: aVh1N3lZb0F1c2l0NHVuRg==
proxyPassword: ""
proxyUsername: ""
kind: Secret
Expand Down Expand Up @@ -1413,7 +1413,7 @@ spec:
metadata:
annotations:
checksum/config: 8f50e768255a87f078ba8b9879a0c174c3e045ffb46ac8723d2eedbe293c8d81
checksum/secret: f6b8f4ae413528aa882ed401dca20e11f8947e1ca829df6bedbf16698de03cdf
checksum/secret: 042e6b21a3852a65952e0701cd9667e53bfef57590eea4d116b261472f29a882
labels:
app: docker-registry
release: flyte-sandbox
Expand Down
4 changes: 2 additions & 2 deletions docker/sandbox-bundled/manifests/complete.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -798,7 +798,7 @@ type: Opaque
---
apiVersion: v1
data:
haSharedSecret: Wkl6V2diWk50S1Ftd1R3Nw==
haSharedSecret: Q2EyanRtd1JjWmVKS2tHMw==
proxyPassword: ""
proxyUsername: ""
kind: Secret
Expand Down Expand Up @@ -1362,7 +1362,7 @@ spec:
metadata:
annotations:
checksum/config: 8f50e768255a87f078ba8b9879a0c174c3e045ffb46ac8723d2eedbe293c8d81
checksum/secret: ab69c0935db6eb0dd11b9df6716336d8f993cb949d112fd0417d1133a88000cc
checksum/secret: 01201329c98a1417f04feeef00dc21e67cf73d99ac9b99486ce5788eca0c282c
labels:
app: docker-registry
release: flyte-sandbox
Expand Down
4 changes: 2 additions & 2 deletions docker/sandbox-bundled/manifests/dev.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -499,7 +499,7 @@ metadata:
---
apiVersion: v1
data:
haSharedSecret: Z1BQdzNCck9SbGF2bFBNcg==
haSharedSecret: N3dIemE2TnF1b3l1SWdNTw==
proxyPassword: ""
proxyUsername: ""
kind: Secret
Expand Down Expand Up @@ -934,7 +934,7 @@ spec:
metadata:
annotations:
checksum/config: 8f50e768255a87f078ba8b9879a0c174c3e045ffb46ac8723d2eedbe293c8d81
checksum/secret: 42de0a9877ccf019375a303e7a813c44ec6dc92758e3af6c0f10aeb4c3a1071c
checksum/secret: ca7423805c2fd3a98507c790af575a6e5389f50d6baa09bd8c49cb59c4452340
labels:
app: docker-registry
release: flyte-sandbox
Expand Down
Loading