Init helm charts

helm/.helmignore

@@ -0,0 +1,23 @@
+# Patterns to ignore when building packages.
+# This supports shell glob matching, relative path matching, and
+# negation (prefixed with !). Only one pattern per line.
+.DS_Store
+# Common VCS dirs
+.git/
+.gitignore
+.bzr/
+.bzrignore
+.hg/
+.hgignore
+.svn/
+# Common backup files
+*.swp
+*.bak
+*.tmp
+*.orig
+*~
+# Various IDEs
+.project
+.idea/
+*.tmproj
+.vscode/

helm/Chart.yaml

@@ -0,0 +1,24 @@
+apiVersion: v2
+name: llm-d-modelservice
+description: A Helm chart for ModelService
+
+# A chart can be either an 'application' or a 'library' chart.
+#
+# Application charts are a collection of templates that can be packaged into versioned archives
+# to be deployed.
+#
+# Library charts provide useful utilities or functions for the chart developer. They're included as
+# a dependency of application charts to inject those utilities and functions into the rendering
+# pipeline. Library charts do not define any templates and therefore cannot be deployed.
+type: application
+
+# This is the chart version. This version number should be incremented each time you make changes
+# to the chart and its templates, including the app version.
+# Versions are expected to follow Semantic Versioning (https://semver.org/)
+version: 0.0.1
+
+# This is the version number of the application being deployed. This version number should be
+# incremented each time you make changes to the application. Versions are not expected to
+# follow Semantic Versioning. They should reflect the version the application is using.
+# It is recommended to use it with quotes.
+appVersion: "0.0.1"

helm/examples/README.md

@@ -0,0 +1,44 @@
+# Examples
+
+Contains example values file and their rendered templates.
+
+```
+cd helm 
+helm template [RELEASE-NAME] . -f [VALUES-FILEPATH]
+```
+
+1. `vllm-sim` in Kind 
+
+    Make sure there is a gateway (Kgteway or Istio) deployed in the cluster named `llm-d-inference-gateway` or change values file accordingly.
+
+    ```
+    helm template llmd-sim . -f examples/values-vllm-sim.yaml > examples/output-vllm-sim.yaml
+    ```
+
+    Remove `protocol: tcp` in `initContainers` and `readinessProbe` and `livenessProbe` from epp deployment
+
+
+2. `facebook/opt-125m`: downloads from Hugging Face 
+
+    ```
+    helm template facebook . -f examples/values-facebook.yaml > examples/output-facebook.yaml
+    ```
+
+
+Port forward the inference gateway 
+
+```
+k port-forward svc/llm-d-inference-gateway-istio 8000:80
+```
+
+Send a request
+
+```
+curl http://localhost:8000/v1/completions -vvv \
+    -H "Content-Type: application/json" \
+    -H "x-model-name: facebook/opt-125m" \
+    -d '{
+    "model": "facebook/opt-125m",
+    "prompt": "Hello, "
+}'
+```