diff --git a/controllers/job_mgr/README.md b/controllers/job_mgr/README.md index dc488934..431e2dcf 100644 --- a/controllers/job_mgr/README.md +++ b/controllers/job_mgr/README.md @@ -22,7 +22,7 @@ When Job Manager is an enabled service LMevalJob requires `kueue.x-k8s.io/queue- curl -L https://github.com/kubernetes-sigs/kueue/releases/download/v0.8.1/manifests.yaml | sed 's/# externalFrameworks/ externalFrameworks/; s/# - "Foo.v1.example.com"/ - "trustyai.opendatahub.io\/lmevaljob"/'|kubectl apply --server-side -f - ``` - Create 2 sets of Kueue CRs. + After the kueue-controller-manager deployment is ready, create a ClusterQueue, ResourceFlavor, and a namespaced LocalQueue at least. ```bash cat </var/run/secrets/kubernetes.io/serviceaccount/namespace ENABLED_SERVICES=LMES,JOB_MGR make run ``` @@ -138,8 +102,129 @@ When Job Manager is an enabled service LMevalJob requires `kueue.x-k8s.io/queue- INFO Starting workers {"controller": "lmevaljob", "controllerGroup": "trustyai.opendatahub.io", "controllerKind": "LMEvalJob", "worker count": 1} INFO Starting workers {"controller": "LMEvalJobWorkload", "controllerGroup": "trustyai.opendatahub.io", "controllerKind": "LMEvalJob", "worker count": 1} ``` -1. Quota and Node Affinity example. We will create 5 jobs. - +1. Admit an lmevaljob to the `user-queue` LocalQueue, specify `kueue.x-k8s.io/queue-name: user-queue` in the metadata.labels + ```bash + cat < 0 { nsl := psi[0].NodeSelector // Note there is only 1 element in podset array see PodSets method above. + if len(nsl) == 0 { + return nil + } nsra := []corev1.NodeSelectorRequirement{} for k, v := range nsl { nsr := corev1.NodeSelectorRequirement{