thanks @mrbobbytables that’s very interesting.
I run a small company that does a lot of HPC work for the financial sector (risk calculations and the like) and many of our clients use products like IBM’s Platform Symphony and TIBCO GridServer and curiously the challenges I see in trying to move their workloads to K8 is different to the sorts of things you’ve outlined. Happy to share more on what they are if that’s of interest.
The kube-arbitrator project you’ve pointed me to looks very interesting especially as it alludes to being derived form experience on using products like Symphony before. I’ve taken a quick look at the README and the tutorial but if someone could give me a high level idea of the architecture and maybe some kind of idea of the direction you’re hoping to move it in that would be very helpful and potentially something we might be able to help with too.
I certainly agree that we’ll see a shift away from traditional HPC workloads and in fact many of my existing and previous clients are actively exploring this (hence me asking these questions!). There is a definite desire to be able to use K8 to provide a generic compute resource which can be used equally by applications and HPC alike
(and personally I have grander visions of where I’d like to see that go… must put pen to paper on that).
I’ve joined the slack channel too, so thanks for the pointer.