Advanced Computing in the Age of AI | Thursday, March 28, 2024

Wallaroo.AI Introduces Powerful Workload Orchestration Features to Scale ML Workflows 

NEW YORK, June 6, 2023 -- Wallaroo.AI, a leader in scaling production machine learning (ML) on premise, in the cloud, and at the edge, today announced early access of ML Workload Orchestration features in its unified production ML platform. This unique capability facilitates automation, scheduling and execution of combined data and ML inferencing workflows across the production process, enabling AI teams to scale their ML workflows by 5-10x while also freeing up 40% of their weekly time, based on customer data.

Data scientists, data engineers, and ML engineers no longer need to waste time trying to set up the basic elements of data and ML pipelines with unwieldy tools. Removing these unnecessary and time-consuming steps accelerates the feedback loop from model deployment to business value so organizations can troubleshoot and tune models to respond more quickly to unsatisfactory performance of the model and market changes.

With these ML Workload Orchestration features, enterprises can now also be data-source agnostic, ensure business continuity with portable ML pipelines that move from development through to production, and scale ML use cases.

“Going from ML prototype to production is a huge challenge and even when enterprises succeed with ad hoc approaches, most don’t have the efficiency, flexibility, or repeatability in their processes that they need to scale their ML,” said Vid Jain, founder and chief executive officer of Wallaroo.AI. “This is usually because they’ve had to create ML production workflows from scratch or integrate discrete tooling across the various stages of the production ML process. Because Wallaroo.AI is a single unified platform, we’re able to provide an easy-to-use fully integrated experience – minimizing operational overhead and bottlenecks so you can scale quickly and efficiently.”

Workload Orchestration Details

As enterprise AI teams upload their models, they can now define their ML workload steps and set up a schedule with just a few lines of code, if they use the Wallaroo.AI platform with the new Workload Orchestration features. Behind the scenes, this new technology orchestrates scheduling and infrastructure utilization, data gathering and inferencing while ensuring resilience. Teams can then monitor workloads and review results as needed.

Integrations - The Wallaroo.AI platform now includes support for data connections across the three major cloud datastores, Google Cloud, Amazon Web Services, and Microsoft Azure as well as Wallaroo SDK and Wallaroo API support. Enterprises can now ingest data from predefined data sources to run inferences in the Wallaroo.AI platform, chain pipelines, and send inference results to predefined destinations to analyze model insights and assess business outcomes.

Security - The new data connections use authentication management at the platform level to ensure security. The new cloud datastore connections can be configured in Wallaroo workspaces, which is where the ML Workload Orchestration management lives.

Automation and Scripting - Users now have the ability to execute interactive (realtime) and scheduled (batch) workloads across the ML production process (deployment, serving, observing, optimization). The Wallaroo.AI platform also now includes support for custom/arbitrary python scripts and chained ML models and pipelines.

About Wallaroo.AI

Wallaroo.AI empowers enterprise AI teams to scale Machine Learning (ML) to drive positive outcomes with a unified software platform that enables deployment, observability, optimization and scalability of ML on premise, in the cloud, and at the edge. The unified Wallaroo.AI platform enables enterprise AI teams to easily deploy ML in seconds with no fuss or engineering overhead. They can then observe and optimize in real-time from a self-service operations center. Enterprises can run at scale with 80% less infrastructure and turbocharge their Databricks and Cloud ML production workflows using familiar dev tools. Wallaroo.AI is backed by Microsoft’s venture fund, M12, and leading VCs including Boldstart, Contour Ventures, Enicac, Greycroft, and Ridgeline.


Source: Wallaroo.AI

EnterpriseAI