Archive 22.04.2026

Page 3 of 9
1 2 3 4 5 9

Your AI agents will run everywhere. Is your architecture ready for that? 

You bet on a hyperscaler to power your AI ambitions. One provider, one ecosystem, one set of tools. What nobody said out loud is that you just walked into a walled garden.

The walls are the point. AWS, GCP, and Azure can all be connected to other environments, but none of them is built to serve as a neutral control layer across the rest. And none of them extends that control cleanly across your on-premise systems, edge environments, and business applications by default.

So most enterprises end up with one of two bad options: consolidate more of the stack into one cloud and accept the lock-in, or hand-build brittle integrations across environments and accept the operational risk.

This isn’t about where your AI platform runs. It’s about where your agents execute, and whether your architecture can govern them consistently everywhere they do. 

Agents don’t stay inside walls. They need to operate across business applications, clouds, on-premise systems, and edge environments, consistently, securely, and under unified governance. No single hyperscaler is designed to provide that across a heterogeneous enterprise estate. And while patchwork integrations can bridge the gaps temporarily, they rarely provide the consistency, control, or durability that enterprise-scale agent deployment requires.

Key takeaways

  • Agentic AI requires infrastructure-agnostic deployment so agents can run consistently across cloud, on-premise, and edge environments.
  • Every major cloud provider operates as a walled garden. Without a vendor-neutral control plane, multi-cloud agentic AI becomes far harder to govern, scale, and keep consistent across environments.
  • Governance must follow the agent everywhere, ensuring consistent security, lineage, and behavior across every environment it touches.
  • Infrastructure-agnostic deployment is a strategic cost lever, enabling smarter workload placement, avoiding vendor lock-in, and improving performance. 
  • Build-once, deploy-anywhere execution is achievable today, but only with a platform that separates governance from compute and orchestrates across all environments.

The hybrid and multi-cloud trap most enterprises are already in 

Most enterprise AI workloads don’t live in one place. They’re scattered across business applications, multiple clouds, on-premise systems, and edge environments. That distribution looks like flexibility. In practice, it’s fragmentation.

Each environment runs its own security model, configuration logic, and identity controls. What enterprises usually lack is a native, cross-environment way to coordinate those differences under one operating model. So they end up making one of two bad choices.

  1. Consolidation: Move everything into one cloud, accept the data gravity, navigate the sovereignty constraints, and pay for the migrations. And once you’re all in, you’re all in. Switching costs make the lock-in permanent in everything but name.
  2. Integration: Hand-build the connectors, the IAM mappings, the data pipelines, and the monitoring hooks across every environment. This works until it doesn’t. Policies drift. Tools fall out of sync. 

When an agent calls a tool in one environment using assumptions baked in from another, behavior becomes unpredictable and failures are hard to trace. Security gaps appear not because anyone made a bad decision, but because no one had visibility across the whole system.

Without a coordination layer above all environments, tracking assets, enforcing governance, and monitoring performance consistently become fragmented and hard to sustain. For traditional AI workloads, that’s already a serious problem. For agentic AI, it becomes a critical failure point.

Agentic AI doesn’t just expose your infrastructure gaps. It amplifies them

Traditional AI workloads are relatively forgiving of infrastructure fragmentation. A model running in one cloud, returning predictions to one application, can tolerate some environmental inconsistency. Agents can’t.

Agentic AI systems make decisions, trigger actions, and execute multi-step workflows autonomously. They call tools, query data, and interact with business applications across whatever environments those resources live in. 

That means infrastructure inconsistency doesn’t just create operational friction. It changes the conditions under which agents reason, call tools, and execute workflows, which can lead to inconsistent behavior across environments.

To operate safely and reliably, agents require consistency across five dimensions:

  • Consistent reasoning behavior. Agents plan and make decisions based on context. When the tools, data, or APIs available to an agent change between environments, its reasoning changes too — producing different outputs for the same inputs. At enterprise scale, that inconsistency is ungovernable.
  • Consistent tool access. Agents need to call the same APIs and reach the same resources regardless of where they’re running. Environment-specific rewrites don’t scale and introduce failure points that are difficult to detect and nearly impossible to audit.
  • Consistent governance and lineage. Every decision, data interaction, and action an agent takes must be tracked, logged, and compliant — across all environments, not just the ones your security team can see.
  • Consistent performance. Latency and throughput differences across cloud and on-premise hardware affect how agents execute time-sensitive workflows. Performance variability isn’t just an engineering problem. It’s a business reliability problem.
  • Consistent safety and auditability. Guardrails, identity controls, and access policies must follow the agent wherever it runs. An agent that operates under strict governance in one environment and loose controls in another isn’t governed at all.

What a vendor-neutral control plane actually gives you

The consistency that enterprise agentic AI requires usually does not come from any single cloud provider. It comes from a layer above the infrastructure: a vendor-neutral control plane that governs how agents behave regardless of where they run.

This isn’t about where your AI platform is deployed. It’s about where your agents execute, and ensuring that wherever that is, governance, security, and behavior travel with them.

That control plane does three things hyperscaler ecosystems struggle to do consistently on their own:

  • Enables agents to execute where data lives. Cross-environment data movement is expensive, slow, and often non-compliant. A vendor-neutral control plane lets agents operate where the data already resides, eliminating the cost and compliance risk of moving sensitive data across environments to meet compute requirements.
  • Unifies identity and access across every environment. Without a central identity layer, every cloud and on-premise environment maintains its own access controls, creating gaps where agent permissions are inconsistent or unaudited. A vendor-neutral control plane enforces the same identity, RBAC, and approval workflows everywhere, so there’s no environment where an agent operates outside policy.
  • Centralizes policy without limiting deployment flexibility. Security and governance rules are written once and propagated automatically across every environment. Policies don’t drift. Compliance doesn’t require per-environment validation. And when requirements change, updates apply everywhere simultaneously.

This is what a multi-cloud orchestration layer like Covalent makes operationally real: reducing environment-specific infrastructure differences behind a common control layer so agents can be governed and executed more consistently whether they run in a public cloud, on-premise, at the edge, or alongside business platforms like SAP, Salesforce, or Snowflake.

The architectural requirements for infrastructure-agnostic agentic AI 

Building for infrastructure agnosticism isn’t a single decision. It’s a set of architectural commitments that work together to ensure agents behave consistently, securely, and governably across every environment they touch. Here’s what that foundation looks like. 

Separation of control plane and compute plane

Two distinct functions. Two distinct layers.

  • Control plane. Where governance lives. Security policies, identity controls, compliance rules, and audit logging are defined once and applied everywhere.
  • Compute plane. Where execution happens. Clouds, on-premise systems, edge environments, GPU clusters — wherever agents need to run.

Separating them means governance follows the agent automatically rather than being rebuilt for each new environment. When requirements change, updates propagate everywhere. When a new environment is added, it inherits existing controls immediately.

This is what makes build-once, deploy-anywhere operationally real rather than aspirationally true.

Containerization and standardized interfaces

Separating control from compute sets the architectural principle. Containerization and standardized interfaces are what make it executable at the agent level.

  • Containerization. Agents are packaged with everything they need to run: runtime, dependencies, configuration. What works in AWS works on-premise. What works on-premise works at the edge. No rebuilding per environment.
  • Standardized interfaces. Agents interact with tools, data, and other agents the same way regardless of where compute lives. No environment-specific rewrites. No workflow rebuilding. No behavioral drift.

Without both, every new deployment is effectively a new build.

Policy inheritance and governance consistency

Separating control from compute only delivers value if governance actually travels with the agent. Policy inheritance is how that happens.

When security and governance rules are defined centrally, every agent automatically inherits and applies enterprise-compliant behavior wherever it runs. No manual reconfiguration per environment. No gaps between what policy says and what agents do.

What this means in practice:

  • No policy drift. Changes propagate automatically across every environment simultaneously.
  • No compliance blind spots. Every environment operates under the same rules, whether it’s a public cloud, on-premise system, or edge deployment.
  • Faster audit cycles. Compliance teams validate one operating model instead of assessing each environment independently.

Lineage, versioning, and reproducibility

Observability tells you what agents are doing right now. Lineage tells you what they did, why, and with what version of which tools and models.

In enterprise environments where agents are making consequential decisions at scale, that distinction matters. Every agent action, tool call, and model version needs to be traceable and reproducible. When something goes wrong — and at scale, something always does — you need to reconstruct exactly what happened, in which environment, under which conditions.

Lineage also makes agent updates safer. When you can version tools, models, and agent definitions independently and trace their interactions, you can roll back selectively rather than broadly. That’s the difference between a controlled update and an enterprise-wide incident.

Without lineage, you don’t have governance. You have hope.

Unified observability and auditability

Governance and policy consistency mean nothing without visibility. When agents are making decisions and triggering actions autonomously across multiple environments, you need a single, unified view of what they’re doing, where they’re doing it, and whether it’s working as intended.

That means one consolidated view across:

  • Performance: Latency, throughput, and task-quality signals across every environment.
  • Drift: Detecting when agent behavior deviates from expected patterns before it becomes a business problem.
  • Security events: Identity anomalies, access violations, and guardrail triggers surfaced in one place regardless of where they occur.
  • Audit trails: Every agent action, tool call, and workflow step logged and traceable across all environments.

Without unified observability, you’re not governing a distributed agentic system. You’re hoping it’s working.

How infrastructure-agnostic deployment simplifies compliance and eliminates vendor lock-in

When each cloud and on-premise environment runs its own security model, audit process, and configuration standards, the gaps between them become the risk. Policies fall out of sync. Audit trails fragment. Security teams lose visibility precisely where agents are most active. For regulated industries, that exposure isn’t theoretical. It’s an audit finding waiting to happen.

Infrastructure-agnostic deployment gives compliance teams a single entry point to govern, monitor, and secure every agentic workload regardless of where it runs.

  • Consistent security controls. Identity, RBAC, guardrails, and access permissions are defined once and enforced everywhere. No rebuilding configurations for AWS, then Azure, then GCP, then on-premise.
  • No policy drift. In multi-cloud environments, policies maintained separately per environment will diverge over time. A single infrastructure-agnostic control plane propagates changes automatically, keeping every environment aligned without manual correction.
  • Simplified governance reviews. Compliance teams validate one operating model instead of auditing each environment independently, accelerating alignment with SOC 2, ISO 27001, FedRAMP, GDPR, and internal risk frameworks.
  • Unified audit logging. Every agent action, tool call, and workflow step is captured in one place. End-to-end traceability is the default, not something reconstructed after the fact.

When governance and orchestration live above the cloud layer rather than inside it, workloads are far easier to move between environments without large-scale rewrites, duplicated security rework, or full compliance revalidation from scratch.

Infrastructure agnosticism is also a cost strategy 

Vendor lock-in doesn’t just constrain your architecture. It constrains your leverage. When all your agentic AI workloads run inside one hyperscaler’s ecosystem, you pay their prices, on their terms, with no practical alternative.

Infrastructure-agnostic deployment changes that calculus. When workloads can move with less friction, cost becomes more of a controllable variable rather than a fixed amount you simply absorb.

  • Burst to lower-cost GPU providers when demand spikes. Rather than over-provisioning expensive reserved capacity, workloads shift automatically to alternative GPU clouds when needed and scale back when demand drops.
  • Use purpose-built clouds for training. Not all clouds handle AI training equally. Infrastructure-agnostic deployment lets you route training workloads to providers optimized for that task and avoid paying general-purpose compute rates for specialized work.
  • Run inference on-premise or in cheaper regions. Steady-state and latency-tolerant inference workloads don’t need to run in expensive primary cloud regions. Routing them to lower-cost environments is a straightforward cost lever that’s only accessible when your architecture isn’t locked to one provider.
  • Preserve negotiating leverage. When you can move workloads with far less friction, you are less captive to a single provider’s pricing and capacity constraints. That optionality has real financial value, even when you do not exercise it often.

Deploy anywhere, govern everywhere

Infrastructure-agnostic deployment isn’t an architectural preference. It’s the prerequisite for enterprise agentic AI that actually works, consistently, securely, and at scale across every environment your business runs on.

Where to run your AI platform is only half the question. The harder half is whether your agents can execute anywhere your business needs them to, under governance that travels with them.

The walled garden was never a foundation. It was a starting point. The enterprises that will lead on agentic AI are the ones building above it.

See the Agent Workforce Platform in action.

FAQs

Why do enterprises need infrastructure-agnostic deployment for agentic AI?

Agentic AI relies on consistent tool access, reasoning behavior, memory, governance, and auditability. These requirements break down when agents run in environments that enforce different security models, APIs, networking patterns, or hardware assumptions.

Infrastructure-agnostic deployment provides a unified control plane that sits above all clouds, on-premise systems, and edge environments. This ensures that agents operate the same way everywhere, using the same policies, lineage, access controls, and orchestration logic, regardless of where the compute actually runs.

What makes multi-cloud and hybrid AI deployments so challenging today?

Cloud providers operate as walled gardens. AWS, GCP, and Azure can all be connected to other environments, but none is designed to act as a neutral control layer across the rest, and none extends governance cleanly across on-premise or edge environments by default. Without a neutral control layer, enterprises face two bad options: centralize all workloads into one cloud, which is unrealistic for sovereignty, cost, and data-gravity reasons, or hand-build brittle integrations across environments.

These manual integrations often drift, introduce security gaps, and create inconsistent agent behavior. Infrastructure-agnostic deployment solves this by providing a single orchestration and governance layer across all environments.

How does infrastructure-agnostic deployment support compliance?

Compliance becomes significantly easier when all agent activity flows through a single entry point. Infrastructure-agnostic deployment enables unified audit logging, consistent RBAC and identity controls, and standardized policy enforcement across every environment.

Instead of evaluating each cloud independently, compliance teams can validate one operating model for SOC 2, ISO 27001, GDPR, FedRAMP, or internal risk frameworks. It also reduces policy drift, as changes propagate everywhere automatically, allowing security and governance standards to remain stable over time.

Does this approach help reduce vendor lock-in?

Yes. When governance, orchestration, policy controls, and agent behavior are defined at the control-plane level rather than inside a specific cloud, enterprises can move or scale workloads freely.

This makes it possible to burst to alternative GPU providers, keep sensitive workloads on-premise, or switch clouds for cost or availability reasons without rewriting code or rebuilding configurations. The result is more leverage, lower long-term cost, and the ability to adapt as infrastructure needs change.

What’s the biggest misconception about hybrid or cross-environment agent deployment?

Many organizations assume they can deploy agents the same way they deploy traditional applications, by running identical containers in multiple clouds. But agents are not simple services. They depend on reasoning, multi-step workflows, tool use, memory, and safety constraints that must behave identically across environments.

Hardware differences, networking assumptions, inconsistent security models, and cloud-specific APIs can cause agents to behave unpredictably if not managed centrally. A vendor-neutral control plane is required to preserve consistent behavior and governance across all environments.

How does DataRobot enable “build once, deploy anywhere” execution?

DataRobot provides a centralized control plane for agent governance, lineage, and security, with one critical distinction: governance is enforced at Day 0, meaning it’s baked into the agent’s definition at build time, not added after deployment. 

Workloads run wherever the customer needs them, whether in a public cloud, on-premise, at the edge, in specialized GPU clouds, or directly inside business applications like SAP, Salesforce, and Snowflake, through Covalent-powered multi-cloud orchestration. Standardized agent templates and tool interfaces ensure consistent behavior across every environment, while the Unified Workload API allows models, tools, containers, and NIMs to run without environment-specific rewrites. The result is agentic AI that doesn’t just run everywhere. It runs safely everywhere.

The post Your AI agents will run everywhere. Is your architecture ready for that?  appeared first on DataRobot.

AI latency is a business risk. Here’s how to manage it

When a major insurer’s AI system takes months to settle a claim that should be resolved in hours, the problem usually isn’t the model in isolation. It’s the system around the model and the latency that system introduces at every step.

Speed in enterprise AI isn’t about impressive benchmark numbers. It’s about whether AI can keep pace with the decisions, workflows, and customer interactions the business depends on. And in production, many systems can’t. Not under real load, not across distributed infrastructure, and not when every delay affects cost, conversion, risk, or customer trust.

The danger is that latency rarely appears alone. It is tightly coupled with cost, accuracy, infrastructure placement, retrieval design, orchestration logic, and governance controls. Push for speed without understanding those dependencies, and you do one of two things: overspend to brute-force performance, or simplify the system until it is faster but less useful.

That is why latency is not just an engineering metric. It is an operating constraint with direct business consequences. This guide explains where latency comes from, why it compounds in production, and how enterprise teams can design AI systems that perform when the stakes are real.

Key takeaways

  • Latency is a system-level business issue, not a model-level tuning problem. Faster performance depends on infrastructure, retrieval, orchestration, and deployment design as much as model choice.
  • Where workloads run often determines whether SLAs are realistic. Data locality, cross-region traffic, and hybrid or multi-cloud placement can add more delay than inference itself.
  • Predictive, generative, and agentic AI create different latency patterns. Each requires a different operating strategy, different optimization levers, and different business expectations.
  • Sustainable performance requires automation. Manual tuning does not scale across enterprise AI portfolios with changing demand, changing workloads, and changing cost constraints.
  • Deployment flexibility matters because AI has to run where the business operates. That may mean containers, scoring code, embedded equations, or workloads distributed across cloud, hybrid, and on-premises environments.

The business cost of AI that can’t keep up

Every second your AI lags, there’s a business consequence. A fraud charge that goes through instead of getting flagged. A customer who abandons a conversation before the response arrives. A workflow that grinds for 30 seconds when it should resolve in two.

In predictive AI, this means meeting strict operational response windows inside live business systems. When a customer swipes their credit card, your fraud detection model has roughly 200 milliseconds to flag suspicious activity. Miss that window and the model may still be accurate, but operationally it has already failed.

Generative AI introduces a different dynamic. Responses are generated incrementally, retrieval steps may happen before generation begins, and longer outputs increase total wait time. Your customer service chatbot might craft the perfect response, but if it takes 10 seconds to appear, your customer is already gone.

Agentic AI raises the stakes further. A single request may trigger retrieval, planning, multiple tool calls, approval logic, and one or more model invocations. Latency accumulates across every dependency in the chain. One slow API call, one overloaded tool, or one approval checkpoint in the wrong place can turn a fast workflow into a visibly broken one. 

Each AI type carries different latency expectations, but all three are constrained by the same underlying realities: infrastructure placement, data access patterns, model execution time, and the cost of moving information across systems.​​

Speed has a price. So does falling behind.

Most AI initiatives go sideways when teams optimize for speed, then act surprised when their costs explode or their accuracy drops. Latency optimization is always a trade-off decision, not a free improvement.

  • Faster is more expensive. Higher-performance compute can reduce inference time dramatically, but it raises infrastructure costs. Warm capacity improves responsiveness, but idle capacity costs money. Running closer to data may reduce latency, but it may also require more complex deployment patterns. The real question is not whether faster infrastructure costs more. It is whether the business cost of slower AI is greater.
  • Faster can reduce quality if teams use the wrong shortcuts. Techniques such as model compression, smaller context windows, aggressive retrieval limits, or simplified workflows can improve response time, but they can also reduce relevance, reasoning quality, or output precision. A fast answer that causes escalation, rework, or user abandonment is not operationally efficient.
  • Faster usually increases architectural complexity. Parallel execution, dynamic routing, request classification, caching layers, and differentiated treatment for simple versus complex requests can all improve performance. But they also require tighter orchestration, stronger observability, and more disciplined operations.

That is why speed is not something enterprises “unlock.” It is something they engineer deliberately, based on the business value of the use case, the tolerance for delay, and the cost of getting it wrong.

Three things that determine whether your AI performs in production 

Three patterns show up consistently across enterprise AI deployments. Get these right and your AI performs. Get them wrong and you have an expensive project that never delivers.

Where your AI runs matters as much as how it runs 

Location is the first law of enterprise AI performance.

In many AI systems, the biggest latency bottleneck is not the model. It is the distance between where compute runs and where data lives. If inference happens in one region, retrieval happens in another, and business systems sit somewhere else entirely, you are paying a latency penalty before the model has even started useful work.

That penalty compounds quickly. A few extra network hops across regions, cloud boundaries, or enterprise systems can add hundreds of milliseconds or more to a request. Multiply that across retrieval steps, orchestration calls, and downstream actions, and latency becomes structural, not incidental.

“Centralize everything” has been the default hyperscaler posture for years, and it starts to break down under real-time AI requirements. Pulling data into a preferred platform may be acceptable for offline analytics or batch processing. It is much less acceptable when the use case depends on real-time scoring, low-latency retrieval, or live customer interaction.

The better approach is to run AI where the data and business process already live: inside the data warehouse, close to existing transactional systems, within on-premises environments, or across hybrid infrastructure designed around performance requirements instead of platform convenience.

Automation matters here too. Manually deciding where to place workloads, when to burst, when to shut down idle capacity, or how to route inference across environments does not scale. Enterprise teams that manage latency well use orchestration systems that can dynamically allocate resources against real-time cost and performance targets rather than relying on static placement assumptions.

Your AI type determines your latency strategy 

Not all AI behaves the same way under pressure, and your latency strategy needs to reflect that.

Predictive AI is the least forgiving. It often has to score in milliseconds, integrate directly into operational systems, and return a result fast enough for the next system to act. In these environments, unnecessary middleware, slow network paths, or rigid deployment models can destroy value even when the model itself is strong.

Generative AI is more variable. Latency depends on prompt size, context size, retrieval design, token generation speed, and concurrency. Two requests that look similar at a business level may have very different response times because the underlying workload is not uniform. Stable performance requires more than model hosting. It requires careful control over retrieval, context assembly, compute allocation, and output length.

Agentic AI compounds both problems. A single workflow may include planning, branching, multiple tool invocations, safety checks, and fallback logic. The performance question is no longer “How fast is the model?” It becomes “How many dependent steps does this system execute before the user sees value?” In agentic systems, one slow component can hold up the entire chain.

What matters across all three is closing the gap between how a system is designed and how it actually behaves in production. Models that are built in one environment, deployed in another, and operated through disconnected tooling usually lose performance in the handoff. The strongest enterprise programs minimize that gap by running AI as close as possible to the systems, data, and decisions that matter.

Why automation is the only way to scale AI performance 

Manual performance tuning does not scale. No engineering team is large enough to continuously rebalance compute, manage concurrency, control spend, watch for drift, and optimize latency across an entire enterprise AI portfolio by hand.

That approach usually leads to one of two outcomes: over-provisioned infrastructure that wastes budget, or under-optimized systems that miss performance targets when demand changes.

The answer is automation that treats cost, speed, and quality as linked operational targets. Dynamic resource allocation can adjust compute based on live demand, scale capacity up during bursts, and shut down unused resources when demand drops. That matters because enterprise workloads are rarely static. They spike, stall, shift by geography, and change by use case.

But speed without quality is just expensive noise. If latency tuning improves response time while quietly degrading answer quality, decision quality, or business outcomes, the system is not improving. It is becoming harder to trust. Sustainable optimization requires continuous accuracy evaluation running alongside performance monitoring so teams can see not just whether the system is faster, but whether it is still working.

Together, automated resource management and continuous quality evaluation are what make AI performance sustainable at enterprise scale without requiring constant manual intervention.

Know where latency hides before you try to fix it 

Optimization without diagnosis is just guessing. Before your teams change infrastructure, model settings, or workflow design, they need to know exactly where time is being lost.

  • Inference is the obvious suspect, but rarely the only one, and often not the biggest one. In many enterprise systems, latency comes from the layers around the model more than the model itself. Optimizing inference while ignoring everything else is like upgrading an engine while leaving the rest of the vehicle unchanged.
  • Data access and retrieval often dominate total response time, especially in generative and agentic systems. Finding the right data, retrieving it across systems, filtering it, and assembling useful context can take longer than the model call itself. That is why retrieval strategy is a performance decision, not just a relevance decision.
  • More data is not always better. Pulling too much context increases processing time, expands prompts, raises cost, and can reduce answer quality. Faster systems often improve because they retrieve less, but retrieve more precisely.
  • Network distance compounds quickly. A 50-millisecond delay across one hop becomes much more expensive when requests touch multiple services, regions, or external tools. At enterprise scale, those increments are not trivial. They determine whether the system can support real-time use cases or not.
  • Orchestration overhead accumulates in agentic systems. Every tool handoff, policy check, branch decision, and state transition adds time. When teams treat orchestration as invisible glue, they miss one of the biggest sources of avoidable delay.
  • Idle infrastructure creates hidden penalties too. Cold starts, spin-up time, and restart delays often show up most visibly on the first request after quiet periods. These penalties matter in customer-facing systems because users experience them directly.

The goal is not to make every component as fast as possible. It is to assign performance targets based on where latency actually affects business outcomes. If retrieval consumes two seconds and inference takes a fraction of that, tuning the model first is the wrong investment.

Governance doesn’t have to slow you down 

Enterprise AI needs governance that enforces auditability, compliance, and safety without making performance unacceptable.

Most governance functions do not need to sit directly in the critical path. Audit logging, trace capture, model monitoring, drift detection, and many compliance workflows can run alongside inference rather than blocking it. That allows enterprises to preserve visibility and control without adding unnecessary user-facing delay.

Some controls do need real-time execution, and those should be designed with performance in mind from the start. Content moderation, policy enforcement, permission checks, and certain safety filters may need to execute inline. When that happens, they need to be lightweight, targeted, and intentionally placed. Retrofitting them later usually creates avoidable latency.

Too many organizations assume governance and performance are naturally in tension. They are not. Poorly implemented governance slows systems down. Well-designed governance makes them more trustworthy without forcing the business to choose between compliance and responsiveness.

It is also worth remembering that perceived speed matters as much as measured speed. A system that communicates progress, handles waiting intelligently, and makes delays visible can outperform a technically faster system that leaves users guessing. In enterprise AI, usability and trust are part of performance.

Building AI that performs when it counts 

Latency is not a technical detail to hand off to engineering after the strategy is set. It is a constraint that shapes what AI can actually deliver, at what cost, with what level of reliability, and in which business workflows it can be trusted.

The enterprises getting this right are not chasing speed for its own sake. They are making explicit operating decisions about workload placement, retrieval design, orchestration complexity, automation, and the trade-offs they are willing to accept between speed, cost, and quality.

Performance techniques that work in a controlled environment rarely survive real traffic unchanged. The gap between a promising proof of concept and a production-grade system is where latency becomes visible, expensive, and politically important inside the business.

And latency is only one part of the broader operating challenge. In a survey of nearly 700 AI leaders, only a third said they had the right tools to get models into production. It takes an average of 7.5 months to move from idea to production, regardless of AI maturity. Those numbers are a reminder that enterprise AI performance problems usually start well before inference. They start in the operating model.

That is the real issue AI leaders have to solve. Not just how to make models faster, but how to build systems that can perform reliably under real business conditions. Download the Unmet AI Needs survey to see the full picture of what is preventing enterprise AI from performing at scale.

Want to see what that looks like in practice? Explore how other AI leaders are building production-grade systems that balance latency, cost, and reliability in real environments.

FAQs

Why is latency such a critical factor in enterprise AI systems?

Latency determines whether AI can operate in real time, support decision-making, and integrate cleanly into downstream workflows. For predictive systems, even small delays can break operational SLAs. For generative and agentic systems, latency compounds across retrieval, token generation, orchestration, tool calls, and policy checks. That is why latency should be treated as a system-level operating issue, not just a model-tuning exercise.

What causes latency in modern predictive, generative, and agentic systems?

Latency usually comes from a mix of factors: inference delays, retrieval and data access, network distance, cold starts, and orchestration overhead. Agentic systems add further complexity because delays accumulate across tools, branches, context passing, and approval logic. The most effective teams identify which layers contribute most to total response time and optimize there first.

How does DataRobot reduce latency without sacrificing accuracy?

DataRobot uses Covalent and syftr to automate resource allocation, GPU and CPU optimization, parallelism, and workflow tuning. Covalent helps manage scaling, bursting, warm pools, and resource shifting so workloads can run on the right infrastructure at the right time. syftr helps teams evaluate accuracy, performance, and drift so they do not improve speed by quietly degrading model quality. Together, they support lower-latency AI that remains accurate and cost-aware.

How do infrastructure placement and deployment flexibility impact latency?

Where compute runs matters as much as the model itself. Long network paths between cloud regions, cross-cloud traffic, and distant data access can inflate latency before useful work begins. DataRobot addresses this by allowing AI to run directly where data lives, including Snowflake, Databricks, on-premises environments, and hybrid clouds. Teams can deploy models in multiple formats and place them in the environments that best support operational performance, rather than forcing workloads into one preferred architecture.

The post AI latency is a business risk. Here’s how to manage it appeared first on DataRobot.

Handle with care: Soft robot gripper picks ripe fruit without bruising

When assessing the ripeness of fruit, sight and smell can tell you a lot, but the best indicator is often how the fruit feels. Cornell researchers used stretchable fiber-optic sensors to create a soft robot gripper that can predict the ripeness of strawberries by touch, then gently twist them off their branch or vine without causing any damage.

AI system learns to keep warehouse robot traffic running smoothly

By Adam Zewe

Inside a giant autonomous warehouse, hundreds of robots dart down aisles as they collect and distribute items to fulfill a steady stream of customer orders. In this busy environment, even small traffic jams or minor collisions can snowball into massive slowdowns.

To avoid such an avalanche of inefficiencies, researchers from MIT and the tech firm Symbotic developed a new method that automatically keeps a fleet of robots moving smoothly. Their method learns which robots should go first at each moment, based on how congestion is forming, and adapts to prioritize robots that are about to get stuck. In this way, the system can reroute robots in advance to avoid bottlenecks.

The hybrid system utilizes deep reinforcement learning, a powerful artificial intelligence method for solving complex problems, to figure out which robots should be prioritized. Then, a fast and reliable planning algorithm feeds instructions to the robots, enabling them to respond rapidly in constantly changing conditions.

In simulations inspired by actual e-commerce warehouse layouts, this new approach achieved about a 25 percent gain in throughput over other methods. Importantly, the system can quickly adapt to new environments with different quantities of robots or varied warehouse layouts.

“There are a lot of decision-making problems in manufacturing and logistics where companies rely on algorithms designed by human experts. But we have shown that, with the power of deep reinforcement learning, we can achieve super-human performance. This is a very promising approach, because in these giant warehouses even a two or three percent increase in throughput can have a huge impact,” says Han Zheng, a graduate student in the Laboratory for Information and Decision Systems (LIDS) at MIT and lead author of a paper on this new approach.

Zheng is joined on the paper by Yining Ma, a LIDS postdoc; Brandon Araki and Jingkai Chen of Symbotic; and senior author Cathy Wu, the Class of 1954 Career Development Associate Professor in Civil and Environmental Engineering (CEE) and the Institute for Data, Systems, and Society (IDSS) at MIT, and a member of LIDS. The research appears today in the Journal of Artificial Intelligence Research.

Rerouting robots

Coordinating hundreds of robots in an e-commerce warehouse simultaneously is no easy task.

The problem is especially complicated because the warehouse is a dynamic environment, and robots continually receive new tasks after reaching their goals. They need to be rapidly redirected as they leave and enter the warehouse floor.

Companies often leverage algorithms written by human experts to determine where and when robots should move to maximize the number of packages they can handle.

But if there is congestion or a collision, a firm may have no choice but to shut down the entire warehouse for hours to manually sort the problem out.

“In this setting, we don’t have an exact prediction of the future. We only know what the future might hold, in terms of the packages that come in or the distribution of future orders. The planning system needs to be adaptive to these changes as the warehouse operations go on,” Zheng says.

The MIT researchers achieved this adaptability using machine learning. They began by designing a neural network model to take observations of the warehouse environment and decide how to prioritize the robots. They train this model using deep reinforcement learning, a trial-and-error method in which the model learns to control robots in simulations that mimic actual warehouses. The model is rewarded for making decisions that increase overall throughput while avoiding conflicts.

Over time, the neural network learns to coordinate many robots efficiently.

“By interacting with simulations inspired by real warehouse layouts, our system receives feedback that we use to make its decision-making more intelligent. The trained neural network can then adapt to warehouses with different layouts,” Zheng explains.

It is designed to capture the long-term constraints and obstacles in each robot’s path, while also considering dynamic interactions between robots as they move through the warehouse.

By predicting current and future robot interactions, the model plans to avoid congestion before it happens.

After the neural network decides which robots should receive priority, the system employs a tried-and-true planning algorithm to tell each robot how to move from one point to another. This efficient algorithm helps the robots react quickly in the changing warehouse environment.

This combination of methods is key.

“This hybrid approach builds on my group’s work on how to achieve the best of both worlds between machine learning and classical optimization methods. Pure machine-learning methods still struggle to solve complex optimization problems, and yet it is extremely time- and labor-intensive for human experts to design effective methods. But together, using expert-designed methods the right way can tremendously simplify the machine learning task,” says Wu.

Overcoming complexity

Once the researchers trained the neural network, they tested the system in simulated warehouses that were different than those it had seen during training. Since industrial simulations were too inefficient for this complex problem, the researchers designed their own environments to mimic what happens in actual warehouses.

On average, their hybrid learning-based approach achieved 25 percent greater throughput than traditional algorithms as well as a random search method, in terms of number of packages delivered per robot. Their approach could also generate feasible robot path plans that overcame congestion caused by traditional methods.

“Especially when the density of robots in the warehouse goes up, the complexity scales exponentially, and these traditional methods quickly start to break down. In these environments, our method is much more efficient,” Zheng says.

While their system is still far away from real-world deployment, these demonstrations highlight the feasibility and benefits of using a machine learning-guided approach in warehouse automation.

In the future, the researchers want to include task assignments in the problem formulation, since determining which robot will complete each task impacts congestion. They also plan to scale up their system to larger warehouses with thousands of robots.

AI swarms could hijack democracy without anyone noticing

AI-powered personas are becoming so realistic that they can infiltrate online communities and subtly steer public opinion. Unlike traditional bots, they adapt, coordinate, and refine their messaging at a massive scale, creating a false sense of consensus. Early warning signs—like deepfakes and fake news networks—have already appeared in global elections. Researchers warn that the next election could be the true test of this technology’s power.

AI swarms could hijack democracy without anyone noticing

AI-powered personas are becoming so realistic that they can infiltrate online communities and subtly steer public opinion. Unlike traditional bots, they adapt, coordinate, and refine their messaging at a massive scale, creating a false sense of consensus. Early warning signs—like deepfakes and fake news networks—have already appeared in global elections. Researchers warn that the next election could be the true test of this technology’s power.

Gradient-based planning for world models at longer horizons

BallNav demo
Push-T demo

By Michael Psenka, Mike Rabbat, Aditi Krishnapriyan, Yann LeCun, Amir Bar

GRASP is a new gradient-based planner for learned dynamics (a “world model”) that makes long-horizon planning practical by (1) lifting the trajectory into virtual states so optimization is parallel across time, (2) adding stochasticity directly to the state iterates for exploration, and (3) reshaping gradients so actions get clean signals while we avoid brittle “state-input” gradients through high-dimensional vision models.

Large, learned world models are becoming increasingly capable. They can predict long sequences of future observations in high-dimensional visual spaces and generalize across tasks in ways that were difficult to imagine a few years ago. As these models scale, they start to look less like task-specific predictors and more like general-purpose simulators.

But having a powerful predictive model is not the same as being able to use it effectively for control/learning/planning. In practice, long-horizon planning with modern world models remains fragile: optimization becomes ill-conditioned, non-greedy structure creates bad local minima, and high-dimensional latent spaces introduce subtle failure modes.

In this blog post, I describe the problems that motivated this project and our approach to address them: why planning with modern world models can be surprisingly fragile, why long horizons are the real stress test, and what we changed to make gradient-based planning much more robust.


This blog post discusses work done with Mike Rabbat, Aditi Krishnapriyan, Yann LeCun, and Amir Bar (* denotes equal advisorship), where we propose GRASP.


What is a world model?

These days, the term “world model” is quite overloaded, and depending on the context can either mean an explicit dynamics model or some implicit, reliable internal state that a generative model relies on (e.g. when an LLM generates chess moves, whether there is some internal representation of the board). We give our loose working definition below.

Suppose you take actions a_t \in \mathcal{A} and observe states s_t \in \mathcal{S} (images, latent vectors, proprioception). A world model is a learned model that, given the current state and a sequence of future actions, predicts what will happen next. Formally, it defines a predictive distribution on a sequence of observed states s_{t-h:t} and current action a_t:

    \[P_\theta(s_{t+1} \mid s_{t-h:t},\; a_t)\]

that approximates the environment’s true conditional P(s_{t+1} \mid s_{t-h:t},\; a_t). For this blog post, we’ll assume a Markovian model P(s_{t+1} \mid s_{t-h:t},\; a_t) for simplicity (all results here can be extended to the more general case), and when the model is deterministic it reduces to a map over states:

    \[s_{t+1} = F_\theta(s_t, a_t).\]

In practice the state s_t is often a learned latent representation (e.g., encoded from pixels), so the model operates in a (theoretically) compact, differentiable space. The key point is that a world model gives you a differentiable simulator; you can roll it forward under hypothetical action sequences and backpropagate through the predictions.


Planning: choosing actions by optimizing through the model

Given a start s_0 and a goal g, the simplest planner chooses an action sequence \mathbf{a}=(a_0,\dots,a_{T-1}) by rolling out the model and minimizing terminal error:

    \[\min_{\mathbf{a}} \; \| s_T(\mathbf{a}) - g \|_2^2, \quad \text{where } s_T(\mathbf{a}) = \mathcal{F}_{\theta}^{T}(s_0,\mathbf{a}).\]

Here we use \mathcal{F}^T as shorthand for the full rollout through the world model (dependence on model parameters \theta is implicit):

    \[\mathcal{F}_{\theta}^{T}(s_0, \mathbf{a}) = F_\theta(F_\theta(\cdots F_\theta(s_0, a_0), \cdots, a_{T-2}), a_{T-1}).\]

In short horizons and low-dimensional systems, this can work reasonably well. But as horizons grow and models become larger and more expressive, its weaknesses become amplified.

So why doesn’t this just work at scale?


Why long-horizon planning is hard (even when everything is differentiable)

There are two separate pain points for the more general world model, plus a third that is specific to learned, deep learning-based models.

1) Long-horizon rollouts create deep, ill-conditioned computation graphs

Those familiar with backprop through time (BPTT) may notice that we’re differentiating through a model applied to itself repeatedly, which will lead to the exploding/vanishing gradients problem. Namely, if we take derivatives (note we’re differentiating vector-valued functions, resulting in Jacobians that we denote with D_x (\cdots)) with respect to earlier actions (e.g. a_0):

    \[D_{a_0} \mathcal{F}_{\theta}^{T}(s_0, \mathbf{a}) = \Bigl(\prod_{t=1}^T D_s F_\theta(s_t, a_t)\Bigr) D_{a_0}F_\theta(s_0, a_0).\]

We see that the Jacobian’s conditioning scales exponentially with time T:

    \[\sigma_{\text{max/min}}(D_{a_0}\mathcal{F}_{\theta}^{T}) \sim \sigma_{\text{max/min}}(D_s F_\theta)^{T-1},\]

leading to exploding or vanishing gradients.

2) The landscape is non-greedy and full of traps

At short horizons, the greedy solution, where we move straight toward the goal at every step, is often good enough. If you only need to plan a few steps ahead, the optimal trajectory usually doesn’t deviate much from “head toward g” at each step.

As horizons grow, two things happen. First, longer tasks are more likely to require non-greedy behavior: going around a wall, repositioning before pushing, backing up to take a better path. And as horizons grow, more of these non-greedy steps are typically needed. Second, the optimization space itself scales with horizon: \mathrm{dim}(\mathcal{A} \times \cdots \times \mathcal{A}) = T\mathrm{dim}(\mathcal{A}), further expanding the space of local minima for the optimization problem.

Loss landscape
Distance to goal along the optimal path is non-monotonic, and the resulting loss landscape can be rough.


A long-horizon fix: lifting the dynamics constraint

Suppose we treat the dynamics constraint s_{t+1} = F_{\theta}(s_t, a_t) as a soft constraint, and we instead optimize the following penalty function over both actions (a_0,\ldots,a_{T-1}) and states (s_0,\ldots,s_T):

    \[\min_{\mathbf{s},\mathbf{a}} \mathcal{L}(\mathbf{s}, \mathbf{a}) = \sum_{t=0}^{T-1} \big\|F_\theta(s_t,a_t) - s_{t+1}\big\|_2^2, \quad \text{with } s_0 \text{ fixed and } s_T=g.\]

This is also sometimes called collocation in planning/robotics literature. Note the lifted formulation shares the same global minimizers as the original rollout objective (both are zero exactly when the trajectory is dynamically feasible). But the optimization landscapes are very different, and we get two immediate benefits:

  • Each world model evaluation F_{\theta}(s_t,a_t) depends only on local variables, so all T terms can be computed in parallel across time, resulting in a huge speed-up for longer horizons, and
  • You no longer backpropagate through a single deep T-step composition to get a learning signal, since the previous product of Jacobians now splits into a sum, e.g.:

    \[D_{a_0} \mathcal{L} = 2(F_\theta(s_0, a_0) - s_1).\]

Being able to optimize states directly also helps with exploration, as we can temporarily navigate through unphysical domains to find the optimal plan:

Collocation planning in BallNav
Collocation-based planning allows us to directly perturb states and explore midpoints more effectively.

However, lunch is never free. And indeed, especially for deep learning-based world models, there is a critical issue that makes the above optimization quite difficult in practice.

An issue for deep learning-based world models: sensitivity of state-input gradients

The tl;dr of this section is: directly optimizing states through a deep learning-based F_{\theta} is incredibly brittle, à la adversarial robustness. Even if you train your world model in a lower-dimensional state space, the training process for the world model makes unseen state landscapes very sharp, whether it be an unseen state itself or simply a normal/orthogonal direction to the data manifold.

Adversarial robustness and the “dimpled manifold” model

Adversarial robustness originally looked at classification models f_\theta : \mathbb{R}^{w\times h \times c} \to \mathbb{R}^K, and showed that by following the gradient of a particular logit \nabla f_\theta^k from a base image x (not of class k), you did not have to move far along x' = x + \epsilon\nabla f_\theta^k to make f_\theta classify x' as k (Szegedy et al., 2014; Goodfellow et al., 2015):

Adversarial example
Depiction of the classic example from (Goodfellow et al., 2015).

Later work has painted a geometric picture for what’s going on: for data near a low-dimensional manifold \mathcal{M}, the training process controls behavior in tangential directions, but does not regularize behavior in orthogonal directions, thus leading to sensitive behavior (Stutz et al., 2019). Another way stated: f_\theta has a reasonable Lipschitz constant when considering only tangential directions to the data manifold \mathcal{M}, but can have very high Lipschitz constants in normal directions. In fact, it often benefits the model to be sharper in these normal directions, so it can fit more complicated functions more precisely.

Adversarial perturbations leave the data manifold

As a result, such adversarial examples are incredibly common even for a single given model. Further, this is not just a computer vision phenomenon; adversarial examples also appear in LLMs (Wallace et al., 2019) and in RL (Gleave et al., 2019).

While there are methods to train for more adversarially robust models, there is a known trade-off between model performance and adversarial robustness (Tsipras et al., 2019): especially in the presence of many weakly-correlated variables, the model must be sharper to achieve higher performance. Indeed, most modern training algorithms, whether in computer vision or LLMs, do not train adversarial robustness out. Thus, at least until deep learning sees a major regime change, this is a problem we’re stuck with.

Why is adversarial robustness an issue for world model planning?

Consider a single component of the dynamics loss we’re optimizing in the lifted state approach:

    \[\min_{s_t, a_t, s_{t+1}} \|F_\theta(s_t, a_t) - s_{t+1}\|_2^2\]

Let’s further focus on just the base state:

    \[\min_{s_t} \|F_\theta(s_t, a_t) - s_{t+1}\|_2^2.\]

Since world models are typically trained on state/action trajectories (s_1, a_1, s_2, a_2, \ldots), the state-data manifold for F_{\theta} has dimensionality bounded by the action space:

    \[\mathrm{dim}(\mathcal{M}_s) \le \mathrm{dim}(\mathcal{A}) + 1 + \mathrm{dim}(\mathcal{R}),\]

where \mathcal{R} is some optional space of augmentations (e.g. translations/rotations). Thus, we can typically expect \mathrm{dim}(\mathcal{M}_s) to be much lower than \mathrm{dim}(\mathcal{S}), and thus: it is very easy to find adversarial examples that hack any state to any other desired state.

As a result, the dynamics optimization

    \[\sum_{t=0}^{T-1} \big\|F_\theta(s_t,a_t) - s_{t+1}\big\|_2^2\]

feels incredibly “sticky,” as the base points s_t can easily trick F_{\theta} into thinking it’s already made its local goal.1

Adversarial world model example


1. This adversarial robustness issue, while particularly bad for lifted-state approaches, is not unique to them. Even for serial optimization methods that optimize through the full rollout map \mathcal{F}^T, it is possible to get into unseen states, where it is very easy to have a normal component fed into the sensitive normal components of D_s F_{\theta}. The action Jacobian’s chain rule expansion is

    \[\Bigl(\prod_{t=1}^T D_s F_\theta(s_t, a_t)\Bigr) D_{a_0}F_\theta(s_0, a_0).\]

See what happens if any stage of the product has any component normal to the data manifold. ↩


Our fix

This is where our new planner GRASP comes in. The main observation: while D_s F_{\theta} is untrustworthy and adversarial, the action space is usually low-dimensional and exhaustively trained, so D_a F_{\theta} is actually reasonable to optimize through and doesn’t suffer from the adversarial robustness issue!

Network diagram showing high-dim state vs low-dim action
The action input is usually lower-dimensional and densely trained (the model has seen every action direction), so action gradients are much better behaved.

At its core, GRASP builds a first-order lifted state / collocation-based planner that is only dependent on action Jacobians through the world model. We thus exploit the differentiability of learned world models F_{\theta}, while not falling victim to the inherent sensitivity of the state Jacobians D_s F_{\theta}.

GRASP: Gradient RelAxed Stochastic Planner

As noted before, we start with the collocation planning objective, where we lift the states and relax dynamics into a penalty:

    \[\min_{\mathbf{s},\mathbf{a}} \mathcal{L}(\mathbf{s}, \mathbf{a}) = \sum_{t=0}^{T-1} \big\|F_\theta(s_t,a_t) - s_{t+1}\big\|_2^2, \quad \text{with } s_0 \text{ fixed and } s_T=g.\]

We then make two key additions.

Ingredient 1: Exploration by noising the state iterates

Even with a smoother objective, planning is nonconvex. We introduce exploration by injecting Gaussian noise into the virtual state updates during optimization.

A simple version:

    \[s_t \leftarrow s_t - \eta_s \nabla_{s_t}\mathcal{L} + \sigma_{\text{state}} \xi, \qquad \xi\sim\mathcal{N}(0,I).\]

Actions are still updated by non-stochastic descent:

    \[a_t \leftarrow a_t - \eta_a \nabla_{a_t}\mathcal{L}.\]

The state noise helps you “hop” between basins in the lifted space, while the actions remain guided by gradients. We found that specifically noising states here (as opposed to actions) finds a good balance of exploration and the ability to find sharper minima.2


2. Because we only noise the states (and not the actions), the corresponding dynamics are not truly Langevin dynamics. ↩


Ingredient 2: Reshape gradients: stop brittle state-input gradients, keep action gradients

As discussed, the fragile pathway is the gradient that flows into the state input of the world model, D_s F_{\theta}. The most straightforward way to do this initially is to just stop state gradients into F_{\theta} directly:

  • Let \bar{s}_t be the same value as s_t, but with gradients stopped.

Define the stop-gradient dynamics loss:

    \[\mathcal{L}_{\text{dyn}}^{\text{sg}}(\mathbf{s},\mathbf{a}) = \sum_{t=0}^{T-1} \big\|F_\theta(\bar{s}_t, a_t) - s_{t+1}\big\|_2^2.\]

This alone does not work. Notice now states only follow the previous state’s step, without anything forcing the base states to chase the next ones. As a result, there are trivial minima for just stopping at the origin, then only for the final action trying to get to the goal in one step.

Dense goal shaping

We can view the above issue as the goal’s signal being cut off entirely from previous states. One way to fix this is to simply add a dense goal term throughout prediction:

    \[\mathcal{L}_{\text{goal}}^{\text{sg}}(\mathbf{s},\mathbf{a}) = \sum_{t=0}^{T-1} \big\|F_\theta(\bar{s}_t, a_t) - g\big\|_2^2.\]

In normal settings this would over-bias towards the greedy solution of straight chasing the goal, but this is balanced in our setting by the stop-gradient dynamics loss’s bias towards feasible dynamics. The final objective is then as follows:

    \[\mathcal{L}(\mathbf{s},\mathbf{a}) = \mathcal{L}_{\text{dyn}}^{\text{sg}}(\mathbf{s},\mathbf{a}) + \gamma \, \mathcal{L}_{\text{goal}}^{\text{sg}}(\mathbf{s},\mathbf{a}).\]

The result is a planning optimization objective that does not have dependence on state gradients.


Periodic “sync”: briefly return to true rollout gradients

The lifted stop-gradient objective is great for fast, guided exploration, but it’s still an approximation of the original serial rollout objective.

So every K_{\text{sync}} iterations, GRASP does a short refinement phase:

  1. Roll out from s_0 using current actions \mathbf{a}, and take a few small gradient steps on the original serial loss:

    \[\mathbf{a} \leftarrow \mathbf{a} - \eta_{\text{sync}}\,\nabla_{\mathbf{a}}\,\|s_T(\mathbf{a})-g\|_2^2.\]

The lifted-state optimization still provides the core of the optimization, while this refinement step adds some assistance to keep states and actions grounded towards real trajectories. This refinement step can of course be replaced with a serial planner of your choice (e.g. CEM); the core idea is to still get some of the benefit of the full-path synchronization of serial planners, while still mostly using the benefits of the lifted-state planning.


How GRASP addresses long-range planning

Collocation-based planners offer a natural fix for long-horizon planning, but this optimization is quite difficult through modern world models due to adversarial robustness issues. GRASP proposes a simple solution for a smoother collocation-based planner, alongside stable stochasticity for exploration. As a result, longer-horizon planning ends up not only succeeding more, but also finding such successes faster:

Push-T planning demo
Push-T demo: longer-horizon planning with GRASP.

Horizon CEM GD LatCo GRASP
H=40 61.4% / 35.3s 51.0% / 18.0s 15.0% / 598.0s 59.0% / 8.5s
H=50 30.2% / 96.2s 37.6% / 76.3s 4.2% / 1114.7s 43.4% / 15.2s
H=60 7.2% / 83.1s 16.4% / 146.5s 2.0% / 231.5s 26.2% / 49.1s
H=70 7.8% / 156.1s 12.0% / 103.1s 0.0% / — 16.0% / 79.9s
H=80 2.8% / 132.2s 6.4% / 161.3s 0.0% / — 10.4% / 58.9s

Push-T results. Success rate (%) / median time to success. Bold = best in row. Note the median success time will bias higher with higher success rate; GRASP manages to be faster despite higher success rate.


What’s next?

There is still plenty of work to be done for modern world model planners. We want to exploit the gradient structure of learned world models, and collocation (lifted-state optimization) is a natural approach for long-horizon planning, but it’s crucial to understand typical gradient structure here: smooth and informative action gradients and brittle state gradients. We view GRASP as an initial iteration for such planners.

Extension to diffusion-based world models (deeper latent timesteps can be viewed as smoothed versions of the world model itself), more sophisticated optimizers and noising strategies, and integrating GRASP into either a closed-loop system or RL policy learning for adaptive long-horizon planning are all natural and interesting next steps.

I do genuinely think it’s an exciting time to be working on world model planners. It’s a funny sweet spot where the background literature (planning and control overall) is incredibly mature and well-developed, but the current setting (pure planning optimization over modern, large-scale world models) is still heavily underexplored. But, once we figure out all the right ideas, world model planners will likely become as commonplace as RL.


For more details, read the full paper or visit the project website.


Citation

@article{psenka2026grasp,
  title={Parallel Stochastic Gradient-Based Planning for World Models},
  author={Michael Psenka and Michael Rabbat and Aditi Krishnapriyan and Yann LeCun and Amir Bar},
  year={2026},
  eprint={2602.00475},
  archivePrefix={arXiv},
  primaryClass={cs.LG},
  url={https://arxiv.org/abs/2602.00475}
}

This article was initially published on the BAIR blog, and appears here with the authors’ permission.

How a Supply Chain Analyst Agent Works?

How a Supply Chain Analyst Agent Works?

The 5 Things It Does That Your Team Doesn’t Have Time For

The question we get most often in the first conversation with a supply chain leader is not ‘can AI do this?’ It is ‘what exactly does it do, and what does it replace?’

That is the right question. And the answer is specific.

A supply chain analyst agent does not replace supply chain judgment. It replaces the manual work that happens before the judgment. The reconciling, the assembling, the waiting-for-the-report work that consumes hours every week and still produces outputs that are already stale by the time anyone reads them.

USM Business Systems builds supply chain analyst agents for mid-market manufacturing, distribution, and logistics companies. Here is what those agents actually do.

1. Continuous Data Reconciliation

Most supply chain teams reconcile data manually. Lead times from supplier confirmations. Inventory positions from the WMS. Demand signals from the order management system. Purchase order status from the ERP. All of it coming in at different cadences, in different formats, from different systems.

The agent handles all of that continuously. Lead times update when supplier confirmations come in. Inventory positions update as transactions process. Demand signals update as orders come through. The team opens the dashboard and the picture is current.

  • Time recovered: 4-10 hours per analyst per week
  • Decision quality improvement: leadership briefs off data that is hours old, not days old

2. Automated Exception Surfacing

The most expensive supply chain problems are the ones nobody noticed until they became commitments. A supplier whose lead times have been drifting for three weeks. Inventory coverage that is thinning on a high-velocity SKU. A demand pattern that has shifted since the last forecast cycle.

The agent monitors the operation continuously and surfaces exceptions automatically. It does not wait for the weekly review. It flags the situation when the threshold is crossed.

  • Near-miss visibility window extends from hours before a problem to days before
  • The team shifts from reactive response to proactive resolution

3. Root Cause Analysis on Demand

When a supply chain problem does occur, the investigation typically takes longer than the resolution. Where did the breakdown start? Which supplier? Which lane? Which upstream signal was the leading indicator?

The agent traces disruptions backward through the data and presents the cause with supporting evidence. The supply chain leader does not spend Monday morning running the investigation. They receive the analysis and move to the response.

  • Mean time to root cause: reduced from days to hours
  • For manufacturers where downtime runs $10K-$50K per hour, this is direct margin protection

4. Plain-Language Scenario Modeling

Supply chain decisions under uncertainty require modeling. What happens to coverage if Supplier A delays by three weeks? What does re-sourcing to Supplier B do to landed cost and lead time? What is the inventory exposure if demand holds at the current pace through Q3?

Historically, running those scenarios required an analyst, a spreadsheet, and time that is usually not available before the decision needs to be made.

The agent accepts plain-language questions and returns modeled answers. The procurement leader or ops director asks the question and gets the output in minutes. The decision is made with the modeling, not in spite of the absence of it.

5. Automated Reporting and Narrative Generation

Weekly ops reviews, supplier scorecards, and executive summaries do not disappear when a supply chain agent is deployed. What changes is who builds them.

The agent generates those reports automatically, from the live data it is already reconciling. The narrative is written. The tables are populated. The anomalies are flagged.

The supply chain team does not spend Thursday building Friday’s report. Reporting becomes a byproduct of operations, not a project with a deadline.

  • 4-8 senior team hours recovered per week on report assembly
  • Version control and manual error risk eliminated

The teams that get the most out of supply chain AI are not the ones with the biggest budgets. They are the ones who identified one specific problem and ran a contained build on it first.

What the First Deployment Looks Like?

USM scopes every supply chain agent engagement in two weeks. We identify the one or two problems with the clearest ROI and the fastest measurement cycle. We build to that scope. We measure from week one.

Most first deployments are live within 8-12 weeks. The team starts using the output before the quarter is out.

Request a 30-minute Supply Chain Agent walkthrough at usmsystems.com. See the live system, not the slide deck.

[contact-form-7]

AI Agents

Still a Crapshoot, With 66% Reliability

Despite unending tales of ‘the magic of AI agents,’ the hard numbers tell a different story: Turns out, they’re about as reliable as a human who shows up drunk for work a couple of days a week.

Observes writer Taryn Plumb: “AI agents are now embedded in real enterprise workflows, and they’re still failing roughly one in three attempts on structured benchmarks.”

That reality is documented in the latest study on AI from Stanford: The 2026 AI Index Report.

In other news and analysis on AI writing:

*Now Stash Your Gemini AI Prompts In Google Chrome: Gemini users can now store their commonly used prompts for the AI in the Google Chrome browser for instant access.

The handy new feature is part of a new ‘Skills’ update rolled out in Chrome.

Observes writer Lance Whitney: “With Skills, you can save an AI prompt and then reuse it in the future just by selecting it from a list.

”To reuse a saved prompt in your chat window, just type the forward slash or click the plus button and select the Skill from the menu. That Skill then runs in your new chat.”

*Chrome ‘AI Mode’ Chatbot Now Stays Resident in the Left Sidebar: Researchers will most likely welcome a new upgrade to Chrome that ensures Google Search’s AI Mode chatbot stays pinned to the left sidebar – no matter how many pages you visit on Chrome.

Observes writer Reece Rogers: “This update to AI Mode means that once you begin a search using that tool in Chrome, the search tool essentially becomes an always-on aspect of your user experience.”

*ChatGPT Competitor Gemini Now Available on Windows Desktop: Gemini users on Windows now have an option to call-up the AI chatbot by simply punching ‘Alt’ plus their keyboard spacebar.

The feature can be activated with a free Gemini Windows app that Windows users can download.

Minimum software requirement: Windows 10.

*Popular Design Tool Canva Gets Major AI Upgrade: Already the go-to design tool for 265 million users, Canva is looking to make its tool much easier to use with this upgrade.

Essentially, Canva has been redesigned with AI so that any user can build and publish work using everyday natural language commands – rather than clicking on individual tools.

Observes Cliff Obrecht, co-founder, Canva: “Until now, Canva has been a design platform with AI tools.

“Now, we become an AI platform with design tools.”

*ChatGPT Competitor Releases AI Design Tool: Anthropic has rolled-out a new AI design tool that will compete directly with alternatives from companies like Adobe and Canva.

Creators looking for AI that creates prototypes, slides, wireframes, mockups, pitch decks, marketing content and similar will want to check-out the new tool.

Dubbed ‘Claude Design,’ the new AI is powered by Claude Opus 4.7.

*AI Search Optimization Tool Debuts: LovedByAI has released a new WordPress plugin that promises to auto-optimize the content you publish on your WordPress Web site for discovery by AI search tools.

Observes Jenny Beasley, head of GEO, LovedByAI: “Small businesses should not need a developer, a consultant — and weeks of testing — just to be visible in AI search.

“The goal with LovedByAI is simple: Give SMBs (small-and-medium-sized businesses) a practical way to help AI systems understand their site, without turning this into another complicated project.”

*New AI Writing Tool Released: Editors and writers looking for a new AI writing tool to test-drive may want to check-out TinyMCE AI.

Designed for content creators, the tool offers basic write, refine and review functionality – as well as conversational access, instant text transformation and automated quality checks.

Maker Tiugo Technologies promises the tool is the solution for editors and writers looking for a one-stop fusion of traditional digital writing with modern AI chops.

*ChatGPT Competitor Rolls-Out Update: Anthropic is out with a new version of its flagship AI – Claude Opus 4.7.

Anthropic promises that Opus 4.7 is able to handle complex, long-running tasks with rigor and consistency – while paying precise attention to instructions.

Also upgraded with the new version is Opus’ AI vision, which can see images in greater resolution, according to Anthropic.

*ChatGPT’s Latest Makeover: A Karen?: More than a few ChatGPT users are giving the AI the heave-ho after its most recent update began acting like a persnickety, nagging obsessive.

Observes writer Walter Schulze: “Perfectly routine requests are now being refused — or met with unsolicited lectures. The community has already given it a name: the Karen update.”

Even worse: Subscription cancellation rates for OpenAI’s Plus and Team tiers climbed 4% in the 24 hours following the update’s release, according to Schulze.

Share a Link:  Please consider sharing a link to https://RobotWritersAI.com from your blog, social media post, publication or emails. More links leading to RobotWritersAI.com helps everyone interested in AI-generated writing.

Joe Dysart is editor of RobotWritersAI.com and a tech journalist with 20+ years experience. His work has appeared in 150+ publications, including The New York Times and the Financial Times of London.

Never Miss An Issue
Join our newsletter to be instantly updated when the latest issue of Robot Writers AI publishes
We respect your privacy. Unsubscribe at any time -- we abhor spam as much as you do.

The post AI Agents appeared first on Robot Writers AI.

Page 3 of 9
1 2 3 4 5 9