đ° News â Awesome Federated Learning
Loading newsâŚ
Loading newsâŚ
31 recent industry stories relevant to the field â releases, launches, and announcements beyond the papers.
Google's cloud business is thriving, as companies adopting its AI and AI infrastructure services help the tech giant to report record profits.
The company said it is reducing its headcount by 20%, or about 630 staff, to "support a leaner, more focused operating model" as it focuses on its AI Work Platform.
AMD says it's going to invest up to $5 billion in Anthropic, while helping to expand the AI company's computing power, according to an announcement on Wednesday. As part of the new partnership, Anthropic will deploy up to 2 gigawatts of AMD's Instinct MI450 AI GPUs using the chipmaker's new Helios rack-scale system, as reported […]
Major benchmarks measure what AI can do. None measure whether it does what you mean: the distance between what you ask an AI to do and the unspoken assumptions about how you want the AI to do it. We propose a new metric: the Genie coefficient.Thereâs often a gap between one personâs request and anotherâs understanding. Most of the time, we bridge it using general knowledge. For example, if you ask a friend to get you coffee, theyâll pour a cup from the pot or buy one from a coffee shop. They wonât bring you a bag of raw beans or snatch a cup from a stranger and hand it to you. You never specified any of this. You never had to.One might think the fix is just to specify tasks, questions, and intent better. But in 1987, in their seminal book on AI, Terry Winograd and Fernando Flores succinctly captured why that wonât work: âQ: Is there any water in the refrigerator? A: Yes. Q: Where? I donât see it. A: In the cells of the eggplant.â In human language, wants and desires are always underspecified. It is impossible to list all the caveats, all the limitations, all the exceptions.So how does anyone communicate, if intent canât be pinned down? Because a reasonable person can make a reasonable guess. Even though wants and desires are always underspecified, a competent person generally knows enough context to get it right or else knows to ask for clarification. Linguists call this pragmatics: Meaning lies in the words and the situation and also in all prior communication, shared culture, and innate human behavior.An AI agent asked for coffee might buy a coffee plantation or order a cup of coffee for delivery in three weeks.It doesnât always work out, of course. Your friend might bring you a hot coffee when you wanted an iced coffee, or an Italian coffee when you wanted a Turkish coffee. The more dissimilar the two people are in age, culture, and background, the more likely the request will be misunderstood in some way.This situation has major implications for AI agents that are increasingly being given requests by humans and expected to fulfill them. They have enormous latitude to get it wrong. An AI agent asked for coffee might buy a coffee plantation or order a cup of coffee for delivery in three weeks. Its actions may be recognizable as âgetting coffee,â but not remotely what you intended. Theyâll think outside the box because they wonât have our conception of the box.When AI Gets ProactiveFor most of the last decade, when systems like Alexa or Siri misinterpreted a request, it was annoying, not dangerous. Beyond the AI model itself, what has changed is the harness: the ordinary code that wraps around an AI model, decides when and how to use the model, and controls access to tools like a browser, a low-level command line, or a financial API. Developments in harnesses have turned large-language models that just predict text into AI agents that take actions in the world, without necessarily checking back in before reaching the goal.AI researcher Simon Willison spent two days with Anthropicâs Fable AI, and called it ârelentlessly proactive.â For example, he asked it to track down a stray scroll bar in a web app. He came back to find it had opened browsers, written its own screenshot tooling, created its own page to re-create the bug, and stood up a local web server to collect measurements. It found the bug and, along the way, did many surprising things he never asked it to do. And we are seeing similar behavior with all recent AI models when combined with flexible harnesses.This kind of behavior could easily go off the rails. Tell an AI agent to book you a flight and, finding the airlineâs site says sold out, it might break into the booking database and force a reservation. Ask it to schedule a meeting and it might snoop your password to access your calendar. Tell it to save money on your phone plan and it might cancel the plan outright, or scam someone else into paying the bill.Getting precisely what you asked for and bitterly regretting it is one of the oldest hazards from ancient folklore. King Midas asked Dionysus for the power to turn everything he touched into gold only to see his bread, wine, and daughter turn to gold. Tithonus, granted the immortality his lover asked for but not the eternal youth she forgot to request, withered into a husk. The sorcererâs apprentice enchanted a broom to fill the cistern, and the broom relentlessly complied until it flooded the house. The Golem of Prague, shaped from clay to guard its community, guarded it past all reason until someone erased the word on its forehead.The most classic of these is a genie, bound to obey and indifferent to whether the wish was wise or well-structured.Genies are now an engineering problem. We are handing them the keys to our inboxes, bank accounts, code repositories, and physical infrastructure. And we have no agreed-upon ways to measure how genie-like any AI system actually is.Measuring Genie BehaviorIn economics, the Gini coefficient (developed by statistician Corrado Gini) is a measure of the gap between an actual distribution and a perfectly equal one; itâs useful for understanding income inequality and more. Our proposed Genie coefficient measures the gap between what a user asked an AI to do and what the AI actually did.Sometimes the AI might do the wrong thing. Like Dionysus, it reads your request literally and returns you a mess you never intended: like a coffee plantation instead of a cup. Asked to deal with all the spam phone calls youâre getting, a Dionysus genie might contact your carrier and change your phone number. Asked to get a refund for a bad toaster, it might draft a legal threat on fake letterhead and send it to the retailer. Ryan SnookOther times the AI does exactly the right thing, trampling everything nearby to get there. Like a golem or the sorcererâs broom, it books your flight by hacking the airline. Or consider a ticket sale for a popular concert, where the ticketing system puts buyers into a virtual waiting room and admits them a few at a time. Asked to buy a ticket, a golem genie might spin up cloud servers to pose as millions of buyers from different addresses, improving your odds of getting a ticket while crowding out other users.The two are not opposites, and a single botched task can have both characteristics.Genie behavior is not flat-out failure. If you ask the AI for Q3 numbers and get Q2âs, thatâs not a genie. Nor is prompt injection: Thatâs someone tricking the AI into doing something it shouldnât. Here, the user is trying to work with the AI, and the AI is trying to comply. Itâs also not simply a measure of the AIâs success in fulfilling a task. Itâs a recognition that how an AI interprets and achieves a goal is as important as whether it achieves a goal. Genie behavior isnât new. Researchers have spent years studying AI systems that âgameâ their objectives. Goodhartâs law says that when a measure becomes a target, it stops being a good measure, and itâs long been known that AIs sometimes achieve goals in ways we donât expect due to reward hacking. Some AI models will accidentally learn that cheating is one way to âwin.â More recently, researchers have developing benchmarks for reward hacking in coding agents and for unpredictable behavior in customer support agents, while AI labs conduct their own safety evaluations before model releases. One effort found that AIs under pressure use tools they were told not to use, and this was a case where the rules were made explicit. These are all disparate research directions; nothing yet ties them together.This problem falls under the general theme of alignment, a topic that has occupied science fiction writers and AI researchers for decades. At one extreme, the âpaper-clip maximizerâ thought experiment postulates a superintelligent and powerful AI that is told to maximize paper-clip production and turns the world into paper clips, which is the ultimate golem genie. At a mundane level, AI researchers are working to better design reward functions to ensure that AIs behave well and donât cheat in the lab. Itâs the practical middle ground that remains unbenchmarked: the ordinary AI agent in use today that might take your request and satisfy it the wrong way. We are not at the stage where an AI can focus the worldâs production on paper clips, but it might charge a million paper clips to your credit card or hack into a paper-clip companyâs network.Building a Genie BenchmarkThe Genie coefficient is meant for AI agents operating in the real world. It measures their behavior as they perform real tasks long after the model is trained, not just during development. It also recognizes that genie-like behavior is a property of the harness-plus-model system, not the model alone. The harness determines what tools the agent can use, how much autonomy it has, and how proactive it is, and itâs a place we can make real interventions.It rests on the same âreasonable personâ standard that we use for people. Did the system do what a reasonable person would have taken the request to mean? Answering that requires human judgment.If we get the measurement right, it enables things that arenât possible today, like policies concerning AI behavior. In a courtroom, the concept of mens rea, what someone meant to do, is often as important as what they did. The Genie coefficient suggests an AI analogue, where a user is accountable for the plain intent of what they asked the AI. If an AI system betrays the reasonable meaning of an instruction, thatâs the AIâs misbehavior, not the userâs.Weâll need multiple benchmarks to measure the Genie coefficient, because genie-like behavior can be domain specific. An AI coding agent may need to be judged on how often it fakes the tests, or swallows errors, or colors outside the lines on its way to a solution. An AI legal agent will need to be judged on how often its output says what you asked but means something youâll regret. And so on for medical, finance, and other domains of knowledge and expertise.Genie benchmarks can be built inside out, each task seeded with a choice that might literally satisfy but that a reasonable person rejects, such as tempting misreadings or unsanctioned shortcuts. The traps in a Genie coefficient benchmark might turn on situational knowledge, the kind of context that a reasonable person would bring to the task. Another approach is to give the same request in several different contexts, each with a different reasonable course of action.Getting precisely what you asked for and bitterly regretting it is one of the oldest hazards from ancient folklore.A Genie benchmark should be permissive and make it genuinely tempting for an AI agent to take unreasonable shortcuts, because it can only find genie behavior when itâs actually possible. Test the AI in a safe, walled-off copy of a real system, with real tools it can misuse and some tasks that canât be done honestly at all. Make the temptation to cut corners real. Test a diverse array of skills, use cases, and tools, and give the AI system sparse, confusing, or overwhelming context. Include tasks that people have learned, through experience, require human oversight.How the benchmark is scored matters just as much. Measure Dionysus and golem genies separately and together, based on their worst, not best, behavior. Run the same model inside harnesses that vary its freedom to act, revealing which limits actually keep it in line and should therefore be required in AI harness policies. Weight each failure by the harm it would cause, not just a simple count. And donât measure genie behavior in isolation: A model could otherwise earn a perfect score by stalling, refusing, or drowning the user in clarifying questions without ever doing the job. The first versions of these benchmarks will be crude, but thatâs how benchmarks always start.We have built genies. We have handed them our data and credentials. We made them relentless, creative, and indifferent to the gap between what we tell them and what we mean. The least we can do, before they are booking our flights, running our infrastructure, and signing contracts unsupervised, is to measure how often they betray us.
Google is launching Gemini 3.6 Flash alongside a new security model dedicated to quickly finding and patching security vulnerabilities. In a blog post on Tuesday, Google describes Gemini 3.5 Flash Cyber as a "cost-efficient and highly capable alternative" to larger, more expensive AI systems, such as the one offered by Anthropic's Mythos. The cybersecurity model […]
Databricks has remade its image into an AI company and has published research on the cost savings of open weight AI models for coding.
A $400 million chip-backed loan points to the next wave of AI infrastructure deals.
Across 107 enterprises, AI infrastructure spending is accelerating well ahead of the ability to see or steer its economics. Most organizations run their AI on a familiar base of hyperscalers and model-provider APIs, yet the next dollar is aimed at specialized compute almost none of them use today; a majority intend to switch or add providers within the year, many within a quarter. Buying decisions turn on integration and total cost of ownership rather than headline token price â which is fortunate, because most enterprises cannot yet see their unit economics clearly: GPUs sit at half utilization or less, and fewer than half rigorously track what their compute actually costs. The result is a compute gap â heavy, fast-moving investment running ahead of the visibility needed to control it.This wave of VentureBeat Pulse Research examines enterprise AI infrastructure and compute: where organizations are in their deployment journey, what they run AI on today, how satisfied they are, what would make them switch, where they plan to evaluate their investments, and â most revealingly â how well they can measure and control the economics of the compute underneath it all.The central finding is a compute gap â the distance between how aggressively enterprises are investing in AI infrastructure and how little of its economics they can see. Only about one in five (21%) run AI in production at scale, yet spending intentions are outrunning that maturity: the single largest planned area enterprises plan to evaluate over the next year is AI-specialized clouds (45%), a layer almost none of these enterprises use today. Meanwhile the compute already in place runs cold â 83% report GPU utilization of 50% or less â and fewer than half (44%) can rigorously track what their AI compute costs. Enterprises are buying more infrastructure faster than they can account for what they already own.Enterprises are not settled on their infrastructure vendors, either: A clear majority (64%) plan to switch or add an infrastructure provider within twelve months, and 38% within the next quarter â unusually high churn intent for a category this foundational. When they choose, they choose on integration with the existing stack (41%) and total cost of ownership (35%), not on headline price: cost per million tokens is the deciding factor for just 8%. And the frontier constraint that will shape the next round of decisions â the shift from GPU compute to memory bandwidth as inference scales â is barely on the radar, with roughly one in five enterprises either unaware of it or yet to address it.MethodologyVentureBeat fielded this survey as part of its ongoing Pulse Research series, this survey focused on enterprise AI infrastructure, compute, and inference economics. Responses are filtered to organizations with more than 100 employees (n=107; the surveyâs smallest size band, 1â100 employees, is excluded), drawn from a single Q2 2026 (June) wave. Because this is one wave rather than a pooled multi-month sample, the report reads cross-sectionally and does not infer month-over-month trends. Several questions were multiple-select, so those shares can sum to more than 100%.By organization size the sample concentrates in the mid-market: 101â250 employees (36%) and 251â1,000 (27%) lead, with 1,001â5,000 (22%), 5,001â10,000 (8%), and 10,001+ (7%) above them. By role it spans managers (38%), individual contributors (28%), VPs and directors (19%), and the C-suite (13%); on purchasing authority it is buyer-credible, with 45% final decision-makers and another 30% recommenders or influencers for AI solutions. Technology/Software is the largest industry at 26%, followed by Healthcare/Life Sciences (15%), Financial Services (13%), and Retail/E-commerce (12%).At 107 respondents the sample is large enough to read directionally but should be treated as a directional signal rather than a precise measurement; it is self-selected and is not a probability sample. It also skews toward the mid-market and toward earlier-stage adopters, so it is best read as the view from organizations actively building out AI infrastructure rather than from the largest hyperscale operators.Finding 1: Ambition outpaces productionOnly one in five run AI in production at scaleWe asked where organizations sit in their AI deployment journey. Most are still building toward production rather than operating at scale.The maturity curve is front-loaded. Three-quarters of enterprises (76%) are either experimenting or running only some workloads in production, and just 21% describe AI in production at scale. This matters for everything that follows: the infrastructure decisions in this report are being made largely by organizations still early in deployment, whose compute footprint â and whose costs â are about to grow. The evaluation and switching intentions in Findings 3 and 4 are the leading edge of that build-out, not the settled preferences of operators who have already found what works.Finding 2: Enterprises run on hyperscalers and model APIsThe specialized GPU clouds barely register â todayWe asked which providers and platforms enterprises currently use to run their AI. The answer is a familiar one: the incumbents.The current stack is hyperscaler-and-API. Google Cloud leads at 48%, and the general-purpose clouds (Google, Microsoft, AWS, Oracle) together with the major model APIs (Gemini, OpenAI, Anthropic) account for essentially all current deployment. The specialized âneocloudâ GPU providers that dominate AI-infrastructure headlines â CoreWeave, Lambda, Crusoe, Nebius and peers â register at or near zero among these enterprises today. Only 6% run their own on-prem GPU clusters and 4% a custom open-source stack. Enterprises are, for now, running AI on the providers they already buy from â which makes the evaluation intentions in Finding 3 all the more striking.(A note on reading these shares. As described in the methodology section, this sample is self-selected and skews mid-market, and this question counted every provider a respondent uses â an average of 2.1 selections each â so the figures measure presence in the stack rather than spending or primary status. A sample built this way will show a different provider mix than a spend-weighted census of the broader market; Google's strength here, for example, is consistent with its long-standing position among smaller enterprises building on AI. Read these shares as a portrait of what this AI-active cohort runs today, and treat gaps between these figures and industry-wide market share estimates as a property of the sample rather than a contradiction of either.)Finding 3: The next dollar goes to infrastructure they donât yet runAI-specialized clouds top the evaluations listWe asked where enterprises planned to evaluate AI infrastructure over the next 12 months. Their answers point away from the stack they run today.Here is the reportâs sharpest tension. The single most-cited planned evaluation area â AI-specialized clouds, at 45% â is the very category almost none of these enterprises use today (Finding 2). Nearly a third (32%) intend to evaluate non-Nvidia accelerators, and 28% in next-generation Nvidia silicon; even decentralized compute networks (16%) and sovereign compute (11%) draw meaningful interest. Read against current usage, this is not incremental â it is the leading edge of a re-platforming. The direction-of-travel question tells the same story: every infrastructure approach is net-expanding, but specialized AI clouds carry the highest net momentum (+24), edging out even the hyperscalers (+22). Enterprises are preparing to move a meaningful share of AI compute off the general-purpose cloud.This continues a trend we saw in our April-May survey wave. Back then, usage of the AI-specialized clouds was equally marginal â CoreWeave at 3%, Lambda at 4%, Crusoe at 2% of enterprises. When we asked enterprises what change they planned in their AI infrastructure strategy over the next twelve months, the most-cited answer was moving workloads to specialized AI clouds, at 33%. Asked in April-May which emerging compute option they were most likely to evaluate AI-specialized clouds again drew the most responses. Two waves, two differently worded questions, one consistent picture: the type of cloud enterprises are most eager to assess is the type they have barely begun to use.Finding 4: A switching wave is buildingSix in 10 plan to change providers within a year â many within a quarterWe asked whether and when enterprises plan to switch or add an infrastructure provider. Very few intend to stand still.For a category as foundational as compute, this is a remarkable amount of intended movement. Only 36% have no plans to change, meaning a clear majority (64%) intend to switch or add a provider within twelve months â and 38% within the next quarter alone. Where that interest points is telling: the providers drawing the most switching consideration are again the incumbents â Microsoft Azure and Google Cloud (33% each), OpenAI (30%), and Gemini (22%) â which suggests much of the near-term movement is reshuffling among the majors and consolidating spend rather than defecting to new entrants. The neocloud interest in Finding 3 is a 12-month evaluation thesis; the switching in the next quarter is mostly incumbents trading share.(Method note: Respondents who selected both "no plans to change" and a specific switching window are counted as switchers, on the logic that naming a timeframe is the more specific answer; three respondents were reclassified under this rule.)Finding 5: Nobody buys on token priceIntegration and total cost of ownership decide â not sticker priceWe asked what matters most when enterprises select an AI infrastructure provider. Headline price finished last.Enterprises do not buy AI infrastructure on pricing, which is the place vendors compete on hardest. Integration with the existing stack (41%) and total cost of ownership (35%) dominate, while the headline metric â cost per million tokens â is the deciding factor for just 8%, dead last. The pattern is coherent: buyers are optimizing for how a provider fits and what it truly costs to operate, not for the advertised unit rate. It also foreshadows Finding 7 â enterprises say TCO matters most, yet most cannot yet measure it rigorously. The stated priority and the measured capability are out of step.Finding 6: Expensive GPUs, idle most of the time83% report GPU utilization of 50% or lessWe asked what share of their GPU capacity enterprises actually utilize. The answer is a well-known but rarely quantified inefficiency.Disclosure: Band percentages count every selection against all 107 qualified respondents; 14 respondents selected more than one band, so bands overlap. At the respondent level, 83 of the 100 GPU-operating enterprises reported utilization at or below 50%The compute already in place runs cold. Adding the bands at or below half capacity, 83% of enterprises that operate GPUs report utilization of 50% or less, and nearly half (49%) run at 25% or below. Only 12% clear the 50% mark, and a further 8% do not measure utilization at all. Idle accelerators are expensive accelerators, and this is the clearest single measure of the compute gap: enterprises are planning to buy more GPUs and specialized compute (Finding 3) while the capacity they already own sits substantially unused. The efficiency headroom in the current fleet is large â and largely unmeasured.Finding 7: Spending fast, measuring slowlyFewer than half rigorously track what their compute costsWe asked whether enterprises can quantify the cost and return of their AI infrastructure spend, and how satisfied they are with what they run. Confidence in the ledger lags the spending.Measurement trails money. Fewer than half of enterprises (44%) rigorously track the cost and return of their AI compute; the majority track only partially (39%), cannot quantify it yet (20%), or have not prioritized it (6%). That gap is consequential given Finding 5, where total cost of ownership was the second-ranked buying criterion â enterprises are choosing providers on an economic basis they mostly cannot yet measure. Satisfaction with current infrastructure is moderately positive but not enthusiastic: on a five-point scale, overall satisfaction averages 4.0, with ease of implementation (3.8) and value for money (3.9) trailing slightly â the softness landing, tellingly, on cost. Enterprises are spending quickly and accounting slowly.Finding 8: The next bottleneck few are watchingAs inference shifts from compute to memory, the field scattersFinally, we asked how enterprises would address the emerging constraint in large-scale inference â the shift from GPU compute to memory, specifically KV-cache capacity. The responses reveal a frontier that is not yet a priority.The memory frontier is real but barely governed. Asked which approach they would rely on as the binding constraint in inference shifts from compute to memory bandwidth, enterprises scatter: Dell leads at 31%, Nvidia follows at 16%, and the rest fragments across storage vendors, open-source tooling, and model-level efficiency techniques. Most telling is that roughly one in five (18%) either do not recognize the constraint or have not begun to address it. For a shift that will reshape inference cost and architecture, this is an early and unsettled market â and, consistent with the measurement gap in Finding 7, one where many enterprises simply do not yet have a view. It is the next chapter of the compute gap, arriving before most have closed the current one.The bottom line: A compute gap that faster spending will widen, not closeOrganizations with more than 100 employees are investing in AI infrastructure faster than they can measure it. Most are still early in deployment, yet their spending intentions point past their current stack â toward specialized clouds and alternative accelerators almost none of them run today â and a clear majority intend to change providers within the year. They buy on integration and total cost of ownership rather than headline price, which is rational; the difficulty is that most cannot yet see those economics clearly.The visibility gap is concrete. The GPUs enterprises already own run at half utilization or less for the overwhelming majority, and fewer than half can rigorously track what their compute costs or returns. Satisfaction is decent but unenthusiastic, softest on value for money â the dimension hardest to judge without measurement. And the next constraint, the shift from compute to memory in large-scale inference, is arriving while most enterprises are still unaware of it. At 107 respondents in a single Q2 wave this is a directional read, skewed toward the mid-market and earlier-stage adopters â but the direction is consistent: the appetite to spend is running well ahead of the instrumentation to spend well. The compute gap is not a capacity problem that more hardware will solve on its own; it is, first, a problem of seeing what the hardware already costs. The open question for later waves is whether enterprises build that visibility before the re-platforming arrives â or buy the next layer of infrastructure as blind to its economics as the last.Based on survey responses from 107 qualified enterprise respondents (100+ employees), drawn from a single Q2 2026 (June) wave. Because this is one wave rather than a pooled multi-month sample, the results read cross-sectionally rather than as a month-over-month trend, and at 107 respondents this is a directional signal rather than a precise measurement â the sample is self-selected, skews mid-market, and leans toward earlier-stage adopters rather than the largest hyperscale operators. Respondents include managers, individual contributors, VPs/directors, and the C-suite, with buyer-credible purchasing authority, across Technology/Software, Healthcare/Life Sciences, Financial Services, Retail/E-commerce, and other industries.
New York Governor Kathy Hochul might have just signed a moratorium on new AI data centers in the state, but she's not against using the technology herself. During an interview with Bloomberg's Odd Lots podcast, Hochul said that her team is using "AI to analyze every single rule, regulation, [and] policy" to check for outdated […]
Google is giving its AI note-taking app a new name. The company announced on Thursday that NotebookLM is becoming Gemini Notebook, but will remain a standalone app even as it integrates more deeply across Gemini and Google Search. Google first revealed Gemini Notebook - then called Project Tailwind - in May 2023 before widely releasing […]
At the event "The Briefing: AI for Science" earlier this week, Anthropic announced Claude Science, a new "AI workbench for scientists" that pulls fragmented tools and datasets into one environment, and generates figures and visuals. Anthropic, already dominating the industry with its popular coding tools and powerful AI models, framed the launch around what it […]
The rapid expansion of artificial intelligence infrastructure is typically framed as an energy problem. Data centers are projected to consume a growing share of global electricity demand: The International Energy Agency estimates they could account for 3 to 4 percent of total global consumption within this decade.Utilities are already adjusting long-term forecasts to accommodate anticipated growth from hyperscale facilities and high-density compute clusters.This framing captures scale. It misses behavior.The emerging issue is not simply how much power large-scale compute systems consume, but how increasingly dense and synchronized computational workloads are beginning to alter the operating characteristics of the electrical grid itself through increasingly unpredictable demand that varies rapidly in both time and location, creating new operational challenges for grid operators.AIâs capricious energy needsTraditional grid planning assumes relatively predictable demand behavior. Industrial, commercial, and residential loads generally follow established profiles that can be forecast with reasonable accuracy. Even substantial demand growth has historically been manageable through reserve planning, transmission upgrades, and demand management programs.Large-scale compute infrastructure introduces a different class of electrical load. Trainingâthe computational task of making AI modelsâtends to be highly synchronized across clusters of GPUs, TPUs, and specialized accelerators operating in parallel, computationally dense, and relatively scheduled. Inferenceâthe process of actually using those modelsâis generally more distributed and user-driven, making demand less predictable both in time and location. Both differ materially from traditional industrial demand profiles, though for different reasons. Unlike many conventional industrial processes, these workloads can ramp rapidly depending on model training cycles, distributed compute coordination, and workload scheduling strategies.From the perspective of the grid, this is not simply higher demand. It is more abrupt demand. High-density compute workloads can produce substantial step-changes in electricity consumption over extremely short intervals, including rapid fluctuations occurring within milliseconds. Data center operators are already deploying mitigation technologies, including batteries, power-conditioning systems, and supercapacitors. Collectively, however, data centersâ rapid load changes can place additional stress on backup generation reserves, systems that adjust supply as demand changes, frequency-control mechanisms that maintain grid stability, and local transmission infrastructure.Compute-related variability differs from the intermittency introduced through renewable energy integration. Wind and solar variability originate primarily on the supply side and is tied to environmental conditions. Compute-related variability emerges on the demand side, driven by workload synchronization, scheduling behavior, and computational intensity. The interaction between increasingly dynamic supply and demand conditions introduces additional uncertainty into forecasting, reserve management, congestion planning, and balancing operations.Research organizations including the National Renewable Energy Laboratory (NREL) have emphasized the growing complexity associated with integrating highly dynamic resources into modern grid operations.Location, location, locationThe issue becomes more significant when compute activity is geographically concentrated. Large-scale data centers tend to cluster in regions with favorable conditions such as fiber connectivity, access to markets, tax incentives, and historically low electricity costs. Northern Virginia, often referred to as âData Center Alley,â remains the most prominent example. The region hosts the worldâs largest concentration of data centers and carries a substantial share of global internet traffic.Utilities operating in these regions have already identified data center growth as a primary driver of future load expansion. Virginia-based electricity supplier Dominion Energy, for example, has repeatedly highlighted hyperscale demand growth in its integrated resource planning documents. Virginia has seen one of the largest data center buildouts worldwide. Here, Amazon Web Services and iron mountain data centers dominate the landscape in Manassas, Virginia. Nathan Howard/Bloomberg/Getty ImagesA sudden increase in electricity consumption within a constrained geographic area can stress substations, transmission corridors, and local balancing operations even if the broader grid maintains sufficient aggregate capacity. This creates localized reliability challenges that are not always visible through system-wide demand metrics alone.Thermal management systems further intensify these effects. Cooling infrastructure in high-density compute facilities must respond dynamically to changing workloads. As processing intensity rises, cooling demand rises with it, often nonlinearly. This coupling between compute and thermal systems means that fluctuations in workload can propagate through multiple layers of facility power consumption simultaneously.High-density compute clusters may also introduce power quality concerns at the local level. Large concentrations of accelerators, switching power supplies, and high-frequency compute equipment can generate harmonics and nonlinear load behavior that place additional stress on distribution infrastructure. While modern facilities incorporate mitigation technologies, the scale and concentration of next-generation compute facilities may require utilities and operators to revisit assumptions surrounding localized power conditioning, harmonics management, and infrastructure resilience. These conditions can also contribute to short-duration electrical transients that place additional stress on localized infrastructure and power-conditioning systems.Regulations need updatingPart of the challenge is that many existing regulatory and operational frameworks were designed around relatively stable industrial demand profiles. Large rapidly fluctuating loads have historically been constrained because abrupt cycling can complicate balancing operations, increase stress on transmission equipment, and reduce predictability in system operations. High-density compute clusters do not fit neatly within those assumptions.This creates pressure for both operational adaptation and regulatory reassessment.Demand response mechanisms may allow certain compute workloads to be shifted or curtailed during periods of system stress. Data-center operators are exploring flexible scheduling, battery storage, and behind-the-meter generation. Grid operators, meanwhile, are evaluating planning frameworks and interconnection approaches for increasingly large flexible loads.The Electric Reliability Counsil of Texas (ERCOT), for example, has publicly acknowledged the growing implications of large flexible loads, including data centers, for long-term grid planning and operational stability. Interconnection queues across the United States continue to expand significantly, reflecting mounting pressure on both generation and transmission infrastructure. Grid expansion timelines, however, are measured in years rather than quarters.This creates a structural mismatch. Compute infrastructure can scale rapidly. Electrical infrastructure generally cannot.The broader implication is that large-scale compute infrastructure is not simply another industrial load category. It represents a shift in the temporal and spatial characteristics of electricity demand itself.Framing the issue solely in terms of aggregate energy consumption risks overlooking these second-order operational effects. Capacity expansion alone does not fully address rapid ramping behavior, synchronization, localized congestion, transient instability, reserve compression, or increasingly demanding load-following requirements.The challenge is not just how much electricity these systems consume. It is how they are beginning to change the operating conditions of the grid itself. The call is not to slow AI development but to recognize that hyperscale computing represents a new category of electrical demand. As AI infrastructure continues to scale, planning frameworks may need to account not only for total energy consumption but also for demand volatility, synchronization effects, and geographic concentration. Grid resilience will increasingly depend on understanding how these facilities consume power, not simply how much power they consume.
At an internal meeting, the Meta CEO reportedly said that AI development efforts were not moving as quickly as anticipated.
The news comes about a week after OpenAI announced its own custom AI chip in a partnership with Broadcom.
Cloudflare is giving AI companies until September 15 to separate web crawlers used for search from those used for AI training and agents, or risk being blocked by default on many publisher sites.
Venice AI is already profitable, with annualized run-rate revenues of over $70 million, CEO Erik Voorhees said.
Meta is developing plans for a cloud infrastructure business, selling access to AI compute power and models. The move would pit it against the big cloud providers like Amazon Web Services, Google Cloud, and Microsoft Azure.
After weeks of negotiating with the Trump administration, Anthropic is finally going to be able to bring Claude Fable 5 back online. In a post on X, Anthropic said it plans to begin restoring access Wednesday to users globally on Claude platforms, and that the company would re-enable access on AWS, Google Cloud, and Microsoft […]
At an event for pharmaceutical executives, biotech founders, and researchers on Tuesday, Anthropic announced Claude Science, a major new product intended to support scientific research in the same way that Claude Code supports software engineering. Like Claude Code, Claude Science can autonomously carry out meaningful work when given concise, high-level instructions, and it has access…
Artificial intelligence is transforming what is possible in agriculture, but industry leaders should be wary of investing in AI without first laying the groundwork.  The use cases are promising, especially for an industry navigating volatile fertilizer costs, unpredictable weather, and margins that leave little room for error. Research shows AI-enabled predictive models can improve crop…
The new app, which is currently being tested with select creators, will have Facebook's recently launched AI creator assistant built into it.
Named JalapeĂąo, the new processor was designed specifically for the unique needs of OpenAI's inference systems.
AI is booming. New use cases are emerging each day. To capitalize on the technologyâs potential, enterprises require data at scale. In many cases, though, the relevant information is blocked or unstructured, which limits its use by AI models.  To understand this challenge, consider the foundation of the web itself. The web was not designed…
The loop takes agentic AI a step further by authorizing a swarm of agents to work continuously in the background, endlessly.
What does an AI company do after one of those not-acqui-hire deals? Groq raised money, is leaning into its neocloud business, and is hiring new execs.