Arm Holdings has positioned itself at the centre of AI transformation. In a wide-ranging podcast interview, Vince Jesaitis, head of global government affairs at Arm, offered enterprise decision-makers look into the company\u2019s international strategy, the evolution of AI as the company sees it, and what lies ahead for the industry.<\/p>\n
From cloud to edge<\/p>\n
Arm thinks the AI market is about to enter a new phase, moving from cloud-based processing to edge computing. While much of the media\u2019s attention has been focused to date on massive data centres, with models trained in and accessed from the cloud, Jesaitis said that most AI compute, especially inference tasks, is likely to be increasingly decentralised.<\/p>\n
\u201cThe next \u2018aha\u2019 moment in AI is when local AI processing is being done on devices you couldn\u2019t have imagined before,\u201d Jesaitis said. These devices range from smartphones and earbuds to cars and industrial sensors. Arm\u2019s IP is already embedded, literally, in these devices \u2013 it\u2019s a company that only in the last year has been the IP behind over 30 billion chips, placed in devices of every conceivable description, all over the world.<\/p>\n
The deployment of AI in edge environments has several benefits, with team at Arm citing three main \u2018wins\u2019. Firstly, the inherent efficiency of low-power Arm chips means that power bills for running compute and cooling are lower. That keeps the environmental footprint of the technology as small as possible.<\/p>\n
Secondly, putting AI in local settings means latency is much lower (with latency determined by the distance between local operations and the site of the AI model). Arm points to uses like instant translation, dynamic scheduling of control systems, and features like the near-immediate triggering of safety functions \u2013 for instance in IIoT settings.<\/p>\n
Thirdly, \u2018keeping it local\u2019 means there\u2019s no potentially sensitive data sent off-premise. The benefits are obvious for any organisation in highly-regulated industries, but the increasing number of data breaches means even companies operating with relatively benign data sets are looking to reduce their attack surface.<\/p>\n
Arm silicon, optimised for power-constrained devices, makes it well-suited for compute where it\u2019s needed on the ground, the company says. The future may well be one where AI is found woven throughout environments, not centralised in a data centre run by one of the large providers.<\/p>\n
Arm and global governments<\/p>\n
Arm is actively engaged with global policymakers, considering this level of engagement an important part of its role. Governments continue to compete to attract semiconductor investment, the issues of supply chain and concentrated dependencies still fresh in many policymakers\u2019 memories from the time of the COVID epidemic.<\/p>\n
Arm lobbies for workforce development, working at present with policy-makers in the White House on an education coalition to build an \u2018AI-ready workforce\u2019. Domestic independence in technology relies as much on the abilities of workforce as it does on the availability of hardware.<\/p>\n
Jesaitis noted a divergence between regulatory environments: the US prioritises what the government there terms acceleration and innovation, while the EU leads on safety, privacy, security and legally-enforced standards of practice. Arm aims to find the middle ground between these approaches, building products that meet stringent global compliance needs, yet furthering advances in the AI industry.<\/p>\n
The enterprise case for edge AI<\/p>\n
The case for integrating Arm\u2019s edge-focused AI architecture into enterprise transformation strategies can be persuasive. The company stresses its ability to offer scale-able AI without the need to centralise to the cloud, and is also pushing its investment in hardware-level security. That means issues like memory exploits (outside of the control of users plugged into centralised AI models) can be avoided.<\/p>\n
Of course, sectors already highly-regulated in terms of data practices are unlikely to experience relaxed governance in the future \u2013 the opposite is pretty much inevitable. All industries will be seeing more regulation and greater penalties for non-compliance in the years to come. However, to balance that, there are significant competitive advantages available to those that can demonstrate their systems\u2019 inherent safety and security. It\u2019s into this regulatory landscape that Arm sees itself and local, edge AI fitting.<\/p>\n
Additionally, in Europe and Scandinavia, ESG goals are going to be increasingly important. Here, the power-sipping nature of Arm chips offers big advantages. That\u2019s a trend that even the US hyperscalers are responding to: AWS\u2019s latest SHALAR range of low-cost, low-power Arm-based platforms is there to satisfy that exact demand.<\/p>\n
Arm\u2019s collaboration with cloud hyperscalers such as AWS and Microsoft produces chips that combine efficiency with the necessary horsepower for AI applications, the company says.<\/p>\n
What\u2019s next from Arm and the industry<\/p>\n
Jesaitis pointed out several trends that enterprises may be seeing in the next 12 to 18 months. Global AI exports, particularly from the US and Middle East, are ensuring that local demand for AI can be satisfied by the big providers. Arm is a company that can supply both big providers in these contexts (as part of their portfolios of offerings) and satisfy the rising demand for edge-based AI.<\/p>\n
Jesaitis also sees edge AI as something of the hero of sustainability in an industry increasingly under fire for its ecological impact. Because Arm technology\u2019s biggest market has been in low-power compute for mobile, it\u2019s inherently \u2018greener\u2019. As enterprises hope to meet energy goals without sacrificing compute, Arm offers a way that combines performance with responsibility.<\/p>\n
Redefining \u201csmart\u201d<\/p>\n
Arm\u2019s vision of AI at the edge means computers and the software running on them can be context-aware, cheap to run, secure by design, and \u2013 thanks to near-zero network latency \u2013 highly-responsive. Jesaitis said, \u201cWe used to call things \u2018smart\u2019 because they were online. Now, they\u2019re going to be truly intelligent.\u201d<\/p>\n
(Image source: \u201cFactory Floor\u201d by danielfoster437 is licensed under CC BY-NC-SA 2.0.)<\/p>\n
\u00a0<\/p>\n
Want to learn more about AI and big data from industry leaders? Check out AI & Big Data Expo taking place in Amsterdam, California, and London. The comprehensive event is part of TechEx and co-located with other leading technology events. Click here for more information.<\/p>\n
AI News is powered by TechForge Media. Explore other upcoming enterprise technology events and webinars here.
\nThe post Arm and the future of AI at the edge appeared first on AI News.<\/p>\n","protected":false},"excerpt":{"rendered":"
Arm Holdings has positioned itself at the centre of AI transformation. In a wide-ranging podcast interview, Vince Jesaitis, head of global government affairs at Arm, offered enterprise decision-makers look into the company\u2019s international strategy, the evolution of AI as the company sees it, and what lies ahead for the industry. From cloud to edge Arm [\u2026]<\/p>\n
The post Arm and the future of AI at the edge<\/a> appeared first on AI News<\/a>.<\/p>\n<\/div>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"site-container-style":"default","site-container-layout":"default","site-sidebar-layout":"default","disable-article-header":"default","disable-site-header":"default","disable-site-footer":"default","disable-content-area-spacing":"default","footnotes":""},"categories":[1,305,74,59,306,55],"tags":[3],"class_list":["post-284","post","type-post","status-publish","format-standard","hentry","category-ai-and-ml","category-ai-hardware-chips","category-environment-sustainability","category-manufacturing-engineering-ai","category-retail-logistics-ai","category-service-industry-ai","tag-ai"],"yoast_head":"\n