Nvidia Fleet Command updated with Just In Time security, more

4451
4451 4451 4451 4451
4451 4451 4451 4451 4451 4451 4451 4451

4451
4451 4451 4451
4451 4451 4451

4451 Multi-instance GPU provisioning helps ‘right-size’ 4451 edge AI deployments

4451

4451 Edge AI moves the computational 4451 focus out of the data 4451 center and closer to the 4451 edge of the network, where 4451 the users and their data 4451 are both located. Nvidia announced 4451 Monday improvements to  4451 Fleet Command 4451 , its cloud platform to 4451 manage edge AI apps, to 4451 help streamline and manage those 4451 deployments. The new features include new 4451 just-in-time (JIT) security functions and 4451 improvements aimed at optimal GPU 4451 utilization.

4451

4451 Managing edge AI can quickly 4451 become unwieldy at scale, according 4451 to Nvidia. Deployments may be 4451 spread around thousands of independent 4451 locations, requiring computational power 4451 spread to the network edge 4451 to drive meaningful business 4451 outcomes. Fleet Command provides administrators 4451 with a unified interface for 4451 edge AI lifecycle management, regardless 4451 of the distributed network topology. 4451 Early adopters included businesses in 4451 healthcare, retail, and logistics. 

4451

4451 Administrators set up virtual locations 4451 and systems, mapped to physical 4451 devices at edge locations. Once 4451 deployed, Fleet Command promises centralized 4451 edge AI app lifecycle management. 4451 It supports over-the-air (OTA) updates, 4451 health monitoring, and visualization using 4451 remote tools. Fleet Command supports 4451 zero-touch networking, to reduce potential 4451 security exposure. The platform also 4451 sports one-touch provisioning and a 4451 simplified interface to manage app 4451 deployment and scale. 

4451

4451 Nvidia added multi-instance GPU (MIG) 4451 provisioning to Fleet Command. MIG 4451 provisioning partitions an Nvidia GPU 4451 into several independent instances. MIG 4451 is a foundational capability of 4451 Nvidia’s Ampere GPU architecture, the 4451 basis of its data center-friendly 4451 A100, H100 and A30 Tensor 4451 Core GPUs. MIG enables a 4451 single Nvidia GPU to operate 4451 as seven independent GPU instances, 4451 each fully isolated with its 4451 own memory, cache, and compute 4451 cores. 

4451

4451 This “right-sizing” approach enables administrators 4451 to partition GPUs and assign 4451 multiple AI applications to operate 4451 on the same GPU more 4451 efficiently, according to Nvidia.

4451

4451 Nvidia’s bolstered Fleet Command’s remote 4451 management with new just-in-time (JIT) 4451 security features which, by their 4451 design, reduce security exposure by 4451 making time-limited sessions. The new 4451 features are designed to overcome 4451 limitations with traditional network security 4451 like Virtual Private Networks (VPNs), 4451 according to Nvidia.

4451

4451 “First, most VPN connections do 4451 not have the ability to 4451 set time limits or restrictions. 4451 Administrators could (and often do) 4451 forget to close out a 4451 VPN session, leaving an avenue 4451 open for malicious actors,” said 4451 Nvidia’s Troy Estes in a 4451 blog post announcing the new 4451 features.

4451

4451 “Second, VPN connections do not 4451 easily provide the access controls 4451 needed for securely deploying and 4451 managing edge AI given the 4451 number of different partners, vendors, 4451 contractors, and other actors that 4451 might need access to parts 4451 of the deployment solution,” he 4451 added.

4451

4451 To that end, Fleet Command 4451 has two features designed to 4451 provide secure edge AI app 4451 deployment and lifecycle management: Remote 4451 system access via Fleet Command’s 4451 remote console, which Nvidia says 4451 eliminates the need for additional 4451 ports and traditional VPN connections.

4451

4451 “To ensure the highest security 4451 across nodes, Fleet Command infrastructure 4451 isolates each of the open 4451 nodes in separate sessions and 4451 ensures that any issues on 4451 one system do not affect 4451 other systems,” said Estes.

4451

4451 Fleet Command also provides remote 4451 application access, which allows web-based 4451 access to edge AI apps 4451 without requiring a manual connection 4451 to the system and VPN 4451 networking.

4451

4451 “Remote application access gives you 4451 visibility to the application services, 4451 providing full access to all 4451 features and functionality of the 4451 web applications running on the 4451 edge devices,” said Estes.

4451

4451 Administrators can configure time allotments 4451 that automatically end remote access 4451 sessions, to help streamline remote 4451 session management and lower resource 4451 utilization.

4451
4451 4451