Posts

Building High-Performance AI Fabrics with NVIDIA Spectrum-X

Image
Your AI network design needs more than just GPUs. Did you know that the Day 0 design decisions, topology, IP addressing, BGP, QoS, server connectivity, and more can have a dramatic impact on the performance of your network Fabric in production? Designing and deploying high-performance AI networking at scale using, for example, NVIDIA Spectrum-X is challenging. You can simplify Day 0 design and deployment with Aviz ONES Fabric Designer. Instead of hand-configure complex IPCLOS Fabrics and dealing with hundreds or even thousands of parameters, the ONES Fabric Designer lets teams input data at a high level – specifying the Scalable Unit (SU) size, the desired number of GPUs, and the IP address pool. The system then generates a tested and validated network Fabric design including spine and leaf configuration, BGP peering, interface settings, and IP assignments. Furthermore, the solution also fully automates the setup and configuration of NVIDIA BlueField and ConnectX SuperNICs including a...
Post a Comment
Read more

Why AI's Biggest Opportunity Is Moving Beyond Hardware

Until recently, companies sold innovative hardware. Now companies are focused more on integrated and proprietary software. AI is disrupting companies' old ways. Quickly upgradable chips and networks are no longer the most important hardware to own. Long term value comes from data, models, and workflows that utilize AI to run applications. The biggest challenge to AI businesses is: Fast-developing hardware generations. Hard-to-keep-up-with upgrades in infrastructure. Dependence on hardware for developing applications. Growing demand for deploying AI quicker at a larger scale. The answer is not decreasing hardware spending. The solution is spending to develop hardware that is more flexible and evolving. The adaptability of infrastructure allows organizations to upgrade hardware without the difficulty of rebuilding applications. Integrating upgrades in hardware allows organizations to keep their AI workflows running and evolving. Implementing operating standards is what the market is ...
Post a Comment
Read more

Can Today's Networks Handle Tomorrow's AI?

The way data center networks operate is changing with the evolving nature of AI workloads. In a recent Aviz Networks podcast, Taylor Allison, Senior Product Marketing Manager at NVIDIA, spoke about changes that will happen in networking when it comes to large-scale AI training and inference. To do AI training, GPUs need to work in tandem, which requires a network that is able to communicate with low latency and stay synchronized. Once you increase the number of GPUs, even more, the existing networking technologies will start to fail. The networking solutions from NVIDIA that are optimized for AI workloads include Spectrum-X built for AI clusters over Ethernet and InfiniBand, another high-performance networking architecture for AI overclusters. The podcast also covered NVIDIA Air and the digital twin technology. Before deploying configurations and automation to the production environments, users can create virtual environments in which they can test configurations and automation. This g...
Post a Comment
Read more

How Aviz and Endace Strengthen Network Forensics with Continuous Packet Evidence

Image
To investigate cyberattacks and suspicious activity - and to meet compliance regulations - security teams rely on evidence found within packets. However, traffic is traversing not only across their data centers, but also cloud platforms, campuses, and edges, making it challenging to capture every essential packet. Some typical problems that teams encounter are: * Overloaded packet capture systems unable to handle traffic spikes. * Irrelevant data obscuring important evidence. * Inconsistent historical records creating drag on investigations. * Higher infrastructure costs, without an increase in visibility. The Aviz Networks-Endace integrated solution makes this task simpler by guaranteeing that only optimized, high-fidelity traffic arrives at packet capture systems. Aviz Deep Network Observability (DNO) smart services efficiently aggregate, filter, dedup, and normalize traffic before directing it to Endace Always-On Packet Capture, which ingests, indexes, and permanently stores the tra...
Post a Comment
Read more

Why AI Factory Networking Should Be Validated Before Deployment

Image
Assembling AI infrastructure is significantly different than just installing servers and switches. Modern AI factories are highly interconnected and need to integrate networking, GPUs, storage, orchestration, and suites of applications. If configuration or integration issues appear in the deployed system, there will likely be major interruptions in the operation and costs associated with delays. Many companies struggle with: * A shortage of real-world physical lab testing. * Long validation/deployment cycles. * Discovering integration bugs at an inconvenient (read, costly!) late stage. * The hidden post-deployment rework needed to fix. That's where Aviz ONES on NVIDIA DSX Air helps deliver a better AI infrastructure build process: digital twin simulation. The idea is simple: instead of building, and then testing, why not design, simulate, and validate your entire AI networking environment beforehand? Engineers can create a model of their production-scale network, simulate traffic f...
Post a Comment
Read more

Why Aviz Service Node v2.4 Is the Missing Intelligence Layer for Modern Networks

Image
In today's era, enterprise and telecom networks span much wider than a data center. These networks' traffic traverse through the cloud, edge, hybrid infrastructure, and wireless networks, giving network administrators a challenging time in gaining end-to-end visibility. Lack of smart traffic analysis has put security and network teams' fragmented views and increased incident response times. Typical issues faced are: The inability of getting visibility across a distributed environment. Replication of traffic which impacts data processing costs. Cost-intensive hardware appliances tied to proprietary technology. Lack of data to feed the AI-based observability platforms. Aviz Service Node v2.4 processes raw packet traffic to create machine-readable, application-aware metadata which is consumable by present-day observability platforms. ASN, through deep packet inspection (DPI) and application classification, enhances packet-aware traffic data with context so that AI/ ML can eff...
Post a Comment
Read more

Why AI Factory Design Needs Real-Time Validation Instead of Physical Labs

Image
Modern AI infrastructure no longer only means networking together a stack of GPUs with a bunch of switches. The modern AI factory now relies on tightly optimized networking in which a slight configuration miss will affect performance, price or deployment timeline. Traditionally, this means it requires setting up and testing the network configuration in a physical lab which is expensive, time consuming and not easily scalable. Why, you ask? Because hardware testing alone can be cost prohibitive. Design cycles are serial and iterative, meaning designs and validation are split into distinct phases that take weeks or days to cycle through. When you're designing for the future, you have configuration misses which aren’t caught until you’ve rolled out production. It’s time to disrupt the cycle with digital twins. What NVIDIA AIR and Aviz ONES give you NVIDIA AIR provides an all-digital, virtualized AI network simulation where you can simulate all the switches, links, automation and confi...
Post a Comment
Read more