AI Fabric Architect

Fal Ai · via Arbeitnow ·

TypeFull-time job
LocationRemote
Posted2 hours ago
fal is the generative media ecosystem powering the next generation of AI products. We build the infrastructure, tools, and model access that teams need to move from idea to production, and do it at scale without compromise. For developers and enterprises, fal is the foundation that makes generative media not just possible, but practical: a unified platform where high-performance inference, orchestration, and observability come together to unlock new categories of AI-native products.
As generative media reshapes industries across a market projected to grow by hundreds of billions over the next decade, fal is becoming the ecosystem that ambitious teams build on.

About this role
You are the architect of the network that our GPU clusters run on. You own the fabric end to end, from the NIC in each GPU server through the spine and leaf across the AI fabric, and you know that in AI infrastructure the network is core to the machine. As fal brings its own GPU capacity online across multiple sites, you will define the fabric architecture every site is built from, and then personally make sure it gets built and performs. This is not an architecture-only role. We are a small team moving fast, and the right person is as comfortable writing a port map, tracing a bad optic, or tuning congestion control on the data center floor as they are setting technical direction.
What you will do:
Own the fabric architecture for every site: GPU backend fabric (InfiniBand and/or RoCEv2), and GPU frontend Fabric

Choose topologies and make the key calls: rail-optimized vs. other designs, InfiniBand vs. Ethernet, oversubscription ratios, and how the fabric scales from one pod to many

Turn the architecture into a repeatable network blueprint: cabling plans, port maps, fabric addressing and routing design, and a fabric bill of materials (switches, NICs, optics, cables)

Get hands-on with bring-up at each site: be on the floor for the first racks, validate cabling and firmware, configure the fabric manager and switches, and run performance acceptance (NCCL tests, burn-in) before capacity goes live

Tune for real workload performance: congestion control, PFC/ECN, adaptive routing, and NCCL settings for both inference and training traffic

Debug fabric problems wherever they show up, from a flapping link to a job that’s mysteriously slow

Evaluate and select AI Fabric vendors and hardware, and push back with data when something doesn’t meet spec

Collaborate across automation and software to help build network monitoring, telemetry, and automation that let a small team run a large fleet, and be the top escalation point for AI Fabric incidents

Document as you go so each new site is faster than the last, and help hire and mentor the network engineers who join after you

Qualifications:
7+ years in data center or HPC networking, including direct responsibility for production GPU cluster fabrics

A track record of taking GPU fabrics from empty racks to production, with your own hands on the work, not only through vendors or integrators

Deep expertise in InfiniBand (NDR/XDR, UFM, subnet management) and/or RoCEv2 lossless Ethernet

Strong command of rail-optimized and Clos/fat-tree designs, BGP/ECMP, and EVPN/VXLAN

A clear understanding of how fabric design and tuning affect collective communication and real workload performance

Comfortable automating with Python, Ansible, or similar

Strong Linux skills and the ability to debug across the boundary between host, NIC, and fabric

Sound judgment on tradeoffs between cost, performance, reliability, and time to deploy

NVIDIA Quantum/Spectrum-X, ConnectX-7/8, BlueField-3 SuperNICs, and/or Broadcom Tomahawk 5-class Ethernet

400G/800G OSFP optics, AOC/DAC, MPO trunking

Nice to have:
Experience at a neocloud, hyperscaler AI infrastructure team, NVIDIA networking, or an AI factory integrator

Experience with NVLink / NVL72-class rack-scale systems and how they change scale-out fabric design

Experience with GPUDirect RDMA and GPUDirect Storage networks

Experience building out multiple sites in parallel or on aggressive timelines

Willingness to travel frequently to data center sites, especially during build-outs

What we offer at fal:
Interesting and challenging work

Competitive salary and equity

A lot of learning and growth opportunities

We offer relocation assistance to San Francisco.

Health, dental, and vision insurance (US)

Regular team events and offsite

U.S. EQUAL EMPLOYMENT OPPORTUNITY INFORMATION:
fal provides equal employment opportunities to applicants and employees without regard to race, color, religion, sex, sexual orientation, gender identity, national origin, protected veteran status, disability, or any other classification protected by applicable law.
Find more English Speaking Jobs in Germany on Arbeitnow
engineering
Apply on Arbeitnow →

Job sourced from Arbeitnow. Applications happen directly on the original platform — we never collect your data.