Senior Network Engineer

Position Summary

We are seeking a Senior Network Engineer to design, deploy, and operate the networks supporting Cirrascale's data centers and AI/HPC infrastructure. This individual contributor role owns assigned network projects from design through production handoff and resolves complex incidents across the internet edge, data center Ethernet, security gateways, and cloud connectivity.

Reporting to the Manager, Network Engineering, you will translate infrastructure requirements into practical designs, execute reviewed changes, and improve network reliability and observability. You will work closely with deployment, platform, storage, and operations teams, support GPU fabrics, and mentor associate engineers and the Network Operations Center (NOC).

Key Responsibilities

Network Design and Delivery

• Develop high-level and detailed designs, implementation plans, port maps, and acceptance criteria for new deployments, expansions, and migrations.

• Design and operate resilient internet edge, WAN, SD-WAN, cloud interconnect, and VPN services, including eBGP policy, traffic engineering, route filtering, and provider coordination.

• Engineer data center leaf-spine networks and redundant gateway paths; assess capacity, oversubscription, physical diversity, and recovery under circuit or device failure.

• Configure and troubleshoot routing, switching, firewalls, NAT, and network segmentation. Validate that public addressing and customer connectivity survive planned failover scenarios.

• Support deployment and troubleshooting of InfiniBand and Ethernet fabrics for GPU and storage workloads, working with fabric specialists and vendors as needed.

• Partner with deployment teams on cabling, optics, firmware compatibility, link validation, and production acceptance before operational handoff.

Reliability and Incident Response

• Serve as a senior escalation point for complex network incidents. Lead technical troubleshooting, coordinate carriers and vendors, and communicate service impact and recovery progress.

• Use device telemetry, flow data, logs, and packet captures to investigate congestion, packet loss, routing instability, and application connectivity issues.

• Improve monitoring for BGP, transit health, interface errors, firewall/NAT resources, and fabric performance; tune alerts and document actionable escalation steps.

• Implement approved DDoS response measures, including upstream coordination, remote-triggered blackholing, and scrubbing integration appropriate to the incident.

• Lead root cause analysis and post-incident reviews, track corrective actions, and validate improvements through testing.

• Participate in the engineering on-call rotation and scheduled maintenance windows, with clear handoffs and escalation procedures.

Automation and Operational Standards

• Automate repeatable provisioning, configuration checks, backups, and pre-change and post-change validation using Python, Ansible, APIs, and version control.

• Maintain NetBox as the network source of truth, including device roles, interfaces, circuit dependencies, IP allocations, VLANs, VRFs, and customer connectivity.

• Prepare peer-reviewed changes with impact analysis, validation steps, and rollback plans. Follow change approval requirements and published maintenance and freeze calendars.

• Maintain network standards, topology diagrams, configuration templates, and runbooks; reconcile documentation with deployed state.

• Mentor associate engineers and help the NOC resolve routine incidents independently through training, runbooks, and clear escalation boundaries.

• Assess technical options and capacity needs, explain tradeoffs, and recommend improvements to the Manager, Network Engineering.

Required Qualifications

• 7+ years of network engineering experience, including independent delivery and operational support of production data center, service provider, or enterprise networks.

• Strong knowledge of TCP/IP, BGP, OSPF, ECMP, VLANs, LACP, and Layer 2/3 troubleshooting, including routing policy and failure-domain analysis.

• Demonstrated experience operating multihomed internet connectivity, implementing safe route policies, and validating circuit and router failover.

• Hands-on experience with enterprise routers, switches, and firewalls, including Arista EOS, Juniper Junos, or comparable platforms.

• Experience with stateful firewalls, high-availability gateways, NAT, segmentation, and secure site-to-site or customer connectivity.

• Ability to diagnose production issues using monitoring systems, interface counters, logs, and packet analysis, and to drive incidents through resolution.

• Practical experience using Python, Ansible, or equivalent tools to automate network tasks, with version control and validation before production changes.

• Strong technical documentation and communication skills, including design reviews, change plans, operational handoffs, and mentoring.

• Ability to work independently within agreed priorities and change controls, participate in on-call coverage, and support occasional after-hours maintenance.

Preferred Qualifications

• Experience with AI/HPC environments, GPU clusters, InfiniBand subnet management and partitions, or RoCE congestion management using ECN and PFC.

• Experience with EVPN/VXLAN, SONiC, and 100/400 GbE networks, including optics, FEC counters, buffering, andcapacity analysis.

• Experience with DDoS mitigation, RTBH, RPKI/IRR filtering, peering, and coordination with transit or scrubbing providers.

• Experience with NetBox, LibreNMS, Prometheus/Grafana, sFlow, NetFlow, IPFIX, or comparable inventory and observability tools.

• Familiarity with Kubernetes networking, Linux networking, virtualization, storage connectivity, and hybrid cloud interconnects.

• CCNP, JNCIP, CCIE, JNCIE, or equivalent practical expertise; experience in a cloud service provider or growing infrastructure organization.

Salary Range

The base salary range for the Senior Network Engineer Lead is $125,000 to $180,000. This pay range reflects the broad, minimum to maximum, pay range for this job for the location for which it has been posted. Compensation decisions are dependent on several factors including, but not limited to, an individual’s qualifications, location where the role is to be performed, internal equity, and alignment with market data.

Benefits

Comprehensive benefits package, including health, dental, and vision insurance, retirement plans, paid time off, and opportunities for professional development.

Why Join Cirrascale?

Join a growing team that's pushing the boundaries of AI infrastructure. At Cirrascale, you’ll contribute to projects powering next-generation AI applications while working with top-tier hardware in a collaborative and innovative environment. From custom deployments to hands-on customer support, every role here plays a part in enabling breakthroughs in AI.

Apply Now: careers@cirrascale.com