Software Engineer - ML Infrastructure

Company Background Specter is creating a software-defined "control plane" for the physical world. We are starting with protecting American businesses by granting them ubiquitous perception over their physical assets. To do so, we are creating a connected hardware-software ecosystem on top of multi-modal wireless mesh sensing technology. This allows us to drive down the cost and time of deploying sensors by 10x. Our platform will ultimately become the perception engine for a company's physical footprint, enabling real-time perimeter visibility and autonomous operations management. Our co-founders Xerxes and Philip are passionate about empowering our partners in the fast-approaching world of physical AI and robotics. We are a small, fast-growing team who hail from Anduril, Tesla, Uber, and the U.S. Special Forces. Role + Responsibilities Specter is hiring an ML infrastructure engineer to build and scale the machine learning systems that power real-time perception and inference across our edge-cloud platform. This role owns the training, deployment, and optimization of computer vision and sensor fusion models that enable autonomous monitoring and decision-making for our customers' physical assets. Key responsibilities include: - Designing and implementing scalable ML training pipelines for computer vision models (object detection, tracking, classification, segmentation). - Building efficient model serving infrastructure for real-time inference on edge devices with constrained compute and power budgets. - Optimizing models for deployment on embedded hardware (quantization, pruning, TensorRT, ONNX, CoreML). - Developing continuous training and evaluation systems to improve model performance from production data feedback loops. - Creating data pipelines for ingesting, labeling, versioning, and managing massive multi-modal sensor datasets (video, radar, lidar, thermal). - Implementing model monitoring, A/B testing frameworks, and performance analytics for deployed perception systems. - Collaborating with perception researchers to transition models from research to production at scale across thousands of edge nodes. - Building tools and infrastructure for distributed training, hyperparameter optimization, and experiment tracking. Preferred Qualifications - Strong experience with ML frameworks (PyTorch, TensorFlow) and model optimization tools (TensorRT, ONNX Runtime, OpenVINO). - Deep understanding of computer vision architectures and their deployment tradeoffs (YOLO, transformers, CNNs, real-time detection/tracking). - Hands-on experience deploying models on edge devices (NVIDIA Jetson, ARM processors, or similar embedded platforms). - Expertise building MLOps infrastructure — experiment tracking (Weights & Biases, MLflow), feature stores, model registries, CI/CD for ML. - Experience with distributed training frameworks (PyTorch DDP, DeepSpeed, Ray) and GPU cluster management. - Strong software engineering skills in Python and systems languages (C++, Rust) for performance-critical inference code. - Familiarity with video processing, sensor fusion, or multi-modal perception systems is a plus. - Prior experience in robotics, autonomous systems, or real-time ML applications is highly valued.