Senior AI Software Engineer (Agentic Systems & LLM Infrastructure) (Remote)

Remote, USA Full-time
As a Senior AI Software Engineer, you will own the design and development of end-to-end AI systems, spanning backend infrastructure, model orchestration, and production-grade deployment. You'll work closely with product, data, and infrastructure teams to integrate LLMs, agentic frameworks (LangGraph, LangChain, AutoGen), computer vision models, and vector-based reasoning systems into consumer-facing and internal tools. This role is highly technical, hands-on, and requires both deep systems expertise and practical AI application skills. If you're a high-ownership engineer excited to ship AI-powered products at scale, this is your opportunity to make a real impact. Key Responsibilities • Design, build, and scale distributed backend systems that power LLMs, agents, and AI infrastructure. • Integrate AI/LLM models into product systems (e.g., LangGraph, Agentic APIs, vector stores, orchestration layers). • Develop high-reliability APIs and services for real-time AI inference, telemetry, usage metering, and monitoring. • Own backend architecture decisions across authentication, billing, deployments, and developer platforms. • Collaborate closely with product, infra, and research teams to translate cutting-edge AI into production systems. • Ensure production-readiness through observability, CI/CD pipelines, and SRE-style reliability engineering. • Drive continuous improvement, pushing for faster iteration, scalability, and throughput. • Mentor peers and lead by example with a hands-on, high-ownership, startup-style mindset. Must-Have Qualifications • 5+ years of experience building production-grade backend systems in Python, Go, or similar. • Deep experience with distributed systems, microservices, and event-driven architecture. • Strong grasp of AI/ML infrastructure, model inference, model serving, and agentic frameworks. • PostgreSQL, Redis, or similar data store expertise, including performance tuning and scaling. • Familiarity with vector databases, embeddings, and LLM-specific storage/search systems. • Experience deploying in cloud-native environments (AWS, GCP) using Kubernetes, Terraform, Docker. • Proficiency with API design, backend frameworks (e.g., FastAPI, Flask), and load balancing. • Hands-on experience with telemetry, monitoring, logging, and production issue triage. • Understanding of CI/CD workflows, developer tooling, and test automation at scale. • Ability to work in fast-paced, early-stage environments, making tradeoffs and shipping quickly. • Strong communication skills: clear, concise, and collaborative-even when disagreeing. • Bias for action: you're a scrappy problem solver who thrives in ambiguity. Nice-to-Have Qualifications • Experience with LangChain, LangGraph, AutoGen, OpenAI APIs, or other agent-based orchestration frameworks. • Familiarity with computer vision models and multimodal AI systems. • Background in health tech, regulated data systems (HIPAA compliance), or medical data pipelines. • Experience building AI-powered consumer applications with personalization and real-time inference. • Exposure to reinforcement learning, retrieval-augmented generation (RAG), or long-term memory agents. • Motivated by a mission-driven product, with excitement for being part of explosive growth. • Background in competitive sports, military, or other high-intensity, high-throughput environments where resilience and ownership are key. Why Join Us • Work on cutting-edge AI products that directly help people improve their health. • Build agentic systems from the ground up, influencing technical strategy and architecture. • Join a fast-moving, high-ownership team, with significant autonomy and impact. • Competitive compensation, equity, and benefits in a rapidly scaling health tech company. Apply tot his job
Apply Now

Similar Jobs

Performance Engineer with Blazemeter - Austin, TX (Remote until Covid) Need min 12 Years Candidate

Remote, USA Full-time

Logistics Coordinator- Desk Agent

Remote, USA Full-time

Platform Engineer/Performance Tester

Remote, USA Full-time

Veterans! Logistics Coordinators - Full Remote - Multiple Openings

Remote, USA Full-time

Seasonal Educator | lululemon North Star Mall

Remote, USA Full-time

Loan Support Specialist - Northeast

Remote, USA Full-time

LVN (Centralized Phone Triage) - Remote Opportunity

Remote, USA Full-time

Manager, Construction (Hybrid-Columbus, OH) in Columbus, OH

Remote, USA Full-time

New York Legal Process Manager | Senior Litigation Paralegal AD

Remote, USA Full-time

Entry Level Remote Live Chat Assistant – Customer Support and Sales Representative for Online Businesses at arenaflex

Remote, USA Full-time

Market Research - Qualitative Report Writer (Pharma)/ Research Analyst (Remote)

Remote, USA Full-time

[Remote] Research Intern (College Students)

Remote, USA Full-time

Remote Data Entry Clerk Opportunity at blithequark - Shape Your Freelance Career with Flexibility and Freedom

Remote, USA Full-time

940- Principal Biostatistician- Late Stage Oncology Studies (Remote, US)

Remote, USA Full-time

**Experienced Remote Online Chat Assistant – Customer Support and Service Expert**

Remote, USA Full-time

Career with American Airlines:Flight Attendant | Hiring

Remote, USA Full-time

Experienced Remote Customer Service Representative – Delivering Exceptional Health Care Experiences at arenaflex

Remote, USA Full-time

Experienced Remote Data Entry Specialist – Flexible Work-from-Home Opportunity with blithequark

Remote, USA Full-time

Communications Analyst (Public Affairs Specialist 2) in Portland, OR

Remote, USA Full-time

District Sales Manager

Remote, USA Full-time
Back to Home