Note: The job is a remote job and is open to candidates in USA. Parallel Partners is seeking talented AI Backend Engineers to build systems that power AI-driven decisioning, automation, and orchestration across their platform. This fully remote role involves working with a global engineering team to develop reliable, scalable AI systems.
Responsibilities
- Build and operate backend systems that serve AI-powered insurance workflows in production
- Design and implement AI orchestration layers that connect models, APIs, workflows, and business logic
- Build inference pipelines for LLM-based and AI-assisted automation systems
- Optimize latency, throughput, and cost across AI services (caching, batching, streaming, routing)
- Design stable service boundaries between backend systems, ML components, and product APIs
- Implement observability: logging, metrics, tracing, alerting, and incident response workflows
- Debug production issues across distributed AI systems and resolve root causes
- Collaborate closely with frontend, product, operations, and ML teams to ship end-to-end features
- Continuously improve system reliability, scalability, and performance
Skills
- Strong backend engineering experience in production systems
- Experience building or operating high-throughput, low-latency services
- Familiarity with AI Systems (LLMs, Embeddings, or AI Workflows)
- Experience with distributed systems and production debugging
- Strong understanding of APIs, data flows, and system design principles
- Experience with observability tools (logging, monitoring, tracing)
- Strong ownership mindset and bias toward shipping
- Comfortable working in fast-paced, globally distributed teams
- Tech Stack: Anthropic, Artificial Intelligence (AI), Distributed Systems Tooling, Docker, Kubernetes, LLM APIs, Node.js, NoSQL, Observability Tools, OpenAI, Open-Source Models, Python, SQL
Benefits
- Medical insurance
- Dental
- Vision
- Savings Plan Options
- PTO
Company Overview