Note: The job is a remote job and is open to candidates in USA. Lattice is a people success platform focused on enhancing employee development and engagement. They are seeking a Software Engineer specializing in AI to contribute to AI evaluation pipelines and improve the quality of AI systems, ensuring high-quality user experiences.
Responsibilities
- Contribute to AI evaluation pipelines, including offline evals, production tracing, and feedback systems
- Implement and maintain performance metrics (e.g., response quality, task success, reliability) using established frameworks
- Help create and maintain evaluation datasets and test cases to identify regressions
- Analyze results and propose incremental improvements to model and agent quality
- Contribute to AI system components such as RAG pipelines, retrieval systems, and multi-step workflows within existing architectures
- Write clean, maintainable Python code that integrates with LLM providers and internal services
- Support improvements to system reliability, observability, and performance in production
- Deliver well-scoped projects with guidance from more senior engineers
- Break down tasks, make steady progress, and be proactive in unblocking yourself by asking for help when needed
- Contribute to team excellence through code reviews, documentation, and knowledge sharing
- Collaborate with cross-functional partners to ship user-facing features
Skills
- 2–5 years of professional software engineering experience
- Experience contributing to production systems as part of a team
- Exposure to AI/ML systems with a strong interest in LLM-powered products
- Experience debugging systems, working with data, and iterating on performance
- Proficiency in Python or a similar language
- Strong understanding of LLM concepts (prompting, RAG, evaluation)
- Familiarity with backend systems, APIs, and cloud environments (e.g., AWS, GCP)
- Exposure to logging, monitoring, or debugging tools
- Interest in learning tools like LangGraph, vector databases, and evaluation platforms
- Strong ownership: you reliably deliver high-quality work on well defined tasks, on time and communicate progress clearly
- Learning mindset: you actively seek feedback and improve quickly
- Pragmatic and product-minded: you focus on solving problems effectively and not perfectly
- Collaborative: you contribute to team discussions and uphold engineering best practices
- Growth-oriented: you actively seek feedback and expand your skills in AI engineering
- Hands-on experience with LLMs, prompt iteration, or MLOps
- Familiarity with vector databases or retrieval systems
- Exposure to experimentation, metrics, or basic statistical analysis
- Familiarity with TypeScript
Benefits
- Medical insurance
- Dental insurance
- Life, AD&D, and Disability Insurance
- Natural Disaster Support Program
- Wellness Apps
- Paid Parental Leave
- Paid Time off inclusive of holidays and sick time
- Working Remotely Stipend
- One time WFH Office Set-Up Stipend
- Retirement Plan
- Financial Planning
- Learning & Development Budget
Company Overview
Lattice is a people success platform that help business leaders develop engaged, high-performing employees, and winning cultures. It was founded in 2015, and is headquartered in San Francisco, California, USA, with a workforce of 501-1000 employees. Its website is http://www.lattice.com.