| Company |
ZS |
| Job title |
LLM Engineer – AI Innovation Lab |
| Job location |
Chicago, Illinois, United States |
| Type |
Full Time |
Responsibilities:
- Take ownership of architecture design and development of scalable and distributed software systems
- Translate business to technical requirements
- Own technical execution, ensuring code quality, adherence to deadlines, and efficient resource allocation
- Design, develop, and deploy LLM-based pipelines involving patterns like RAG, Agentic workflows, and PEFT (e.g., LORA, QLORA, etc.)
- Be responsible for the complete software development lifecycle, including requirements analysis, design, coding, testing, and deployment
- Utilize AWS services/Azure services like IAM, Monitoring, Load Balancing, Autoscaling, Database, Networking, Storage, ECR, AWK, ACR, etc.
- Implement DevOps practices using tools like Docker, Kubernetes to ensure continuous integration and delivery
- Develop DevOps scripts for automation and monitoring
- Collaborate with cross-functional teams, conduct code reviews, and provide guidance on software design and best practices
Requirements & Skills:
- Bachelor’s degree in computer science, information technology, or a related field
- At least 5+ years of experience in software development with relevant work experience in LLM app development
- Strong coding skills with proficiency in Python and Javascript
- Experience with API frameworks, both stateless and stateful, such as Fast API or Django
- Data-driven decision-making with a focus on achieving product goals
- Experience in the implementation of web sockets, gRPC, and access management using JWT (Azure AD, IDM preferred)
- Proficiency in cloud platforms, specifically AWS, Azure, or GCP
- Strong experience in LLM patterns like RAG, Vector DB, Hybrid Search, Agent development, Agentic workflows, prompt engineering, etc.
- Strong experience with LLM APIs (Open AI, Anthropic, AWS Bedrock), SDKs (Langchain, DSPy)
- Hands-on experience with DevOps tools, including Docker, Kuberntes, and AWS services (Redshift, RDS, S3)
- Experience in production deployments involving thousands of users
- Strong understanding of scalable application design principles and experience with security best practices and compliance with privacy regulations
- Good knowledge of software engineering practices like version control (GIT), DevOps (Azure DevOps preferred), and Agile or Scrum
- Strong communication skills with the ability to effectively convey complex technical concepts to a diverse audience
- Experience of SDLC and best practices
- Experience with Agile methodology for continuous product development and delivery
- Knowledge and hands-on experience with front-end development (React JS, Next JS, Tailwind CSS) preferred
