LLM Training Operation (Language and Creative) – Analyst
Job location
Los Angeles, US
Type
Full Time
Responsibilities:
Workflow Design and Management: Design, manage, and optimizes for LLM training projects workflow, including training design, QA processes, and performance tracking.
Collaborate closely with product managers, engineers, and cross-functional teams to ensure alignment on quality metrics and project expectations.
Project Management: Lead and manage multiple projects, ensuring timelines, quality standards, and objectives are met.
Track project progress, identify risks, and implement corrective actions as necessary to keep projects on course.
Coordinate meetings and discussions with global teams to ensure seamless vendors project execution and work with external and trainers per project demands.
Operational Improvement: Conduct quality and productivity improvement experiments to enhance operational processes.
Lead and support general annotation operation initiatives improvement across various data domains.
Develop and maintain guidelines and casebooks to support consistent, high-quality data production.
Team Leadership and Collaboration: Provide mentorship and guidance to team members, helping to develop their skills and ensuring the delivery of high-quality outputs.
Foster a collaborative environment where team members can share knowledge and best practices to improve overall performance.
Requirements & Skills:
3+ years of experience in project or operations management roles.
Advanced proficiency in English with exceptional writing and analytical skills.
Strong project management skills, with the ability to design, manage, and optimize complex workflows.
Ability to balance independent judgment with collaborative teamwork in a fast-paced, project-based environment.
Experience in RLHF annotation and working with leading AI/LLM companies.
Proven ability to lead and mentor entry-level team members in data-related or AI/LLM projects.
Deep interest in LLMs, human behavior, and user experience.
Enthusiasm for learning, engaging with diverse case studies, and working with global teams.
Comfort with technology and tools that enhance project and team performance.
