Job Description

Responsibilities


About the Team The livestream industry has seen tremendous growth in recent years and has become the next growth driver for TikTok global business. It also brings great joy to users globally and it creates a new channel for our creators to show themselves. We are seeking a Content Quality Analyst to join our team to lead quality initiatives in content moderation--leveraging both human labeling and machine learning models, including Large Language Models (LLMs). This role plays a critical part in upholding content quality across Tiktok Live platform. The ideal candidate will be deeply involved in training AI models, analyzing moderation data to extract actionable insights, resolving complex content scenarios, and working closely with partner teams to ensure effective issue resolution. Success in this role requires strong analytical thinking, high ownership, and the ability to collaborate across cross-functional teams. A keen eye for detail and a proactive mindset toward challenging existing processes and driving continuous improvement are essential. Detailed responsibilities include: 1. Ensure high-quality content benchmarking across BPO teams, support the setup, onboarding, and training of new BPO teams. Manage policy clarifications, calibrations, and arbitration processes. Analyze BPO team performance to identify knowledge gaps and systemic issues. 2. Handle content labeling for specific queues based on cross-functional business requirements, analyze labeled content to identify trends and provide insights to project teams and independently manage quality evaluation initiatives, delivering actionable analytical insights. 3. Train models using large datasets of labeled content to improve decision-making accuracy. Enhance model capabilities through iterative training and reinforcement learning, assist in data preparation, cleaning, and structuring for training purposes. Improve model accuracy by testing and fine-tuning, highlight the algorithm team with supporting examples for any potential gaps in LLM decision making draft, revise, and quality-check content to explore and enhance the synergy between human input and data in LLM training. 4. Analyze moderation and labeling data from multiple queues to derive a process or market specific trend/correlation. Arrange supporting data points for impact analysis and solution planning. 5. Custodian of all quality specific artifacts for the content moderation scope, generating creative solutions, including the use of technology and tools, to enhance the quality of both individual and team outputs.


Qualifications


Minimum Qualifications: 1. Bachelor's degree in Business, Data Science, Computer Science, Information Technology, Communications, or a related field. 2. Experienced in content quality management, product operations, or a related analytics role, preferably in tech, digital content, or platform moderation environments. 3. Proficiency in data analysis and visualization tools such as Excel, Tableau, Power BI, or similar. 4. Basic understanding of machine learning concepts and Large Language Models (LLMs). 5. Strong ability to analyze complex datasets, identify patterns, and generate actionable insights. Preferred Qualifications: 1. Strong analytical skills with the ability to translate data into actionable insights, influence strategy, and drive impactful solutions. 2. Solid understanding of machine learning principles, including model evaluation metrics and optimization techniques. 3. Experience as RLHF (Reinforcement learning from human feedback) annotators for leading Al/LLM companies is strongly preferred.


Job Information


About TikTok



TikTok is the leading destination for short-form mobile video. At TikTok, our mission is to inspire creativity and bring joy. TikTok's global headquarters are in Los Angeles and Singapore, and we also have offices in New York City, London, Dublin, Paris, Berlin, Dubai, Jakarta, Seoul, and Tokyo.



Why Join Us



Inspiring creativity is at the core of TikTok's mission. Our innovative product is built to help people authentically express themselves, discover and connect - and our global, diverse teams make that possible. Together, we create value for our communities, inspire creativity and bring joy - a mission we work towards every day.



We strive to do great things with great people. We lead with curiosity, humility, and a desire to make impact in a rapidly growing tech company. Every challenge is an opportunity to learn and innovate as one team. We're resilient and embrace challenges as they come. By constantly iterating and fostering an "Always Day 1" mindset, we achieve meaningful breakthroughs for ourselves, our company, and our users. When we create and grow together, the possibilities are limitless. Join us.



Diversity & Inclusion



TikTok is committed to creating an inclusive space where employees are valued for their skills, experiences, and unique perspectives. Our platform connects people from across the globe and so does our workplace. At TikTok, our mission is to inspire creativity and bring joy. To achieve that goal, we are committed to celebrating our diverse voices and to creating an environment that reflects the many communities we reach. We are passionate about this and hope you are too.