Data Scientist/Analyst

• Design, develop, and maintain efficient, high-quality code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
• Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
• Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
• Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
• Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
• Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
• Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.
• Write effective Python code to tackle complex issues
• Use business sense and analytical abilities to glean valuable insights from public databases
• Fix bugs in the code
• Create thorough documentation
• Communicate clearly with researchers
• Clearly express the reasoning and logic when writing code in Jupyter notebooks, or other suitable mediums.
• Utilize extensive data analysis skills to develop and respond to important business queries using available datasets (such as those from Kaggle, the UN, the US government, etc.)

• Strong data analytic abilities and business sense are required to draw the appropriate conclusions from the dataset, respond to those conclusions, and clearly convey the key findings
• Excellent problem-solving and analytical skills
• Excellent communication abilities to work with stakeholders and researchers successfully

• A desire to have a significant impact on the field of artificial intelligence

RequiredAlso useful

Project and contracting process: Turing. Applications continue on the provider's website.