Python + Full-Stack (JS) Developer

• Design, develop, and maintain efficient, high-quality code to train and optimize AI models.
• Conduct evaluations (Evals) to benchmark model performance and analyze results for continuous improvement.
• Evaluate and rank AI model responses to user queries across diverse domains, ensuring alignment with predefined criteria.
• Develop comprehensive explanations and rationales for evaluations, showcasing excellent reasoning and technical expertise.
• Lead efforts in Supervised Fine-Tuning (SFT), including creating and maintaining high-quality, task-specific datasets.
• Collaborate with researchers and annotators to execute Reinforcement Learning with Human Feedback (RLHF) and refine reward models.
• Design innovative evaluation strategies and processes to improve the model's alignment with user needs and ethical guidelines.
• Create and refine optimal responses to improve AI performance, emphasizing clarity, relevance, and technical accuracy.
• Conduct thorough peer reviews of code and documentation, providing constructive feedback and identifying areas for improvement.
• Collaborate with cross-functional teams to improve model performance and contribute to product enhancements.
• Continuously explore and integrate new tools, techniques, and methodologies to enhance AI training processes.

• Write readable, reusable, and maintainable code
• Participate in code reviews to ensure that the standards for code quality are met
• Provide clear, clean, well-organized, correct, and clearly annotated/classifiable code in the responses
• Demonstrable experience with developing web apps using modular development and scalable architectures as well as a strong focus on code readability and security/stability (i.e. testing).
• Proficiency with the syntax and conventions of Python and JS/TS (Javascript/Typescript)
• Extensive experience working with JavaScript or TypeScript & Python
• Solid understanding of JavaScript ES6 and either Node.js or Nest JS and React or Angular or VueJS
• Mandatory knowledge of Docker is required.

• Some prior software Quality Assurance, Test Planning experience & test driven development
• Some LLM experience with prompting in ChatGPT and other llms.

RequiredAlso useful

Project and contracting process: Turing. Applications continue on the provider's website.