We are looking for Trainium (NKI) Kernel Expert candidates for a project delivered through the hiring partner.
About the role
Evaluate the quality, correctness, and hardware-appropriateness of Neuron Kernel Interface (NKI) development tasks used to train and evaluate a frontier AI lab's models. You'll assess CUDA→NKI migration fidelity, Trainium-specific performance-optimization quality, and cross-platform numerical-correctness standards — and provide clear, rubric-based written feedback.
Basic Qualifications
- 2+ years of hands-on experience developing or optimizing kernels using the Neuron Kernel Interface (NKI) targeting AWS Trainium/Inferentia2 hardware
- Strong understanding of NKI-specific development patterns: tile-based computation, SBUF/PSUM/HBM memory-hierarchy management, partition-dimension constraints, and DMA orchestration
- Demonstrated experience assessing CUDA→NKI migration quality
- Familiarity with Trainium-specific performance profiling (NeuronCore pipeline utilization, tensor-engine throughput, memory-bandwidth bottlenecks)
- Experience defining or evaluating cross-platform numerical-correctness standards (GPU vs Trainium accumulation order, rounding behavior, mixed-precision semantics)
Preferred Qualifications
- Direct experience with AWS Neuron SDK, Neuron Compiler internals, or contributions to NKI kernel libraries
- Prior CUDA or Triton kernel development
- Familiarity with Trainium hardware specifications (NeuronCore-v2 architecture, on-chip SRAM topology, supported data types: FP32/BF16/FP8/INT8)
- Experience benchmarking ML training workloads on Trn1/Trn2 instances
Who you work with
Project and contracting process: the hiring partner. Applications continue on the provider's website.
Pay and hours
This role pays $70–$90/hr, for 40 h/week. The work is remote. That is in line with the $80 an hour median for software roles open now.
Who can apply from where
Open to candidates in United States. With a profile, Tier1 checks your country and languages against this role and every other before you apply.