Amazon logo image
AmazonInternet

Solutions Architect, Frontier AI Quality

India , Chennai
Full-time

DESCRIPTION:

The Solutions Architect is APAJ's technical lead for automated quality judgment. The role partners with Quality Specialists, QOMs, Science and Engineering to move workflows from sampled batch inspection to trustworthy unit-level judgment, and acts as a Technical Bar Raiser for judge builders.

Key job responsibilities
- Turn workflow requirements and conventions into judge designs, deterministic checks and transformation logic, and review difficult designs.
- Streamline existing judge measurement and onboarding mechanisms - including precision measurement, judge onboarding decisions and the handoff to DCE - so they run consistently and at scale.
- Provide technical input to RED certification and data-classification work for critical-data workflows.
- Develop and assess judge-builder candidates; contribute reusable components, runbooks and lessons to the network.

BASIC QUALIFICATIONS:

- 2+ years of design, implementation, or consulting in applications and infrastructures experience
- 4+ years of specific technology domain areas (e.g. software development, cloud computing, systems engineering, infrastructure, security, networking, data & analytics) experience
- 5+ years of IT development or implementation/consulting in the software or Internet industries experience
- Experience using a current programming language, such as Python, to build scripts, prototypes or reusable components
- Experience with large language models, prompt design or automated evaluation

PREFERRED QUALIFICATIONS:

- Experience working within software development or Internet-related industries
- Experience working with AWS technologies from a dev/ops perspective
- Experience building or evaluating ML- or LLM-based quality or evaluation systems in production
- Experience interpreting precision, recall, calibration, agreement or error-analysis results
- Experience with data annotation, labelling or content-quality workflows
- Familiarity with data-classification, access-control or security review requirements

Our inclusive culture empowers Amazonians to deliver the best results for our customers. If you have a disability and need a workplace accommodation or adjustment during the application and hiring process, including support for the interview or onboarding process, please visit https://amazon.jobs/content/en/how-we-hire/accommodations for more information. If the country/region you're applying in isn't listed, please contact your Recruiting Partner.
Share this job

Similar Jobs

Join the leading global inclusive talent platform.

  • Reach LGBTQ+ professionals and graduates worldwide through our dedicated job board
  • Discover relevant roles and save jobs to apply later
  • Build inclusive connections via networking, mentoring, events, and community resources
  • Support allyship and accelerate workplace inclusion across your organisation
Free to join — save jobs, set up role alerts, and connect with inclusive employers.We only use your name and email. Your myGwork activity is never shared back to LinkedIn, Google, or Apple.
or
This site is protected by reCAPTCHA and the Google Privacy Policy and Terms of Service apply.Already have an account?Log in