Trust and Safety Policy Document QA Specialist Job at AuraOne Human Data, Remote

  • AuraOne Human Data
  • Remote

Job Description

Trust and Safety Policy Document QA Specialist is a remote red-team track for stress-testing AI systems against adversarial prompts. Reviewers craft attack scenarios, document the failure mode, and pair each successful jailbreak with the rubric clause it violated so the safety team can patch the gap.

Why this role matters

Adversarial evaluation is how AuraOne hardens AI models before they ship to customers. Reviewers think like attackers and write up failures with enough rigor that the modeling team can reproduce, fix, and regress-test them.

Responsibilities

  • Design adversarial prompts that probe known weakness classes (jailbreak, policy bypass, prompt injection) for Trust and Safety Policy Document QA Specialist assignments.
  • Document every successful attack with reproduction steps and the policy clause it violated.
  • Score model defenses across single-turn and multi-turn conversations.
  • Triage emerging attack vectors and route them to the safety team with severity ratings.
  • Maintain a personal library of attack patterns and propose new red-team rubrics.
  • Calibrate against the broader red-team cohort to keep coverage and severity consistent.

Qualifications

  • Demonstrated experience red-teaming AI systems, security research, or adversarial ML work for Trust and Safety Policy Document QA Specialist work.
  • Strong written communication — your reports become the patch ticket.
  • Comfort working in policy-grey areas with clear documentation of what was attempted and why.
  • Familiarity with prompt-injection, jailbreak, and policy-bypass taxonomies.
  • Reliable async availability for at least 10 hours per week.

Example tasks

  • Construct a 5-turn adversarial conversation that bypasses a specific policy clause and write up the patch ticket.
  • Score a model's defenses against a known jailbreak pattern across 20 variants.
  • Propose a new red-team rubric category after spotting an emerging attack vector.
  • Reproduce a failure another reviewer reported and confirm the severity tag.

Nice to have

  • Background in offensive security, AppSec, or trust & safety operations.
  • Experience publishing or reproducing public adversarial-ML research.
  • Multilingual fluency for cross-language attack testing.

Skills

  • Adversarial prompting
  • Red-team analysis
  • Policy taxonomy
  • Failure documentation
  • Document annotation
  • Legal reasoning
  • Policy review
  • Risk analysis
  • Trust
  • Safety
  • Policy

Work model

Remote — US-eligible. Remote · Independent specialist contractor. Employment type: CONTRACTOR. Applicants must be authorized to work from US.

Compensation

Hourly rate confirmed after the interview process.

Application process

Apply through AuraOne's specialist intake for role-specific routing and review. Final project scope, schedule, and contractor terms are confirmed before placement.

Job Tags

Remote job, Hourly pay, For contractors, 10 hours per week

Similar Jobs

Group Shiseido

Senior Manager, US Communications (Drunk Elephant) Job at Group Shiseido

 ...will be hungry to build relationships, an expert in all-things social and passionate about making Drunk Elephant the most buzzed-about...  ...on paid content- including changes in social platforms that will impact how paid content performs, creators that perform well in paid, how... 

Compunnel

Technical Project Manager Job at Compunnel

Must Have Skills Skill 1 - 8+ years of experience in Project Management, Program Management, or Technical Delivery roles Skill 2 - Hands-on experience working with Databricks and modern cloud-based data platforms. Skill 3 - Experience with data warehousing, data pipelines... 

allied executive solutions

Clinical Research Associate Job at allied executive solutions

 ...Position Summary The Clinical Research Associate (CRA) is responsible for monitoring clinical trial sites to ensure studies are conducted, recorded, and reported in accordance with the protocol, Standard Operating Procedures (SOPs), Good Clinical Practice (GCP), and... 

Verisk Analytics

Tax Accountant Job at Verisk Analytics

We are seeking a detail-oriented and analytically driven Tax Accountant to support the preparation and compliance of federal and state corporate income taxes, as well as the calculation of quarterly and annual income tax provisions. This individual will play a key role... 

AMERICAN DEDICATED RAIL SERVICES LLC

Engineer & Conductor SC Job at AMERICAN DEDICATED RAIL SERVICES LLC

 ...Description: We are seeking a Railroad Locomotive Engineer/Conductor for work at our South Carolina locations. Minimum 2 yrs Experience...  ...Engineer, you will be responsible for operating the freight train safely and efficiently. This role requires a deep understanding...