AI Quality & Performance Analyst
Scottsdale, AZ, United States1h ago
Key details
- Location
- Scottsdale, AZ, United States
- Work style
- Onsite
- Level
- Mid level
- Experience
- 3–6 yrs
- Function
- Operations & Strategy
- Focus area
- other
- Posted
- 1h ago
Skills
About the role
Description
At Mark-Taylor, we believe our success starts with our people. For over 40 years, we’ve built and managed Arizona’s most beautiful apartment communities while fostering a culture centered on people, excellence and growth.
We are proud to be recognized as Ranking Arizona’s #1 Multifamily Builder and Manager, a Best Place to work in Multifamily, and a Healthiest Employer by the Phoenix Business Journal, and more.
Our communities are growing and so is our corporate team! We’re hiring an AI Quality & Performance Analyst at our corporate office in Scottsdale, AZ.
Why You’ll Love working at Mark-Taylor
- Employee rent discounts.*
- Access to all Mark-Taylor amenities.
- Employee appreciation events.
- Opportunities for career growth.
- 401(k) with robust company match.**
- Paid time off, sick time, holidays, and volunteer time.**
- Comprehensive Medical, Dental, and Vision benefits.**
Requirements
- Three or more years of relevant experience in quality assurance, customer experience, software testing, operational analytics, process improvement, or a related discipline.
- Strong judgment and the ability to evaluate ambiguous AI outputs against documented standards.
- Excellent analytical, written communication, and problem-solving skills.
- Experience creating scorecards, analyzing trends, documenting defects, and coordinating improvements across teams.
- Working knowledge of generative AI, including inaccurate responses, inconsistent behavior, and limitations of automated evaluation.
- Ability to work with recordings, transcripts, generated content, CRM records, dashboards, and workflow histories.
- Multifamily leasing, resident services, or centralized operations experience preferred.
- Experience with AI evaluation tools, conversation analytics, SQL, or workflow automation preferred.
In this role, you will
- Review AI-generated conversations, content, recommendations, and related system activity for accuracy, completeness, clarity, relevance, professionalism, and resolution of user needs.
- Verify that AI completes requested or promised actions correctly, including scheduling appointments, recording requests, updating information, and routing work.
- Assess voice and messaging experiences for delays, interruptions, speech recognition and pronunciation issues, repeated questions, conflicting answers, lost context, duplicate outreach, and incomplete handoffs.
- Maintain quality scorecards, examples of acceptable and unacceptable behavior, issue severity definitions, and escalation procedures. Establish quality baselines and recommend performance targets.
- Combine random sampling with targeted reviews of higher-risk interactions. Validate automated evaluations against human review and verified system outcomes.
- Investigate and document root causes involving source information, AI instructions, workflow configuration, integrations, speech recognition, or model behavior.
- Maintain a prioritized issue backlog, coordinate fixes with responsible teams and platform partners, and verify that fixes address the underlying problems and hold up over time.
- Maintain a reusable test library. Test new capabilities and changes before release and confirm existing functionality still works.
- Evaluate AI against company-approved fair housing, privacy, sensitive information, emergency routing, and brand standards. Escalate exceptions to designated owners and track critical policy exceptions separately.
- Escalate critical failures immediately and recommend holding a release or restricting an affected capability when warranted.
- Report quality trends, recurring failures, improvement priorities, and verified results. Measure the impact on leasing, resident service, employee productivity, operational efficiency, and team capacity.
Mark-Taylor is an equal opportunity employer and a drug-free workplace. All our employees undergo pre-employment screening which includes drug testing.
*Housing discounts are subject to availability at each community.
**Benefits offered for full-time employees.
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.