AI Scientist
Australia10h ago
Key details
- Location
- Australia
- Work style
- Onsite
- Job type
- Full-time
- Function
- Data & ML
- Focus area
- AI / ML
- Posted
- 10h ago
Skills
About the role
What's the role?
As an AI Scientist, you will take end-to-end ownership of AI use cases, from problem definition and experimentation through to evaluation and monitored production use. You’ll work across areas such as agentic AI, model evaluation, safeguards, monitoring and scientific governance, applying established AI and machine learning methods to deliver high-quality solutions.
This is a hands-on individual contributor role where you’ll build your specialist expertise while partnering with engineering and other technical teams. You’ll communicate results and limitations clearly, support junior colleagues and ensure your AI solutions are backed by strong scientific evidence.
Key Responsibilities:
- Own the end-to-end scientific delivery of AI use cases, from defining the problem through to production and monitoring.
- Compare and evaluate AI models across quality, accuracy, latency, performance and cost.
- Build robust evaluation frameworks covering datasets, factuality, retrieval, regression testing, bias and data quality.
- Design and test agentic AI workflows, including context, memory, tool use, permissions, human oversight and failure recovery.
- Apply Responsible AI and safety testing across prompt injection, sensitive data, unsafe outputs and other AI risks.
- Monitor production AI solutions through tracing, drift, usage, cost and performance analysis, investigating issues and supporting controlled releases.
- Develop reusable code, testing approaches and guidance while collaborating with engineering teams, supporting junior AI Scientists and communicating results and trade-offs to stakeholders.
What do I need?
- Proven experience delivering AI solutions from prototype through to controlled production, with strong evaluation and monitoring.
- Strong hands-on coding and API integration skills, including prompts, RAG/retrieval, context, memory and agent tool use.
- Practical experience with agentic AI and coding agents, including setting appropriate autonomy levels and validating outputs through testing and code review.
- Experience comparing and evaluating LLMs across accuracy, factuality, latency, token usage, cost and overall performance.
- Strong knowledge of AI evaluation, including datasets, scoring frameworks, regression testing, bias, data quality and model uncertainty.
- Understanding of Responsible AI and safeguards, including prompt injection, sensitive data, permissions, human oversight, privacy and security.
- Strong end-to-end delivery and stakeholder skills, including production monitoring, model drift, version control and ideally experience within banking or another regulated environment.
Why join us?
We’re obsessed with becoming our customers' #1 banking partner for life and we’re looking for people who are passionate about helping us achieve that goal. In return, we’re committed to making Westpac the best place to work in the country. Here are just a few of the ways we’re already doing that:
- Special offers on banking products and discounts from top brands, including generous employee only mortgage rates!
- Flexible work arrangements to help you achieve a greater work/life balance, and a variety of leave options including Culture, Lifestyle and Wellbeing leave.
- Tailored learning and development opportunities to help your grow your career within the bank.
- Lots of opportunities to ‘give back’ to the Community by getting involved in our many volunteering initiatives.
Create your future today
To get started, simply click on the APPLY or APPLY NOW button
We’re all about creating a supportive and inclusive community. We welcome everyone no matter your age, gender, background, or abilities. We also provide additional support to welcome our veterans, Indigenous Australians and neurodiverse community.
If you need any adjustments during the recruitment process, you can find out more information and additional contact details by visiting the "People with Disability and/or needing Accessibility Requirements" page on our website.
How well do you match this job?
Free account needed to apply or save. It takes a minute, and we'll bring you right back to this job.