Angelica Chowdhury

I'm also known as Angie to some

WhoamI?

Angelica Chowdhury

I have too many interests at any given time. They have evolved, devolved and convolved, But what has stayed constant is that I like dabbling in whatever looks interesting and digging deeper into some of them along the way.

I have worked as a data scientist since completing my Master of Data Science at the University of Sydney. I discovered the field after stumbling upon the R Programming course on Coursera while studying for my Bachelor's in Finance, and I later decided to pursue it as a career after getting hooked on Chris Manning's lecture "Building Neural Network Models That Can Reason", the same topic I was researching for my Master's thesis.

My pull towards AI safety came when I bumped into Rob Miles's videos on mesa-optimisers and went down the rabbit hole of finding everything I could, as I had been bored of building variations of the same ML models for some time by then. And the reason I continued on this track was the realisation that the world does not need another person to work on developing and deploying (which was really what I was doing) more and more capable AI models, so I have made it kind of a mission to work on anything that is adjacent to AI risk and safety ever since.

I am based in the sunny Eora Nation (more commonly known as Sydney), Australia, and occasionally work from Sydney AI Safety Space (SASS).

I have been generally focusing on socio-technical AI safety, which means I find myself doing a blend of both technical and policy research at any given time.

What I Do / Did?

Research

Research Engineer

Machine Intelligence & Normative Theory (MINT) Lab - Johns Hopkins University

2026-present

  • AI alignment
  • Normative competence
  • Preference coherence
  • Empirical evaluation
  • Evaluation robustness
  • Parametric variation
  • Preference elicitation
  • Predictive utility
  • Knowledge distillation
  • Model character

Research Affiliate

Centre for AI Risk Management and Alignment (CARMA)

2026-present

  • AI risk management
  • AI assurance
  • Evidence ontologies
  • Web Ontology Language (OWL) graphs
  • Claims, evidence & defeaters
  • Risk-evidence curation
  • Provenance
  • Verification
  • Adversarial probing
  • Multi-agent coordination
  • Epistemic quality

Research Fellow

Future Impact Group

2025-2026

  • Normative competence
  • LLM evaluation
  • Adversarial evaluation
  • Model preferences
  • AI risk management
  • Evidential ontology
  • Evidence taxonomy
  • Knowledge representation
  • AI risk governance

Research Fellow

Mentorship for Alignment Research Students (MARS) - Cambridge AI Safety Hub

2025-2026

  • AI governance mapping
  • Sector vulnerability
  • AI risks
  • Policy gaps
  • Delphi study
  • Public policy & administration
  • Risk assessment
  • Governance macro analysis
  • Actor-network analysis
  • Policy analysis

Research Fellow

Supervisory Program for Alignment Research (SPAR)

2025

  • Randomised control trial
  • Uplift studies
  • AI evaluation
  • Experimental validity
  • Open science
  • Preregistration
  • Transparency
  • Verification
  • Reproducibility
  • Technical AI governance

Industry

Senior Modeller - Data Scientist

Lumi Finance

2024-2026

  • Credit-risk modelling
  • Application scorecards
  • Probability-of-default modelling
  • Banking-trend modelling
  • Agentic model refresh
  • Decision engines
  • Model ensembling
  • Model monitoring
  • Model deployment
  • Model validation
  • Model governance
  • Fairness & bias testing
  • Responsible AI
  • Time-series forecasting
  • Model-performance uplift
  • Training & mentoring

Data Scientist

Commonwealth Bank of Australia

2022-2023

  • Recommender systems
  • Training & scoring pipelines
  • Large-scale scoring
  • Model monitoring
  • Model validation
  • Fairness metrics
  • Model interpretability
  • Experimental design
  • Causal inference
  • Uplift modelling
  • Propensity modelling
  • Customer segmentation
  • Time-series forecasting
  • Household-spending prediction
  • Government decision support
  • Training & mentoring

Customer Insights Analyst

Allianz Australia

2021-2022

  • Customer insights
  • Causal inference
  • Marketing-campaign evaluation
  • Incremental ROI
  • Budget allocation
  • Attribution modelling
  • Propensity modelling
  • A/B testing
  • Experimentation
  • Marketing analytics
  • Training & mentoring

Consultant - Data & AI

Deloitte Australia

2020-2021

  • Data & AI consulting
  • Data strategy
  • Data architecture
  • Technology roadmaps
  • Conceptual & logical data modelling
  • Master data management
  • Reference data management
  • Data governance
  • Data quality management
  • Regulatory data standards
  • Project management
  • Agile delivery
  • Stakeholder workshops
  • Claims triage
  • Insurance modelling
  • Cloud solution design
  • Data & AI community leadership
  • Training & mentoring

Research and Publications

2026 Incoherent Values? Probing LLM Preferences Through Parametric Variation. (Ajayi, Chowdhury, et al.) Tests whether a model’s stated preference still holds when the property the model values is made stronger or weaker and proposes a statistical framework for evaluating value coherence.

2026 Principles and Guidelines for Randomized Controlled Trials in AI Evaluation. (Kelly, Chowdhury, et al.) Proposes five principles and thirty-three guidelines for running AI human-uplift randomised controlled trials, drawing on practice from software engineering, economics, health sciences and psychology so that study results are transparent, repeatable and comparable.

2026 Mapping U.S. Federal AI Governance Against Sector Vulnerability. (Hung, Chowdhury, et al.) Compares the governance coverage of 684 U.S. federal AI governance documents across 14 sectors and 24 AI risk subdomains with how vulnerable experts rate those sectors, and finds where coverage is lacking to inform governments and industries on AI risk related decisions.

2025 An Empirical Study of Power-Seeking Behaviour in a Multi-Agent Setting. (Chowdhury) Simulates four Gemini 1.5 Flash agents running a shared art gallery for six months to test for power-seeking behavior to compare a collaborative baseline against a scenario where the agents are told to prioritise self-interest.

Talks & Appearances

2026 How to Get Into a Career in AI Safety Research and What Do They Do? (The 20 Minute Career) A conversation about my journey into AI safety research and my perspective on what it takes to build that career from Australia.

2026 Incoherent Values? Probing LLM Preferences Through Parametric Variation. (AI Safety Forum) A talk on whether a model’s stated preference still holds when the feature it values is made stronger or weaker, and on the framework for drawing out and evaluating coherent values.

2026 Operationalising LLM as a Judge with Safety Guardrails. (Data and Analytics Wednesday, Sydney) A talk on using language models to judge other outputs, and the safety guardrails needed to do that in practice.

2025-2026 Evaluating Prompt Injection Resistance in LLM Chatbots. (University of Technology Sydney) Designed the master's capstone project on strenghening LLM's against prompt injection attacks for UTS Transdisciplinary School Masters of Data Science Program for two semesters.

2025 Responsible AI in Practice: Embedding Ethics and Transparency in AI. (National AI Week, on behalf of Women in AI) A talk on where Australia stands on the responsible AI front, and steps we can collectively take to keep up with an ever-evolving AI capability landscape as part of the National AI Week.

2025 AI Made Easy: A Human-Centric Perspective. (AEQUITAS) An overview of human-centric AI, and what it means to keep people at the centre of how AI systems are designed and used.

2022 Learning From Imbalanced Data. (Women in AI) A session on how to learn from datasets where one class is much rarer than the others, as part of a Women in AI paper reading club.

Beyond Work and Research

Recent Clicks

Sandstone cliffs and yellow wildflowers on a high plateau A crocodile lying on a sandy riverbank Palm trees along a sandy beach Bright green coral on a reef

Other Notes

Currently reading The Gold-Bug by Edgar Allan Poe.

Next on my list The Power of the Powerless by Václav Havel.

PS: I am a slow reader.

Passing thoughts

I care a lot about x-risks, but I take a passive role in any P(doom) discussions.

I think if we put more weight on resolving the risks we currently have than getting overly hung up on making predictions about the worst case future doom scenarios, we can naturally bring the p of the doom down quite a lot.

That is not to say we should not form ideas of how the future could look like. I only have a problem with it when it overpowers any AI risk related debate and takes the focus away from what needs to be done immediately and in near future, than what's potentially needed in fifty years time.

Occasional longer notes

Lately Listening