You can't delegate understanding. If you're going to do AB experiments or measure data, you have to understand what it means.
Data tells you what, not why
Craft → Analytical Sense
People who are really excited about being data-driven, to me that is oftentimes a red flag for their product thinking.
Prediction is inherently about correlation. But when we ask people to make decisions, we're asking them to think about causation. The distinction between causation and correlation matters a lot.
What AI has done for us is it's massively expanded the frontier of things we could think about our problem, hypotheses we could have, maybe things we could test. I really think actually what that does is puts more pressure on the human, not less.
I started finding that my experiments were so much better the more I talked to customers, and eventually I became very much... The blend of qualitative and quantitative research leads to much better tests.
If you look at a piece of data and the result tells you something that your intuition tells you is insanely wrong, like they probably not right. First, believe your intuition and go and prove yourself right.