Design an A/B Test
Yes, you could, and actually should, if:
- Your DS will not have to define the outcome variable
- Your DS will not have to choose the right loss for the project (such as false positive vs false negative cost, for instance)
- Your data has no bugs
- Your DS will not be asked to come up with actionable insights
- Your DS will never design an A/B test
- Your DS findings will not have any impact on product development
Giulio Palombo worked as a data scientist for several high-growth Silicon Valley tech companies, the last one being Airbnb.
In his career, he interviewed hundreds of DS candidates at top tech companies.
He also wrote the book the book A Collection of Data Science Take-home Challenges that has sold >5K copies in 18 months.
Here you can find all info about the take-home challenge book, testimonials, and more.
Data is simulated, perfectly resembling real data at top tech companies. It even includes bugs, put there on purpose to check candidate attention to detail.
Simulated data allows to create data exactly the way you want to test specific skills.
Challenge samples give an idea of the data format.
One week after payment you will get the challenge as well as the solution template that allows to quickly score candidates.
About 4 hours. That’s typically the optimal length. Challenges longer than that have very low completion rate. Shorter challenges make harder to objectively evaluate several skills, and therefore reduce the on-site to offer rate.
Per our experience, that will be slightly above 50%.
Sure. Can definitely help with that. Email email@example.com for further info.