A/B Testing
for Product Managers

The course gave me the knowledge and skills to effectively design and analyze AB tests. I am very glad that I can immediately apply the acquired knowledge in my work. During the course, we stopped the crookedly launched AV tests, choose the metrics, counted the sample sizes, and launched them with a clear conscience and in accordance with all the rules :)
The course helped me structure my knowledge and fill in gaps in basic concepts, and that helped to establish communication between the PM and the analyst, now we "speak the same language."
The structure of the course is a balance of theory and practice. I liked that everything is explained with simple examples and reinforced with “think about it” questions, sometimes controversial ones, which not only helps to absorb the A/B testing methodology but also, once again, trains critical thinking.

How did the course help me? I came with a request to structure my knowledge about A/B tests and understand what alternatives there are to them, how to avoid false positive results, and negotiate with analysts even more effectively.
What did I get? I gained an increase in my knowledge of A/B tests in terms of confidence intervals and evaluation of A/B test results, as well as an understanding of how I can speed up complex A/B tests, such as AB prices.
At work, I have already begun to apply this knowledge :)
What was missing? Still, the part about alternatives to AB tests seemed to me not fully finalized. Didn't get any interesting insights.

Learning is most engaging to me when combined with an immediate practical application of newly gained knowledge and skills, especially when results come along quickly. When our team faced the challenge of dealing with conversion metrics, I enrolled in ProductDo "A/B Testing for PMs" course as I had to learn on the go. The course provided me with a fundamental understanding of running experiments on digital products and highlighted possible errors and mistakes we could have fronted otherwise. This course covers topics like: when to use A/B experiments, confidence intervals, statistical test and power, making a decision on an A/B test, and many more. Thanks, Konstantin Grabar and Andrew Mende, for the awesome course. Below is our humble observation of the very first A/B testing, which came as an experiment itself.

Firstly, thank you for the course - now I warmly recommend it to everyone!
I work in a startup and we have just started implementing A/B tests - I wanted to make as few mistakes as possible along the way + we regularly had discussions in the product team on the topic "we do A/B everywhere VS it’s not always necessary to do A/B testing". After the course, I gathered arguments about why AB is not always necessary.
It was also a plus for me to figure out once and for all the required degree of immersion for the PM in all stages of AB and terminology. I used to be like this: “Well, now I definitely understood everything,” and if I didn’t do AB regularly, then everything used to disappear. And after this course, came the moment of "enlightenment" for me.
What could be improved? I would add something like "First steps to implement A/B." I want this at the beginning of the course for us guys from startups, where you do a lot of things at once and your team does not have the necessary competencies.

The course helped me get rid of the inferiority complex 🤣. It showed that everything is done through a product hypothesis despite the strict mathematical apparatus. At the forefront, we have not the testing process, but the product and its metrics.
I got a specific track with the instrumentation that I use.
I know the methods, approaches, and, most importantly, the solutions used in top companies (the review of services on the market was especially interesting). Now I can confidently design tests and understand how to interpret them. And most importantly, it gave me a way to understand how to go further.

I am thrilled to announce that I have recently completed an A/B Testing course and received my certificate of completion. This course has provided me with the knowledge and skills to effectively design and analyze A/B tests, and I am eager to apply what I have learned in my work as a product manager.

A/B testing is a powerful tool for optimizing products and improving user experience, and I am grateful for the opportunity to deepen my understanding of this method. The course was expertly designed, with a balance of theory and practical examples, making the concepts easy to understand and apply.

I would like to take this opportunity to express my heartfelt gratitude to Andrew Mende and Konstantin Grabar. Their passion for teaching and commitment to excellence were evident in every aspect of the course, from the well-structured lessons to the interactive quizzes and hands-on projects. Their guidance and support have been invaluable, and I am grateful for the opportunity to learn from such talented and knowledgeable instructors.

Completing this course has been a major accomplishment for me, and I am confident that the knowledge and skills I have acquired will be of great benefit in my career. I look forward to continuing my professional development in the field of A/B testing and contributing to the growth and success of the products I manage.

Thank you again to the creators of the course ProductDo for their dedication and expertise. I am proud to have completed the A/B Testing course and to have received my certificate of completion.

I want to thank ProductDo t4eam for this ability to dig deeper into A/B experimenting, and I especially thank Andrew Mende and Konstantin Grabar for this amazing simulator. I liked it a lot and I'm a bit sad it's over now. I'd love to continue our communication :)