Contact us today!

Professional Computer Associates Blog

Know Your Tech: A/B Testing

Know Your Tech: A/B Testing

A key component to effectively attracting your audience is to better understand their preferences. Even the most seemingly insignificant change, like changing the color of the buttons on your website, can have a major impact on how effective your materials are. Fortunately, through a process called A/B testing, observing the impact of these changes is somewhat straightforward.

A/B Testing, Defined
Running an A/B test is the process of comparing a single variable to deem which option, Option A or Option B, is the more effective of the two. The key to an effective A/B test is to only change one thing between the two test subjects - otherwise, you have no way of knowing exactly what it was that was the influential change.

A/B tests can be used to make a wide variety of choices, from something as simple as an adjustment to a call-to-action to a different layout to a particular page. In this case, Option A should be the way things currently are to serve as a control for the experiment, while Option B displays your proposed change. Each option is then presented to an equally-sized segment of your audience to deem which of the two is the more effective.

Setting Up an A/B Test
A/B testing can be used to make a vast number of decisions, as long as they are approached one at a time. As we said before, if multiple variables are involved in a single test, that test isn’t going to deliver reliable enough results to make any well-supported decisions. It is also worth mentioning that A/B testing tends to work better when comparing options for relatively minor changes, like calls-to-action or images included in an email or on a landing page, rather than big ones.

The first step will be to decide which variable you intend to test, followed by your determination of a metric to base your observations against. Does this change boost engagement? Increase the time spent on page? Improve your click-through rate?

Once this has been accomplished, you’re ready to state what your control option will be, and what your change will be after that. Your control group should be whatever you currently have in place, so you can accurately judge if a change would be an improvement or not. Then you need to settle on a sample size, or the number of recipients that will be a part of this test.

Not all changes will be accurately measured with a sample size alone. Some changes would be better left running until a statistically significant data sample has been collected. Speaking of statistical significance, you will also need to decide how significant your results have to be before a change is deemed to be worthwhile.

Running An A/B Test
There are two real keys to running a successful A/B test: first, you have to give it enough time to collect the data you’ll need to come to a conclusion, and second, both options need to be tested at the same time to prevent other variables from affecting your data. Of course, if the variable that your A/B test is evaluating is timing, this doesn’t apply so much.

In short, A/B testing is a relatively simple way to make sure that you’re having as large an impact on your audience as possible. Can you think of any times that you’ve done something similar to test out a proposed change? Tell us about it in the comments!

Hackers Target Major Sporting Events
Hackers Plus Artificial Intelligence Equals Big Tr...


No comments made yet. Be the first to submit a comment
Already Registered? Login Here
Wednesday, September 26 2018

Captcha Image


Tag Cloud

Security Tip of the Week Best Practices Cloud Technology Privacy Network Security Hackers Business Computing Malware Backup Hosted Solutions Managed IT Services VoIP Google Email Innovation Microsoft Mobile Devices Disaster Recovery Internet Productivity Data Software Business Continuity Outsourced IT Data Backup Business Ransomware Smartphones communications IT Services Efficiency Cybercrime Hardware Data Recovery Computer Windows 10 IT Support Cloud Computing Android Internet of Things Browser Tech Term Office Saving Money BDR Computers Server Alert User Tips Network Windows Business Management Workplace Tips Telephone Systems Applications Virtualization Smartphone Upgrade Cybersecurity Small Business Artificial Intelligence Miscellaneous Mobile Device Management Save Money Managed IT Law Enforcement Social Engineering Communication Passwords Social Media Firewall Facebook Chrome Collaboration BYOD Quick Tips Microsoft Office Productivity Hacking Mobility Holiday Router Automation Office Tips Office 365 Managed Service Provider Recovery Avoiding Downtime Work/Life Balance Password How To Private Cloud Bandwidth App Money Gadgets Two-factor Authentication Data Management Gmail HaaS Data Protection VPN Wi-Fi Remote Monitoring Managed IT Services Bring Your Own Device Operating System Information Technology Phishing Business Intelligence Health Budget Training Redundancy Proactive IT Data Security Flexibility Windows 10 IT Management Big Data IT Support Entertainment Word Mobile Computing Vulnerability Encryption Settings Black Market Risk Management Analysis Employer-Employee Relationship Apps Blockchain Marketing User Error Sports Google Drive Mobile Device Identity Theft Safety Cleaning Compliance Connectivity Spam SaaS Value Data Breach Document Management DDoS Data storage Solid State Drive Virtual Assistant CES Government eWaste Access Control Charger PDF Internet Exlporer Infrastructure Networking YouTube Save Time Smart Tech End of Support OneNote IT Plan Electronic Medical Records Computing Infrastructure Paperless Office Website Content Management Instant Messaging Unified Threat Management Physical Security Legal The Internet of Things Automobile Worker Unsupported Software Comparison Hiring/Firing USB Data Storage Servers HIPAA Computer Care Workers Information Battery Samsung Downtime File Sharing Remote Computing Patch Management Wireless Technology Credit Cards Public Cloud Managed Service Business Owner History Meetings Wireless Education Best Practice Wearable Technology Spam Blocking Keyboard Data loss Update Scam Apple Windows 7 Shadow IT Content Filtering Machine Learning Streaming Media Lifestyle Digital Signature Colocation Smart Office Mobile Office Windows 10s Telephony Fiber-Optic Experience Thought Leadership Loyalty Screen Mirroring Google Docs Transportation Scalability Wiring Regulations Amazon Politics NIST IT solutions Remote Monitoring and Maintenance Frequently Asked Questions Telecommuting Touchpad Uninterrupted Power Supply IT Consultant Users Strategy Distributed Denial of Service Skype Cables Music Content Filter Outlook Telephone System Supercomputer Cast Benefits GDPR Environment Amazon Web Services Authentication Cryptocurrency Password Manager Books IBM Line of Business Excel Remote Work Insurance Internet exploMicrosoft Running Cable Botnet Notifications Leadership Virtual Reality hacker Students Antivirus Audit Start Menu Unified Communications Storage Assessment Humor Current Events Voice over Internet Protocol Smart Technology iPhone Cache Search E-Commerce Netflix Online Shopping Nanotechnology Safe Mode Business Mangement Emergency MSP NarrowBand Tip of the week Practices Rootkit Advertising HVAC Root Cause Analysis Travel Monitor SharePoint Software Tips Specifications Worker Commute Accountants Employer Employee Relationship Healthcare Mouse Computer Fan Mobile Theft Troubleshooting Television WiFi Knowledge Multi-Factor Security Human Resources Wireless Internet How to Flash Evernote Software as a Service Recycling Augmented Reality Windows Server 2008 Content Hosted Computing Enterprise Content Management Tech Support Reputation Techology webinar Millennials Computer Accessories Going Green Electronic Health Records FENG Professional Services Cortana Hosted Solution Addiction Public Computer Network Congestion Data Warehousing Trending Staff Two Factor Authentication Files Wire People Sync Wireless Charging Devices Robot Hard Drives Business Technology Lithium-ion battery Criminal Relocation Video Games Remote Worker Chromecast Emails Fraud Audiobook Inventory Vendor Management Hybrid Cloud Password Management Fax Server Customer Proactive IaaS Conferencing HBO Workforce IoT Bluetooth Laptop Tools Google Apps Congratulations Webinar Company Culture IT solutions Managing Stress CrashOverride Regulation Administration Twitter Printers Thank You

Free Consultation

Free ConsultationSign up today for a
FREE Network Consultation
How secure is your IT infrastructure?
Let us evaluate it for free!

Sign up Now!