Comprehensive VPN Evaluation Methods - Insights From ZDNet

Virtual private networks (VPNs) are services that you can use to hide your online activity and obscure your digital footprint to prevent advertisers – and others – from tracking you. VPNs are also useful in bypassing firewalls, accessing content restricted to specific locations, and masking what websites you visit, and when.

VPNs have become so popular that the digital marketplace is full of them. All VPN providers are competing for your attention and money (as the majority of VPNs are offered on a subscription basis), and it can be difficult to cut through the noise and find good, reputable VPN services suitable for your needs.

This is where ZDNET comes in. Our experts provide hands-on reviews of the top VPNs on the market today, backed by extensive testing and research. This is how we test VPN software to make the right recommendations for you based on your needs.

How ZDNET tests VPNs in 2024

Charlie Osborne/ZDNET

Nowadays, VPNs offer such an extensive list of features that choosing the right VPN can be a daunting and confusing experience.

As the majority of reputable VPN services must be paid for, it is essential that you are able to either test out or pick the right VPN from the start. This becomes critical if you need extensive security, if you live somewhere known for censorship, or if you are in a country that frowns upon VPN usage – or bans it entirely outside of state-controlled solutions.

This is why ZDNET has developed a comprehensive testing structure that accounts for all of the major features VPN users want today: speed, stability, security, server availability, and flexible plans. We also want to see clear and transparent privacy policies, external security audits, warrant canaries, and a dedication to resolving security issues and vulnerabilities as they are reported.

We also consider a VPN’s other selling points, such as whether additional services are on the table – including cloud storage, password managers, and data breach scanners – and just how well these VPNs perform in typical home environments.

A thorough ZDNET review of a VPN takes time, and includes multiple tests to ensure reliability, strong connectivity, and reasonable speeds. This independent process is necessary if we are going to give you authentic and genuine assessments of a VPN’s strengths, weaknesses, and how they perform over an extended period of time so that you can make an informed decision before taking the plunge.

ZDNET VPN experts include David Gerwirtz , an expert in DIY IT and hardware, a US policy advisor, and a computer scientist. Together with Charlie Osborne , a cybersecurity journalist, and other ZDNET authors, we combine decades of experience using, testing, researching, and reviewing VPN software.

We have run hundreds of speed tests on numerous VPNs throughout the years – including over a dozen VPNs more recently – and we have also conducted in-depth research on each VPN, including soliciting customer feedback and speaking to other experts.

If a VPN is going to meet our standards as a top recommendation, it must perform well in numerous criteria. See below for the most significant criteria we test for, and how.

Our top VPN recommendations

Charlie Osborne/ZDNET

Click here

How we test VPN speeds

Charlie Osborne/ZDNET

Being able to recommend VPNs requires an extensive knowledge of a VPN’s performance during speed tests.

In most cases, using a VPN will slow down your connection – there’s no avoiding it. As your traffic will be sent through encrypted tunnels and servers, VPNs become a middleman between your home connection and your desired location, protecting your data but also creating another stop on the journey.

However, the best VPNs will not slow you down drastically in most circumstances.

Speed is important. We like to reach our web destinations as quickly as possible. When you are looking for a new VPN, you will want to have an idea of how much the VPN might slow you down while browsing the web, streaming, or gaming.

With this in mind, ZDNET attempts to replicate the typical conditions of a VPN user. We first measure our baseline upload and download speeds without a VPN and then we conduct further tests with the VPN enabled to ascertain how much speed is lost, if any.

We also have the assistance of the CNET and ZDNET Lab, a dedicated team of data and product testing experts based in Louisville, Kentucky, who conduct further speed tests on our behalf.

ZDNET uses Ookla’s Speedtest service , which is available online, to measure baseline and VPN speeds. This is an excellent and free test if you would also like to know if you are reaching the speeds your internet service provider has promised or if there are any connectivity problems reported in your area.

As speed testing is not an exact science, speed results vary month to month, and they should only be taken as a rough guide rather than the specific results you should also expect.

When we conduct our speed tests, we route traffic through a VPN’s server network in various locations. For example, we may test a VPN connection originating in the UK or US through servers located in European countries – or we may go as far as Australia. We may report on the specific upload and download numbers of our tests, or alternatively, we will provide a speed loss percentage.

If we detect any anomalies or unusual results from our speed tests, we will note them in our reviews. For example, sometimes, a server may be particularly slow, and using it does not represent what the average user can usually expect from a VPN connecting in that country. In this case, we may switch servers – for example, moving from a Washington-based server to a server in New York – and we will note the change.

Some VPNs reduce your speed by a substantial amount, perhaps even as much as 50%. When assessing VPNs, we want to see an average speed loss of under 20%, although we do grant some leeway when servers are located over vast distances (such as from the UK to Australia).

Below, you will see how we display the results in easy-to-understand graphs.

How we assess VPN features

Charlie Osborne/ZDNET

While conducting our assessments of VPNS, we consider the following features:

Platform support

What systems and devices can you run the VPN on? Our recommended vendors must provide easy-to-use and intuitive desktop software and mobile apps. At a minimum, we want to see compatibility with Windows and Mac, and preferably Android and iOS. VPNs that also offer compatibility with routers, smart TVs, Chrome, Firefox, and Linux are preferred.

Geoblocking and streaming

We know that VPNs can be key to accessing local content and services while you’re away from home. We test VPNs to see if they perform well in circumventing geographical locks. Furthermore, we try out streaming services, including Amazon Prime, Netflix, Disney+, and more to see if VPNs can access these libraries and do not noticeably slow down your connection or cause lagging while streaming.

Countries and servers

Servers are important aspects of VPNs as they allow users to appear to be in different countries or locations, such as the US, Germany, or Singapore. The more server availability, the better – especially as this also helps share the load of user traffic, and you can switch between servers if you are connected to one that is too slow for your needs. We consider how many servers are on offer, and we want to see at least 40 to 50 locations, although we keep in mind that servers in some countries – such as Russia or China – are very rare considering their ruling authorities’ stance on VPN usage.

ZDNET will also test a VPN’s “quick” or “smart” server connection features, which automatically select a server on a user’s behalf that will give them the best performance.

Simultaneous connections

When you own multiple devices – such as a tablet, laptop, and smartphone – and use them for different tasks, you want to keep your data and connections secure on each machine. Enabling a VPN on more than one device at the same time means you are using simultaneous connections.

It’s always best to have the option for simultaneous connections in a VPN to ensure your privacy isn’t accidentally compromised by switching between devices.

ZDNET considers the number of simultaneous device connections available to subscribers within our evaluations. While some VPN providers only offer one or two, we prefer to see a minimum of six to eight simultaneous connections when you are paying for an ongoing plan.

Kill switches

One of the main features we insist upon when we recommend a VPN is the existence of a kill switch. Sometimes, our internet connectivity can unexpectedly drop, and this will also cause your VPN connection to fail. Your phone or computer is likely to immediately try to automatically reconnect to your internet service, and this will happen independently of any VPN you are running.

All of a sudden, your data is unprotected, unless a kill switch is active. Kill switches detect when a connection fails and immediately shut down or pause network access, ensuring you are not sending out data or requests without the protection of an encrypted VPN tunnel. That’s not to say a kill switch is a perfect solution, but we cannot recommend VPNs that don’t provide their users with this feature.

Extras

While the above features are the most important criteria we consider during VPN evaluations, we also research and may test additional features including password managers, cloud storage, antivirus software, browser extensions, and more.

How we assess VPN security

A VPN is meant to be a tool to improve your security and privacy.

There’s no point in using a VPN unless the vendor’s security protocols and encryption levels are up to scratch. We look for end-to-end encryption and the use of strong protocols including AES-256.

It is also important that Domain Name System (DNS) leaks do not occur. DNS leaks can reduce the level of anonymity your VPN provides when operating systems use default DNS servers rather than a VPN’s servers, leading to information leaks. We use tools including DNSLeakTest.com .

The privacy policies of a VPN are very important. We investigate VPN privacy policies, paying particular attention to what information is collected about users, whether data is logged and if so, what categories of information, and whether or not any datasets are shared with third parties.

Furthermore, we make note of any external, independent security audits that have taken place – and how often they are repeated. As countries have different policies regarding data protection, we will take note of VPN providers that may be located in dubious areas, just as we will investigate whether or not VPN providers operate warrant canaries.

The best VPNs will also be transparent regarding bug fixes and will frequently issue patch updates to resolve vulnerabilities. ZDNET also likes to see advanced security features on offer, such as split tunneling, Tor over VPN, multihop connections, malware and antivirus solutions, phishing blockers, kill switches, and compromised credential alert systems.

Generally, we will not recommend any VPN that does not have a clear privacy policy in place or that offers free services in exchange for your data.

How we assess VPN value

The quality of a VPN must be assessed by combining the factors that are the most important to end users.

Speed, security, stable connections, simultaneous connections, streaming service access, and any additional value-adding features, together with pricing, all influence ZDNET’s overall opinion of VPNs today.

No VPN is perfect or a silver bullet for security. However, they add an important layer of security that can help protect your digital identity and reduce the risk of your online activities being tracked or monitored.

Regarding pricing, we like to see flexible service options that range from a month to several years. A common phenomenon in the VPN space is the use of time-sensitive promotional deals and costs, and we understand that, sometimes, these deals aren’t all they are cracked up to be.

If a “sale” price is consistent – such as ExpressVPN’s “deal” on 12-month plans -- we consider this to be the baseline price and we will note it as such. However, on occasions such as Black Friday and Thanksgiving, genuine promotions are possible. VPN vendors are also constantly changing their prices in response to rival organizations changing theirs. As a general rule, you will typically find the best deals for one-year and two-year plans, whereas month-to-month options are often expensive.

It is important that VPN providers offer their users a money-back guarantee, which is typically 30 days. However, the longer, the better, as this gives users the chance to test out VPN software fully. We won’t recommend any VPN without a reasonable money-back guarantee.

Factors to consider when choosing a VPN service

Here are the most important factors and pointers to consider when you are selecting a new VPN service.

Trial periods: Every VPN performs differently, and every user experience will be different. Your ISP will offer different speeds than ours. Your favorite coffee shop has a different network connection than our local haunts. You’re even likely to connect to different countries and definitely different sites. Before committing to a VPN provider, test them out – that’s what money-back guarantees are for.
Avoid free VPN providers: Running a VPN is expensive, and if the VPN provider doesn’t make money from your service fees, they’re going to make money from your data -- sometimes even by selling your personal information. Stick with the trusted commercial vendors we’ve tested. There are also cases where ‘free’ VPNs undermine what the software is meant to stand for – data protection and security. There are only a few exceptions to this rule, such as Proton VPN.
Contract terms: VPN providers constantly offer discounts, typically on longer-term plans, so you need to consider the fine print before you sign up. Remember to cancel before automatic renewal if you’re no longer happy with the service or you want to switch to a cheaper deal elsewhere.
Use cases: Your VPN selection should relate to how you want to use a VPN. You may want one specifically for streaming geolocked content, for example, or you may need a VPN likely to work in restricted countries. Consider these points before making your final choice, and test them out during your MBG time period to ensure the VPN is right for you.

Frequently Asked Questions

What is a VPN?

VPN is an acronym for virtual private network . These services allow users to browse the internet privately and securely connect to open or public Wi-Fi networks. VPNs allow users to change their virtual location by redirecting the connection through one of its servers located around the world. A VPN will also encrypt all of your traffic, so you’re hidden from hackers, your internet service provider, and governments.

However, if your online activities are being monitored at the ISP level – say, by a government – they may recognize the signature of a VPN in play, even if exactly what you are doing is hidden.

VPNs are useful in unblocking geo-restricted content and can be a vital tool for accessing information in countries with repressive governments. They are important services for anyone who wants to maintain a high level of safety and privacy online. However, because they are anonymous (or at least should be) they can also be used to hide illegal online activities such as pirating content.

How can I tell if my VPN is working or not?

A fully functional VPN should protect your privacy and mask your location and IP address. If you’re unsure if your VPN is working properly, there are tools that make checking your VPN’s performance easy.

You can find out your IP address and location using whatismyipaddress.com . Just compare the IP address and location when you’re connected with a VPN vs. without a VPN. If they are different, then your VPN is doing its job.

It’s also possible that your VPN is leaking your data and potentially exposing your online activity. To ensure your VPN doesn’t have any issues with DNS leaks or IP leaks, you can run tests on a site like DNS Leak Test . There are plenty of tools that allow you to test for leaks, but many are owned by VPN providers and it may not always be clear who developed the tool, which could be a conflict of interest. You may want to run tests with several different sites and compare the results.

Click here

Do I need a VPN if I’m traveling or using a Wi-Fi hotspot?

If you’re traveling or using the internet in a public place like a coffee shop, that data encryption is critical, since most public Wi-Fi hotspots are open and unencrypted – which means anyone on the network can see what you send and may be able to eavesdrop on your activities and steal passwords.

What’s the best free VPN service?

In general, fully free VPN services aren’t recommended because they may not be secure.

Before you choose a VPN service, free or paid, it’s important to know that no single tool can guarantee your privacy. First, anything can be compromised. But more to the point, a VPN protects your data from your computer to the VPN service. It doesn’t protect what you put on servers. It doesn’t protect your data from the VPN provider’s VPN servers to whatever site or cloud-based application you use. Privacy and security require you to be diligent throughout your digital journey, and VPNs, while helpful, are not a miracle cure.

Operating a good VPN service requires hundreds of servers worldwide and a ton of networking resources. If you’re not paying to support that infrastructure, who is? Probably advertisers or data miners. However, some reputable services – such as ProtonVPN – offer free plans that are supported by paid subscribers, rather than your personal data.

if you want to try out a free VPN, check out our guide: The best free VPNs: Expert tested

Is it legal to use a VPN?

Yes, in most countries, including the US, the UK, and the majority of Europe. Some countries, however, have made VPN use illegal, or they are severely discouraged and limited to state-approved software.

At the moment, countries including North Korea, Iraq, and Belarus have reportedly banned the use of VPNs entirely. As noted in NordVPN’s country guide , others – like China, Russia, and Egypt – discourage VPN use and try to stop new adoption by demonizing VPNs as software widely used for criminal activity.

Workarounds do exist , but they may come with risks.

Newsletters

ZDNET Recommends

ZDNET saves you time and money by delivering the best products and tech deals to your inbox every week.

See all

ZDNET Recommends

The best smartwatches you can buy: Apple, Samsung, Google, and more compared

The 5 best VPN services (and tips to choose the right one for you)

The best Android phones you can buy (including a surprise pick)

The best robot vacuum and mop combos (and if they’re worth the money)

Techno Recovery

Comprehensive VPN Evaluation Methods - Insights From ZDNet