Facing reCAPTCHAs constantly while browsing can be very annoying. Most websites use CAPTCHAs to prevent robots to scrape their website. Basically they can decide if the user is a real person or a robot. Here is a short example to understand it:
If Alice had a database with important information about all the companies in the world she would run a website where you could browse the data. Alice would like to drive as much traffic to that website because she earns money from the ads on the websites. If Bob wants to run the same business but he hasn’t got the database he could make a bot that will scrape Alice’s website. It basically opens every page on her website and saving the data in his own database. In this case Alice will try to do everything to prevent it. So she blocks connections made with a fake connection or her website shows CAPTCHAs before users can read the data about the companies. This way it will be not possible to scrape the website.
When one uses any kind of privacy tool there is a chance that he will face more CAPTCHAs. Here is a short but not full list about what can make you look like a robot.
- Changed IP address – A blacklisted IP will make you very suspicious but a simple VPN can affect it too. Since a VPN provider’s IP can be assigned to a big number of users the traffic to Google’s website will increase from that IP. So if already 100 users watching YouTube from a given IP you may be prompted to solve a CAPTCHA when you try to login from the same IP.
- Inconsistent browser fingerprint – Most tools are simply randomly changing the values of you Browser Fingerprint. This can be detected by more clever websites. And they will stop you with CAPTCHAs. Note that Kameleo is using a technology of Base Profiles. It means that most of the values of the browser fingerprint are derived from a real like profile that was generated by our Artificial Intelligence Algorithm. Users can customize the browser fingerprint but it will stay consistent and it will prevent CAPTCHAs.
- Unnatural Canvas – There are plugins and desktop apps like Kameleo that try to hide or mask the Canvas. It helps to hide one’s real identity but it makes one look suspicious and it will result showing more CAPTCHAs. If a regular scraping bot is browsing the web the Canvas will be fully hided. If you install a Canvas Blocker you will also look like a robot. Enhanced tools can mask it but as the technology improves Machine Learning Algorithms can still detect it. And Google has a lot of AI tools so don’t be surprised if your Canvas looks 100% unique on BrowserLeaks and you face CAPTCHAs even when you want to search something on Google. Fortunately with Kameleo your canvas will be spoofed in an intelligent way and you will look natural. More info in our article about canvas.
- Selenium Driver – Selenium automates browsers so enhanced robots are using Selenium that results a more natural browser fingerprint than just simply using curl. To prevent scraping, websites try to check the presence of the Selenium WebDriver. With Kameleo you can browse with or without Selenium Driver. Read more about it in our article about Disabling Selenium Web driver.
- Lack of Google’s Cookies – Google is presented almost on the whole internet. Or at least the half of it. They provide free solutions in different areas. For example: Google analytics, single sign in with Google, Google Maps, etc. It results that they are able to place cookies on machine if you are visiting almost any website. If you make a new virtual profile you won’t have too many cookies in your browser and it will be doubtfully a fake profile. Don’t worry it just means that you will probably have to face more CAPTCHAs. Once you login to a valid Gmail account, cookies will be placed on your machine. It will decrease the chance of getting a CAPTCHA.
With our browser fingerprint and privacy analyst team we examined closer these types of issues. We used 2 websites during the research:
- ReCaptcha Score Demo – This websites reflects the scores given by the CAPTCHA. 0.1 means that the user is looking fully like a robot. 1.0 means that it is definitely a real user. Depending on the score the CAPTCHA will force you different number of picture puzzles. We noticed that the website says: “score returned here is not a reflection on your Google account or type of traffic“. Despite this we saw that these scores are confirmed by real captchas. Once the score was low we faced a lot of picture puzzles. We also created measurements several times. So we believe this is a very good indication. If you test it yourself we encourage you to refresh the page multiple times.
- ReCaptcha Demo – Simply gives a Captcha. If you are okay you just have to tick the box. If you are a little suspicious it solves one captcha with you. If you are really suspicious you get a tons of captchas. You even can’t change to Audio Captcha. This method really confirmed the other website’s scores.
In the table below you can see the results of our measurements.
We didn’t check every possibility and this is just an approximation but it can be very useful to have the perfect setup while you are browsing on different websites. Please experiment with these setups for yourself and share them with the community.
To summarize the results: If you want to change your browser fingerprint with Kameleo you will have to pick an IP carefully and also login to a Gmail account if you want to eliminate reCAPTCHAs.
Note that some of our beta users reported that fake Gmail accounts won’t help you pass captchas. It means that Google can detect if an account is really used by someone or just created for other purposes. We will examine this in future articles.
Check out this article in our knowledgebase.