What is the Deep Web?
The internet iceberg Believe it or not, the majority of the World Wide Web exists beyond the reach of Google’s search bar. Familiar websites you know and love (like Facebook, Youtube, Wikipedia, and The Beacon) make up less than 1% of the entire internet. Everything else is part of the Deep Web—pages, domains and files that can’t be accessed by standard search engines. Before we delve any deeper, let’s take a look at how the surface web actually works. Crawl. Index. Serve. Repeat. Search engines like Google, Bing and Yahoo aim to connect their users with relevant webpages. Their software crawls billions of pages , traversing the web with the help of sitemaps and hyperlinks . After getting a feel for the structure of each site, the engines index (organize) every page based on the content it contains. Finally, they display the indexed sites that best match your search terms. The pages beyond There’s just one caveat: search engines ...