Technology

Crawling The Web

The basis of our anti-piracy engine is our advanced Web crawler (or spider). Many people are familiar with the concept of crawling and indexing web pages in the context of search engines, like Google. Google builds its gigantic search index primarily by crawling the Web.

However, our spider is different from Google’s: instead of crawling the entire Web, we narrow our focus onto sites known to directly host, or at least provide links to, infringing content. These include torrent tracker sites, one-click download sites, mp3 sharing sites, and even YouTube, where our customers’ copyrighted content is often posted without permission.

Identifying Infringements

We use a three-stage system to indentify infringements, once our spider has indexed Web content: pattern-matching, statistical modeling and expert staff review.

DMCA Takedown Notices & Compliance Monitoring

Once we’ve identified infringements, we issue DMCA takedown notices. Once those are sent, our engine begins monitoring the links contained in the notices for compliance with the DMCA takedown requests.

After a grace period, if the infringing links haven’t been removed by the site operators we notified, then we automatically issue a second wave takedown notices. Another grace period is given for compliance with our second wave of takedown notices, after which time, we may opt to notify registrars and internet payment service providers, informing them of non-compliance and violations of their terms of service.