1337x-scraper

1337x-scraper: Your Comprehensive Torrent Scraping Tool

1337x-scraper is a powerful and efficient tool designed specifically for scraping torrents from the 1337x website. This repository contains a streamlined approach to gather torrent links, facilitating easier access to the desired content.

Project Overview

Originally, the scraping process utilized two scripts, torrents.py and links.py. The links.py script allowed users to input keywords and search through various pages, categories, and sorting methods to extract torrent links. The script continuously optimized the extraction of unique keywords from the torrent titles until no more could be found. However, this complexity was simplified in later iterations of the tool, leading to the consolidation of functionality into a single script, torrents.py, which now handles all aspects of torrent retrieval.

Key Functionalities

1. Robust Scraping: The tool can scrape links from the entire site or specific URLs, allowing for flexible and efficient content retrieval.
2. Multiple Threads: Users can scrape using multiple threads to enhance performance by facilitating quicker data extraction.
3. Error Handling: The tool cleverly manages errors by maintaining records of non-existent and failed torrent IDs, retrying only the necessary requests while skipping already processed torrents.
4. Download Options: Torrents can be downloaded using specific URLs or by scraping the entire site, offering versatility based on user needs.

Usage Examples

To download specific torrents with URLs:

./torrents.py 'https://1337x.to/torrent/6416873/Murderbot-S01E05-1080p-x265-ELiTE/' 'https://1337x.to/torrent/6417145/The-Surfer-2024-1080p-WEB-DL-DDP5-1-x265-NeoNoir/'

To scrape the entire site with a specified number of threads (for instance, 6):

./torrents.py -t 6

Output Format

The output is organized in JSON format, providing comprehensive details about the torrent such as title, magnet link, file size, upload date, and additional metadata:

{
  "title": "The.Amateur.2025.1080p.WEB-DL.DDP5.1.x265-NeoNoir",
  "magnet": "magnet:?xt=urn:btih:495DF65F08FB18DFA91A881EC713CC8825865E4D\\",
  "category": "Movies",
  "size": 2040109465,
  // More details...
}

Important Notes

This tool operates with a copycat site, 1337xx.to, as the primary data source to circumvent the restrictions imposed by the official 1337x website. The alternative site's features allow easier access to consistent and up-to-date torrent data without the heavy blocking typical of the official domain, making it an ideal resource for scraping.

Ideal for Developers and Torrent Enthusiasts

Whether developing an application or simply seeking to collect torrents more efficiently, the 1337x-scraper is a reliable tool designed to meet diverse scraping needs.