The hdporncomics project offers an unofficial API for accessing and downloading content from hdporncomics. This tool simplifies interactions with the website, allowing users to programmatically retrieve comics, manhwas, chapters, and other related data efficiently.

Project Features

• CLI Access: Utilize a command-line interface to download images and metadata associated with comics and manhwas effortlessly. Basic CLI usage is straightforward:

hdporncomics --directory DIR URL1 URL2 URL3

This command creates a dedicated directory for each resource, organizing images and related information systematically.

• Flexible Download Options: The tool supports various download configurations, including the ability to control the number of threads, image naming conventions, and metadata options. For example, one can execute:

hdporncomics --directory DIR --threads 8 --images-only URL1 URL2 URL3

This command allows for parallel downloads of images without any metadata, enhancing speed and efficiency.

• Metadata Management: Manage and prioritize downloads of comments, likes, and other metadata through adjustable commands that ensure the right data is fetched and stored. For instance, comments can be limited or set to capture all available information.

• Adaptive Features: Advanced options such as delay patterns between requests, error retries, and custom user agents can be configured to optimize scraping behavior and mimic natural browsing patterns, enhancing data retrieval reliability.

• Python Library: In addition to the CLI tool, a Python library is available for deeper integration into existing applications. Users can interact with the API programmatically, enabling capabilities such as logging in, commenting, and managing favorites. An example snippet for utilizing the API is:

from hdporncomics import hdporncomics

hdpo = hdporncomics(wait=1.2)

# Example of downloading metadata
comic_data = hdpo.get_comic('comic_url_here')

Scalable Web Scraping

At the core of this project is the hdporncomics-scrape tool, designed for comprehensive site scraping. It systematically traverses the site, gathering data while avoiding duplicates and managing bandwidth effectively. Users can initiate scraping with a single command while adjusting settings for wait times and resource limits.

With proven functionality and extensive customization options, this project is a valuable resource for developers looking to work with comic content programmatically, offering both ease of use and robust performance.