The project is in a healthy, maintained state
Link Scraper is a website link extractor API that pulls internal and external links from any webpage URL in real time. It resolves relative paths to absolute URLs, strips empty fragments, and returns anchor text with internal and external counts.
2005
2006
2007
2008
2009
2010
2011
2012
2013
2014
2015
2016
2017
2018
2019
2020
2021
2022
2023
2024
2025
2026
 Dependencies

Runtime

>= 1.0, < 3.0
~> 2.0
 Project Readme

Link Scraper is a website link extractor API that pulls internal and external links from any webpage URL in real time. It resolves relative paths to absolute URLs, strips empty fragments, and returns anchor text with internal and external counts.

The Link Scraper API provides a simple, reliable way to integrate link scraper functionality into your applications. Built for developers who need production-ready link scraper capabilities without the complexity of building from scratch.

View API Details →

License: MIT API Status Method Platform

Available on: npm NuGet PyPI RubyGems Packagist Go Dart JitPack


Quick Start

Using JavaScript

async function callLinkScraperAPI() {
    try {
        const requestBody = {
    "url": "https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html",
    "maxlinks": 20,
    "includequery": false
};

        const response = await fetch('https://api.apiverve.com/v1/linkscraper', {
            method: 'POST',
            headers: {
                'x-api-key': 'YOUR_API_KEY_HERE',
                'Content-Type': 'application/json'
            },
            body: JSON.stringify(requestBody)
        });

        const data = await response.json();
        console.log(data);
    } catch (error) {
        console.error('Error:', error);
    }
}

callLinkScraperAPI();

Using cURL

curl -X POST "https://api.apiverve.com/v1/linkscraper" \
  -H "x-api-key: YOUR_API_KEY_HERE" \
  -H "Content-Type: application/json" \
  -d '{
    "url": "https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html",
    "maxlinks": 20,
    "includequery": false
}'

Get your API key: https://apiverve.com

📁 For more examples, see the examples folder


Installation

Choose your preferred programming language:

📦 NPM (JavaScript/Node.js)

npm install @apiverve/linkscraper

View NPM Package → | Package Code →


🔷 NuGet (.NET/C#)

dotnet add package APIVerve.API.LinkScraper

View NuGet Package → | Package Code →


🐍 Python (PyPI)

pip install apiverve-linkscraper

View PyPI Package → | Package Code →


💎 Ruby (RubyGems)

gem install apiverve_linkscraper

View RubyGems Package → | Package Code →


🐘 PHP (Packagist)

composer require apiverve/linkscraper

View Packagist Package → | Package Code →


🎯 Dart (pub.dev)

dart pub add apiverve_linkscraper

View pub.dev Package → | Package Code →


🤖 Android (JitPack)

implementation 'com.github.apiverve:linkscraper-api:1.0.0'

Package Code →


🐹 Go

go get github.com/apiverve/linkscraper-api/go

Package Code →


Why Use This API?

Feature Benefit
Multi-language SDKs Native packages for JavaScript, Python, C#, Go, and Android
Simple Integration Single API key authentication, consistent response format
Production Ready 99.9% uptime SLA, served from 24 global regions
Comprehensive Docs Full examples, OpenAPI spec, and dedicated support

Documentation


What Can You Build?

The Link Scraper API is commonly used for:

  • Web Applications - Add link scraper features to your frontend or backend
  • Mobile Apps - Native SDKs for Android development
  • Automation - Integrate with n8n, Zapier, or custom workflows
  • SaaS Products - Enhance your product with link scraper capabilities
  • Data Pipelines - Process and analyze data at scale

API Reference

Authentication

All requests require an API key in the header:

x-api-key: YOUR_API_KEY_HERE

Get your API key: https://apiverve.com

Response Format

Every APIVerve endpoint returns the same envelope — check status, then read data:

{
  "status": "ok",
  "error": null,
  "data": { ... }
}

Example Response

A real response from the Link Scraper API:

{
  "status": "ok",
  "error": null,
  "data": {
    "url": "http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html",
    "linkCount": 16,
    "externalLinkCount": 13,
    "internalLinkCount": 3,
    "links": [
      {
        "text": "Documentation",
        "href": "http://docs.aws.amazon.com/AWSEC2/latest/UserGuide/concepts.html/index.html",
        "external": false
      },
      {
        "text": "Amazon EC2 Instance Types Guide",
        "href": "https://docs.aws.amazon.com/ec2/latest/instancetypes/instance-types.html",
        "external": true
      },
      {
        "text": "Amazon EC2 Auto Scaling",
        "href": "https://docs.aws.amazon.com/autoscaling/",
        "external": true
      }
    ],
    "uniqueDomains": [
      "docs.aws.amazon.com",
      "aws.amazon.com"
    ],
    "maxLinksReached": false
  }
}

Support & Community


Contributing

We welcome contributions! Please see CONTRIBUTING.md for guidelines.


Security

For security concerns, please review our Security Policy.


License

This project is licensed under the MIT License - see the LICENSE file for details.


Acknowledgments

Built with ❤️ by APIVerve

Copyright © 2026 APIVerve. All rights reserved.