web-extractor

Here are 6 public repositories matching this topic...

gamemann / web-extract-with-chatgpt

A Python project that extracts data from websites with the option to process the data through @openai's ChatGPT API. The results are either printed to stdout or sent via a POST request.

Updated Jan 20, 2025
Python

fatihyildizli / web-structured-data-extractor

Star

💎 Extract semantically structured information from any raw HTML or URL, supportted formats "Microdata, RDFa,JSON-LD, opengraph and meta tags.

nodejs-crawler web-structured-data web-extractor nodejs-extractor web-data-extractor nodejs-jsonld nodejs-rdfa nodejs-microdata nodejs-opengraph nodejs-web-extractor nodejs-information-retrieval rdfa-extractor jsonld-extractor opengraph-extractor microdata-extractor schemaorg-extractor schemaorg-nodejs-extractor structured-data-extractor nodejs-web-schemaorg

Updated Dec 13, 2021
JavaScript

Alpha-Park / genpark-semantic-web-crawler-and-clean-markdown-distiller-skill

Star

Extracts clean LLM-ready Markdown and citation links from raw HTML while stripping scripts, navbars, and boilerplate

mcp html-to-markdown python-standard-library web-extractor rag-pipeline agent-skills content-cleaner llm-ingestion markdown-distiller citation-extractor semantic-crawler

Updated Oct 12, 2026
Python

alphaparkinc / genpark-semantic-web-crawler-and-clean-markdown-distiller-skill

Star

Extracts clean LLM-ready Markdown and citation links from raw HTML while stripping scripts, navbars, and boilerplate

mcp html-to-markdown python-standard-library web-extractor rag-pipeline agent-skills content-cleaner llm-ingestion markdown-distiller citation-extractor semantic-crawler

Updated Oct 12, 2026
Python

clhforensics / article-to-pdf-extractor

Star

Quick and dirty text extractor - **NOTE** for personal research, archival, accessibility, and licensed-use workflows only; users are responsible for publisher terms; DO NOT redistribute copyrighted content.

javascript pdf accessibility single-page-app bookmarklet paywall no-backend research-tools web-extractor

Updated Aug 18, 2026
HTML

CINEFyLK / Web-Forensic-web

Star

Web analysis toolkit for real time API finding and source code extraction. ready for local run. highly effective web lookup tool

api web-development web-analytics webapp html-extraction web-extractor api-finder source-code-extraction code-lookup website-sourcecode-extractor

Updated Sep 23, 2026
JavaScript

Add this topic to your repo

To associate your repository with the web-extractor topic, visit your repo's landing page and select "manage topics."

Learn more