Symbo1 / wsltools Star 317 Code Issues Pull requests Web Scan Lazy Tools - Python Package security package security-audit spider web-vulnerability-scanner security-scanner python-package crawling-framework security-automation security-tools spider-framework scanner-web security-tool Updated Jun 30, 2020 Python
HuberTRoy / Seen Star 13 Code Issues Pull requests A lightweight crawling/spider framework for everyone(support JavaScript!).:sparkles: python3 easy-to-use lightweight-framework web-crawling spider-framework javasciprt support-javascript Updated Jul 19, 2018 Python
Xunzhuo / AirSpider Sponsor Star 8 Code Issues Pull requests A Fast and Light Python Spider Framework 🕷️ redis crawler web spider asynchronous python3 distributed spider-framework crawler-python Updated Nov 14, 2023 Python
Windfarer / biu Star 6 Code Issues Pull requests biubiubiu~~ I'm a tiny web crawler framework python crawler spider web-crawler spider-framework Updated Aug 31, 2024 Python
sejal-rajput / Amazon-web-scraping-using-Scrapy-Framework Star 2 Code Issues Pull requests A web scraping script using scrapy framework of python to extract data from amazon.com website. python anaconda scrapy-spider scrapy-crawler spider-framework Updated Jan 30, 2022 Python
HorsesElectricStick / SchoolTeacherSpider Star 0 Code Issues Pull requests 这是一个用于爬取中国大学网站数据的爬虫框架 china college spider-framework Updated Nov 4, 2021 Python
Elsfa7-110 / csefo Star 0 Code Issues Pull requests csefo crawling and spidering Deep crawling – now the crawler will follow all internal links recursively and deeply. cli crawler headless bugbounty web-spider spider-framework gocrawler Updated Jul 12, 2025 Python