webpalm

README

🌐 Advanced Web Traversal & Data Extraction 🚀

🔍 Crawl websites efficiently, extract structured data, and visualize connections. 🕵️‍♂️

---

🗺️ Table of Contents

• 📦 Installation
• ⚡ Features
• 🚀 Usage
• 📌 Examples
• 📜 Regex Patterns
• 🤝 Contributing

---

⚡ Features

• 🌳 Structured Web-Tree Generation

• 🕵️ Regex-Based Data Extraction

• ⚡ High-Speed Multi-threading

• 📂 Multiple Export Formats

• 🎨 Colorized Output & Robust Error Handling

---

📦 Installation

📥 Download Binary

📥 Compile from Source

git clone https://github.com/XORbit01/webpalm.git
cd webpalm
go build -o webpalm && ./webpalm

👉 Download Latest Release

📥 Install via Go

go install github.com/XORbit01/webpalm/v2@latest

---

🚀 Usage

webpalm -h

⚙️ Common Flags

🌎 -i, --include     # Include only specific domains (e.g., google.com, facebook.com)
🔗 -u, --url         # Target website  
📏 -l, --level       # Depth of traversal  
❌ -x, --exclude     # Exclude status codes (e.g., 404, 500)  
💾 -o, --output      # Save results (JSON, XML, TXT)  
🚀 -w, --worker      # Multi-threading workers  
🔍 --regexes         # Extract data using regex  

---

📌 Examples

🌲 Generate a Website Map

webpalm -u https://example.com -l2

💬 Extract Comments from Pages

webpalm -u https://example.com -l1 --regexes comments="\<\!--.*?-->" -o results.json

🚀 Crawl with Multi-threading

webpalm -u https://example.com -l3 -w 50

💾 Export Results

webpalm -u https://example.com -l2 -o output.xml

---

📜 Regex Patterns

🔍 Purpose	📜 Regex Pattern
📧 Emails	[a-zA-Z0-9_.+-]+@[a-zA-Z0-9-]+\.[a-zA-Z0-9-.]+
💬 Comments	\<\!--.*?-->
🔑 Tokens	[a-zA-Z0-9]{32}
🔐 Passwords	\bpassword\b.{0,10}

📌 Escape special characters if needed.

---

🤝 Contributing

💡 Pull requests are welcome! Open an issue before major changes.
📢 Discord: xorbit.

---