clone

package
Version: v0.0.0-...-86b787e Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Oct 31, 2020 License: Apache-2.0 Imports: 12 Imported by: 0

Documentation

Index

Constants

View Source
const KushtakaUrlPlaceholder = "KUSHTAKA_URL_REPLACE"

Variables

View Source
var DEPTH int
View Source
var URI, SCHEME, DOMAIN, PRIMARYLINK string

Functions

func RedirectHandler

func RedirectHandler(req *http.Request, via []*http.Request) error

SetRedirectHandler instructs the Collector to allow multiple downloads of the same URL

func Run

func Run(user_submitted_uri string, user_submitted_depth int, origdb *storm.DB) error

Types

type ForceAssets

type ForceAssets struct {
	Assets map[string]string
	// contains filtered or unexported fields
}

type Redirect

type Redirect struct {
	ID         int64  `storm:"id,increment"`
	StatusCode int    `storm:"index"`
	URL        string `storm:"index,unique"`
	GotoURL    string `storm:"index"`
	Headers    http.Header
}

type Res

type Res struct {
	ID         int64  `storm:"id,increment"`
	StatusCode int    `storm:"index"`
	URL        string `storm:"index,unique"`
	Headers    http.Header
	Body       []byte
	Orig       []byte
}

Source Files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
t or T : Toggle theme light dark auto