README
¶
sitescraper
Scraping Websites in Go!
Examples:
Get InnerHTML:
html := "<html><body><div id="hello">Hello <u>World!</u></div></body></html>"
dom := sitescraper.ParseHTML(html)
innerHTML := dom.Filter("body").GetInnerHTML()
fmt.Println(innerHTML)
//Output: <div id="hello">Hello <u>World!</u></div>
Get Text:
html := "<html><body><div id="hello">Hello World!</div></body></html>"
dom := sitescraper.ParseHTML(html)
text := dom.Filter("div", "id", "hello").GetText()
fmt.Println(text)
//Output: Hello World!
Get Text from single Tags:
html := "<html><body><div>Hello World!</div><div>My name is Sam!</div></body></html>"
dom := sitescraper.ParseHTML(html)
dom = dom.Filter("div")
fmt.Println(dom.Tag[0].GetText()) //Output: Hello World!
fmt.Println(dom.Tag[1].GetText()) //Output: My name is Sam!
Works also with GetInnerHTML()
Get Website-Content:
html, err := sitescraper.Get("http://example.com/")
if err != nil {
log.Fatal(err)
}
dom := sitescraper.ParseHTML(html)
dom = dom.Filter("div")
fmt.Println(dom.GetInnerHTML())
Documentation
¶
Index ¶
Constants ¶
This section is empty.
Variables ¶
This section is empty.
Functions ¶
Types ¶
type Dom ¶
type Dom struct {
Tag []Tag
// contains filtered or unexported fields
}
func (Dom) Filter ¶
Filters the Dom by given parameters in the following order: Filter(tagname, attribute-name, attribute-value). For Example: d.Filter("div", "class", "main") You can also leave one argument out by typing d.Filter("", "class", "main") or d.Filter("*", "class", "main"). Or you can just filter the Dom by tagname using d.Filter("div") or by tagname and attribute using d.Filter("div", "class"). A filtered Dom can be filtered again with Filter() e.g. d.Filter("", "class", "main").Filter("span")
func (Dom) GetAttrValue ¶
Returns the Attribute-Value of all Tags of the Dom filtered by the given Attribute-Name as string
func (Dom) GetInnerHTML ¶
Returns whole innerHTML of all Tags of the Dom or filtered Dom as string
type Tag ¶
type Tag struct {
// contains filtered or unexported fields
}
func (Tag) GetAttrValue ¶
Returns the Value of the given Attribute as string
func (Tag) GetInnerHTML ¶
Returns InnerHTML inside a Tag as string
Source Files