config

package

v0.0.0-...-28f2d27 Latest Latest Go to latest Published: Apr 4, 2021 License: Apache-2.0 Imports: 6 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

github.com/linuxing3/gospider

Links

Open Source Insights

Documentation ¶

Index ¶

Variables
func GetDataList(htmlContent string, selector string) (*goquery.Selection, error)
func GetHTTPHtmlContent(url string, selector string, selected interface{}) (htmlContent string, err error)
func InitChromedpOptions(headless bool) context.Context

Constants ¶

This section is empty.

Variables ¶

View Source

var (
	DocBodySelector   = "document.querySelector('body')"
	ChromeAgentConfig = `Mozilla/5.0 (Windows NT 6.3; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/73.0.3683.103 Safari/537.36`
)

Functions ¶

func GetDataList ¶

func GetDataList(htmlContent string, selector string) (*goquery.Selection, error)

GetDataList 得到数据列表

func GetHTTPHtmlContent ¶

func GetHTTPHtmlContent(url string, selector string, selected interface{}) (htmlContent string, err error)

GetHTTPHtmlContent 获取网站上爬取的数据 url [string] 网址 selector [string] 必须显示的元素 selected [interface] 要抓取的元素

func InitChromedpOptions ¶

func InitChromedpOptions(headless bool) context.Context

InitChromedpOptions 控制是否以无头方式启用Chrome, 初始化参数先传一个空的数据

Types ¶

This section is empty.

Source Files ¶

View all Source files

chrome.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL