crawl

package

v0.0.0-...-01033d1 Latest Latest Go to latest Published: Feb 14, 2023 License: Apache-2.0 Imports: 2 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This section is empty.

This section is empty.

func BuildRequest(method, url, referrer, cookie, os string, iscn, isjson bool, headers ...map[string]string) *httplib.BeegoHTTPRequest

构造request请求

func Crawl(method, url, referrer, cookie, os string, iscn, isjson, isdebug bool, headers ...map[string]string) (string, error)

普通采集函数封装不需要设置UA，采集函数会根据os设置ua 如果在headers设置ua，将重写ua，如果需要重写ua，确实可以这么做

This section is empty.