extract

package

v0.0.0-...-b1b21d8 Latest Latest Go to latest Published: Oct 17, 2023 License: LGPL-3.0 Imports: 10 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

Repository

gitee.com/baixudong/gospider

README ¶

功能概述

从json中智能提取列表
从dom中智能提取列表
从dom中智能提取内容

Documentation ¶

Index ¶

func Content(html *bs4.Client) *bs4.Client
func Json(data gjson.Result) []gjson.Result
func Lis(html *bs4.Client, options ...ListOption) [][]*NodeA
func Lis2(html *bs4.Client, html2 *bs4.Client, options ...ListOption) [][]*NodeA
type ListOption
type NodeA
- func (obj *NodeA) MainNode() *bs4.Client
- func (obj *NodeA) Score() float64

Constants ¶

This section is empty.

Variables ¶

This section is empty.

Functions ¶

func Content ¶

func Content(html *bs4.Client) *bs4.Client

解析dom 内容

func Json ¶

func Json(data gjson.Result) []gjson.Result

解析json 中的列表

func Lis ¶

func Lis(html *bs4.Client, options ...ListOption) [][]*NodeA

解析dom 列表

func Lis2 ¶

func Lis2(html *bs4.Client, html2 *bs4.Client, options ...ListOption) [][]*NodeA

解析dom 多个列表

Types ¶

type ListOption ¶

type ListOption struct {
	HasTime  bool     //是否有时间
	Keywords []string //列表关键词
}

type NodeA ¶

type NodeA struct {
	Node  *bs4.Client //当前节点
	Time  string      //发布时间
	Href  string      //发布地址
	Title string      //标题
	// contains filtered or unexported fields
}

func (*NodeA) MainNode ¶

func (obj *NodeA) MainNode() *bs4.Client

func (*NodeA) Score ¶

func (obj *NodeA) Score() float64

Source Files ¶

View all Source files

extract.go

?	: This menu
/	: Search site
f or F	: Jump to
y or Y	: Canonical URL