godensity

package module

v0.0.0-...-823ec5a Latest Latest Go to latest Published: Apr 18, 2022 License: MIT Imports: 8 Imported by: 0

Details

Valid go.mod file

The Go module system was introduced in Go 1.11 and is the official dependency management solution for Go.
Redistributable license

Redistributable licenses place minimal restrictions on how software can be used, modified, and redistributed.
Tagged version

Modules with tagged versions give importers more predictable builds.
Stable version

When a project reaches major version v1 it is considered stable.
Learn more about best practices

This repository is implematation of 📄 DOM based content extraction via text density and I just tested this code for Korean web pages.

📄 DOM based content extraction via text density 논문의 내용을 Go로 구현 한 것입니다. 한국어 페이지들을 대상으로 테스트 해 봤습니다.

gh repo clone minarc/godensity
cd godensity
go test

This section is empty.

This section is empty.

func CTD() float32

func Density()

func DensitySum()

func Filtering(body *goquery.Selection)

func IsGIF(src *url.URL, currentURL *url.URL) bool

func TD() float32

type Heap struct {
	// contains filtered or unexported fields
}

type Node struct {
	T float32
	// contains filtered or unexported fields
}

func DiveIntoDOM(me *goquery.Selection, domain string) *Node

type Result struct {
	// contains filtered or unexported fields
}