README
¶
go-meta-extractor
Robust starter template for a new Go library
Table of Contents
Installation
go-meta-extractor requires a supported release of Go.
go get -u github.com/mrz1836/go-meta-extractor
Documentation
View the generated documentation
Repository Features
This repository was created using MrZ's go-template
Built-in Features
- Continuous integration via GitHub Actions
- Build automation via Make
- Dependency management using Go Modules
- Code formatting using gofumpt and linting with golangci-lint and yamllint
- Unit testing with testify, race detector, code coverage HTML report and Codecov report
- Releasing using GoReleaser on new Tag
- Dependency scanning and updating thanks to Dependabot and Nancy
- Security code analysis using CodeQL Action
- Automatic syndication to pkg.go.dev on every release
- Basic templates for Issues and Pull Requests in GitHub
- Code ownership configuration for GitHub
- Automatic sync for labels into GitHub using a pre-defined configuration
- Built-in powerful merging rules using Mergify
- Welcome new contributors on their first Pull-Request
- Follows the standard-readme specification
- Visual Studio Code configuration with Go
- (Optional) Slack, Discord or Twitter announcements on new GitHub Releases
- (Optional) Easily add contributors in any Issue or Pull-Request
Library Deployment
Releases are automatically created when you create a new git tag!
If you want to manually make releases, please install GoReleaser:
goreleaser for easy binary or library deployment to GitHub and can be installed:
- using make:
make install-releaser - using brew:
brew install goreleaser
The .goreleaser.yml file is used to configure goreleaser.
Automatic Releases on Tag Creation (recommended)
Automatic releases via GitHub Actions from creating a new tag:
make tag version=1.2.3
Manual Releases (optional)
Use make release-snap to create a snapshot version of the release, and finally make release to ship to production (manually).
Makefile Commands
View all makefile commands
make help
List of all current commands:
all Runs multiple commands
clean Remove previous builds and any cached data
clean-mods Remove all the Go mod cache
coverage Shows the test coverage
diff Show the git diff
generate Runs the go generate command in the base of the repo
godocs Sync the latest tag with GoDocs
help Show this help message
install Install the application
install-all-contributors Installs all contributors locally
install-go Install the application (Using Native Go)
install-releaser Install the GoReleaser application
lint Run the golangci-lint application (install if not found)
release Full production release (creates release in Github)
release Runs common.release then runs godocs
release-snap Test the full release (build binaries)
release-test Full production test release (everything except deploy)
replace-version Replaces the version in HTML/JS (pre-deploy)
tag Generate a new tag and push (tag version=0.0.0)
tag-remove Remove a tag if found (tag-remove version=0.0.0)
tag-update Update an existing tag to current commit (tag-update version=0.0.0)
test Runs lint and ALL tests
test-ci Runs all tests via CI (exports coverage)
test-ci-no-race Runs all tests via CI (no race) (exports coverage)
test-ci-short Runs unit tests via CI (exports coverage)
test-no-lint Runs just tests
test-short Runs vet, lint and tests (excludes integration tests)
test-unit Runs tests and outputs coverage
uninstall Uninstall the application (and remove files)
update-contributors Regenerates the contributors html/list
update-linter Update the golangci-lint package (macOS only)
vet Run the Go vet application
Examples & Tests
All unit tests and examples run via GitHub Actions and uses Go version 1.19.x. View the configuration file.
Run all tests (including integration tests)
make test
Run tests (excluding integration tests)
make test-short
Benchmarks
Run the Go benchmarks:
make bench
Code Standards
Read more about this Go project's code standards.
Usage
Checkout all the examples!
Contributing
View the contributing guidelines and follow the code of conduct.
How can I help?
All kinds of contributions are welcome 🙌! The most basic way to show your support is to star 🌟 the project, or to raise issues 💬. You can also support this project by becoming a sponsor on GitHub 👏 or by making a bitcoin donation to ensure this journey continues indefinitely! 🚀
Contributors ✨
Thank you to these wonderful people (emoji key):
 Mr. Z 🚇 💻 🚧 🛡️ |
This project follows the all-contributors specification.
License
Documentation
¶
Overview ¶
Package metaextractor will extract the title, description, OG & meta tags from HTML
If you have any suggestions or comments, please feel free to open an issue on this GitHub repository!
By MrZ (https://github.com/mrz1836)
Index ¶
Examples ¶
Constants ¶
const ( TagBody = "body" TagContent = "content" TagMeta = "meta" TagMetaAuthor = "author" TagMetaDescription = "description" TagName = "name" TagOGAuthor = "og:author" TagOGDescription = "og:description" TagOGImage = "og:image" TagOGPublisher = "og:publisher" TagOGSiteName = "og:site_name" TagOGTitle = "og:title" TagProperty = "property" TagTitle = "title" TagTwitterCard = "twitter:card" TagTwitterDescription = "twitter:description" TagTwitterImage = "twitter:image" TagTwitterPlayer = "twitter:player" TagTwitterPlayerHeight = "twitter:player:height" TagTwitterPlayerWidth = "twitter:player:width" TagTwitterTitle = "twitter:title" )
Tag and Property constants for parsing
Variables ¶
This section is empty.
Functions ¶
This section is empty.
Types ¶
type Tags ¶
type Tags struct {
Author string `json:"author"`
Description string `json:"description"`
OGAuthor string `json:"og_author"`
OGDescription string `json:"og_description"`
OGImage string `json:"og_image"`
OGPublisher string `json:"og_publisher"`
OGSiteName string `json:"og_site_name"`
OGTitle string `json:"og_title"`
Title string `json:"title"`
TwitterDescription string `json:"twitter_description"`
TwitterImage string `json:"twitter_image"`
TwitterCard string `json:"twitter_card"`
TwitterPlayer string `json:"twitter_player"`
TwitterPlayerHeight string `json:"twitter_player_height"`
TwitterPlayerWidth string `json:"twitter_player_width"`
TwitterTitle string `json:"twitter_title"`
}
Tags is the html/meta tags to extract and process
func Extract ¶
Extract is the method used to extract HTML tags
Example ¶
ExampleExtract will show an example using the extractor
// Set a client
client := &http.Client{Timeout: 20 * time.Second}
// Start the request
req, err := http.NewRequestWithContext(
context.Background(), http.MethodGet, "https://mrz1818.com", nil,
)
if err != nil {
log.Fatal(err)
}
// Fire the request
var resp *http.Response
if resp, err = client.Do(req); err != nil {
log.Fatal(err)
}
// Close the body
defer func() {
_ = resp.Body.Close()
}()
// Extract the meta tags
tags := Extract(resp.Body)
fmt.Println(tags.Author)
Output: MrZ, Proof of Work LLC
Source Files
Directories