gostruct

gostruct

gostruct populates Go structs from webpages using CSS selectors.

Install

go get github.com/bfontaine/gostruct

Usage

type MyStruct struct {
    Title string `gostruct:"#a-selector"`
    Desc  string `gostruct:"h1 .another .one"`
}

var ms MyStruct

gostruct.Fetch(&ms, "http://www.example.com")

gostruct supports all standard CSS selectors. Additionally, you can end a selector with /foo to get the foo attribute on the selected element. This works only on simple values (i.e. not on slices nor structs).

Example

The example program below searchs for "golang" on Google and prints the top results.

package main

import (
    "fmt"
    "os"

    "github.com/bfontaine/gostruct"
)

type Result struct {
    Title       string `gostruct:"h3.r"`
    Website     string `gostruct:".kv cite"`
    Description string `gostruct:".st"`
}

type Search struct {
    Results []Result `gostruct:"#search li.g"`
}

func main() {
    var s Search

    err := gostruct.Fetch(&s, "https://www.google.com/search?q=golang&hl=en")
    if err != nil {
        fmt.Printf("Error: %v\n", err)
        os.Exit(1)
    }

    for _, r := range s.Results {
        fmt.Printf("%s (%s) - %s\n", r.Title, r.Website, r.Description)
    }
}