scrape-me-a-lecture

Scrape Me A Lecture

SMAL is a small (no pun intended) utility for downloading new lectures as they are released on the website.

The tool is written in Go, and is using the Colly framework for scraping the site.

Setup Environment

Below is some general steps to get you started contributing.

export GOPATH=$HOME/.go
export PATH=$PATH:$GOPATH/bin

Add repo as a private, or else you'll recieve an error.

go env -w GOPRIVATE=gitlab.com/hitchhikers/scrape-me-a-lecture

Read more about Go modules here.

Alternatively:

[url "git@gitlab.com:"]
  insteadOf = https://gitlab.com/

Might need the above because it's a private repo.

Run the app

go run .

Install (DON'T USE)

go get -u gitlab.com/hitchhikers/scrape-me-a-lecture

Deubg

If all else fails:

go clean -cache -modcache -i -r

Use only for removing the cache.

Resources

• Forelesninger
• Colly

Pre-commit-hooks

Install pre-commit from https://pre-commit.com/

Run command below in repo-folder to install hook:

pre-commit install

Then the checks in .pre-commit-config.yaml will be run before each commit.