crawler

package
v0.0.0-...-77d1d51 Latest Latest
Warning

This package is not in the latest version of its module.

Go to latest
Published: Dec 15, 2017 License: MIT Imports: 15 Imported by: 0

Documentation

Overview

Package crawler provides a spider which crawls all the cloud services and learn about the infrastructure configs

Index

Constants

This section is empty.

Variables

This section is empty.

Functions

func CheckDNSRecordExists

func CheckDNSRecordExists(docs []storage.DNSDoc, newDoc storage.DNSDoc) bool

Checks if the document already exists in the list

func CrawlAllElbs

func CrawlAllElbs(region string, cwg *sync.WaitGroup)

Crawl all the loadbalncers in a AWS cloud

func CrawlAllInstances

func CrawlAllInstances(region string, cwg *sync.WaitGroup)

Crawl all the machines/instances/hosts/servers running on a AWS cloud

func CrawlAllRoute53

func CrawlAllRoute53(cwg *sync.WaitGroup)

Crawl all the DNS records in a AWS cloud

func CrawlDnsMadeEasy

func CrawlDnsMadeEasy(cwg *sync.WaitGroup)

func CrawlUltraDns

func CrawlUltraDns(cwg *sync.WaitGroup)

func MergeDnsRecords

func MergeDnsRecords(docs []storage.DNSDoc, dupDocs []storage.DNSDoc) []interface{}

Merge the redundant/duplicate document records

func PruneEC2Fields

func PruneEC2Fields(inst *ec2.Instance) storage.NodeDoc

Extract only the required fields and discard the unwanted fields

func PruneELBFields

func PruneELBFields(elb *elb.LoadBalancerDescription) storage.LBDoc

Extract only the required fields and discard the unwanted fields

func PruneR53Fields

func PruneR53Fields(dnsRec *route53.ResourceRecordSet) storage.DNSDoc

Extract only the required fields and discard the unwanted fields

func PruneUltraDnsFields

func PruneUltraDnsFields(dnsRec ultradns.RRSet) storage.DNSDoc

Extract only the required fields and discard the unwanted fields

func Run

func Run()

Types

This section is empty.

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL