Documentation
¶
Overview ¶
Package selenium implements linkedin data scraping with selenium automatisation.
Index ¶
- Constants
- func CloseHandler(wd selenium.WebDriver)
- func CreateSeleniumServer(threadNumber int, initialPort int) []*os.Process
- func CreateWorker(currentWd selenium.WebDriver, threadNumber int, initialPort int) []selenium.WebDriver
- func DecodeReconstruct(searchURL string) (string, error)
- func DecodeRetry(wd selenium.WebDriver) string
- func KillProcess(proc []*os.Process)
- func ReadFile(f *os.File) []string
- func SlicePrint(s []string)
- func Start(comp string, threadNumber int)
- func StartProcess(port int) *os.Process
- func WriteFile(fileName string, buff []string)
Constants ¶
View Source
const ( LITTLE_WAIT = time.Millisecond * 100 MEDIUM_WAIT = time.Second BIG_WAIT = time.Second * 3 )
Variables ¶
This section is empty.
Functions ¶
func CloseHandler ¶
CloseHandler handle program Interruption and perform a clean exit
func CreateSeleniumServer ¶
CreateSeleniumServer Lauch selenium server for workers
func CreateWorker ¶
func CreateWorker(currentWd selenium.WebDriver, threadNumber int, initialPort int) []selenium.WebDriver
CreateWorker Spawn "t" webdriver simulate multithreading and reduce runtime
func DecodeReconstruct ¶
DecodeReconstruct Decode the searchURL and build the search URL for the main company
func DecodeRetry ¶
DecodeRetry Attempt getting currentURL
func KillProcess ¶
KillProcess Kill process started by StartProcess()
func StartProcess ¶
StartProcess Start an OS Process : Used to start selenium standalone server on n port for multiple webdriver worker
Types ¶
This section is empty.
Source Files
Click to show internal directories.
Click to hide internal directories.