scrapers

package
v0.0.0-...-dffe29a Latest Latest
Warning

This package is not in the latest version of its module.

 Go to latest Published: Aug 11, 2025 License: MIT Imports: 27 Imported by: 0

Documentation

Index

Constants

View Source 
const API_KEY string = "0001085cc708b9cef47080f064612ca5"

Found in dev tools on https://map.utdallas.edu/ in any call to https://api.concept3d.com/

View Source 
const BASE_URL string = "https://profiles.utdallas.edu/browse?page="
View Source 
const END_URL string = "/?map=" + UTD_MAP_ID + "&key=" + API_KEY
View Source 
const START_URL string = "https://api.concept3d.com"
View Source 
const UTD_MAP_ID string = "1772"

Found in https://map.concept3d.com/?id=1772

Variables

View Source 
var MAX_EVENTS_PER_DAY = 5000

Functions

func ScrapeAstra 

func ScrapeAstra(outDir string)

func ScrapeCalendar 

func ScrapeCalendar(outDir string)

Get the calendar data through API instead of scraping from website

func ScrapeCoursebook 

func ScrapeCoursebook(term string, startPrefix string, outDir string)

func ScrapeMapLocations 

func ScrapeMapLocations(outDir string)

func ScrapeMazevo 

func ScrapeMazevo(outDir string)

func ScrapeOrganizations 

func ScrapeOrganizations(outdir string)

func ScrapeProfiles 

func ScrapeProfiles(outDir string)

Types

type APICalendarResponse 

type APICalendarResponse struct {
	Events []RawEvent        `json:"events"`
	Page   map[string]int    `json:"page"`
	Date   map[string]string `json:"date"`
}

type RawEvent 

type RawEvent struct {
	Event map[string]interface{} `json:"event"`
}

Structure of the API response

Source Files

View all Source files

Jump to

Keyboard shortcuts

? : This menu
/ : Search site
f or F : Jump to
y or Y : Canonical URL
go.dev uses cookies from Google to deliver and enhance the quality of its services and to analyze traffic. Learn more.